{"id":1644,"date":"2024-03-18T21:06:33","date_gmt":"2024-03-18T21:06:33","guid":{"rendered":"https:\/\/blog.thomarite.uk\/?p=1644"},"modified":"2024-03-19T19:29:05","modified_gmt":"2024-03-19T19:29:05","slug":"meta-genai-infra-oracle-rdma-cerebras-co-packaged-optics-devin-figure01-summarize-youtube-videos-pdf-linux-cli","status":"publish","type":"post","link":"https:\/\/blog.thomarite.uk\/index.php\/2024\/03\/18\/meta-genai-infra-oracle-rdma-cerebras-co-packaged-optics-devin-figure01-summarize-youtube-videos-pdf-linux-cli\/","title":{"rendered":"Meta GenAI Infra, Oracle RDMA, Cerebras, Co-packaged optics, devin, figure01, summarize youtube videos, pdf linux cli, levulinic acid"},"content":{"rendered":"\n<p>Meta GenAI infra: <a href=\"https:\/\/engineering.fb.com\/2024\/03\/12\/data-center-engineering\/building-metas-genai-infrastructure\/\">link<\/a>. Interesting they have built two cluster one Ethernet and the other Infiniband, both without bottlenecks. I don&#8217;t understand if Gran Teton is where they install the NVIDIA GPUs? And for storage, I would expect something based on ZFS or similar. For performance, &#8220;We also optimized our network routing strategy&#8221;. And it is critical the &#8220;debuggability&#8221; for a system of this size. How quick you can detect a faulty cable, port, gpu, etc?<\/p>\n\n\n\n<p><a href=\"https:\/\/developer.nvidia.com\/blog\/oci-accelerates-hpc-ai-and-database-using-roce-and-nvidia-connectx\/\">Oracle RDMA<\/a>: This is an ethernet deployment with RDMA. The interesting part is the development <a href=\"https:\/\/conferences.sigcomm.org\/sigcomm\/2015\/pdf\/papers\/p523.pdf\">DC-QCN<\/a> (some ECN enhancement)<\/p>\n\n\n\n<p><a href=\"https:\/\/www.servethehome.com\/cerebras-wse-3-ai-chip-launched-56x-larger-than-nvidia-h100-vertiv-supermicro-hpe-qualcomm\/\">Cerebras WSE-3<\/a>: Looks like outside NVIDIA and AMD, this is the only other option. I wonder how much you need to change your code to work in this setup? They say it is easier&#8230;  I like the pictures about the cooling and racks.<\/p>\n\n\n\n<p><a href=\"https:\/\/www.servethehome.com\/broadcom-now-sampling-51-2t-co-packaged-optics-switch\/\">Co-packaged optics<\/a>: Interesting to see if this becomes a new &#8220;normal&#8221;. No more flapping links anybody? It is the fiber or replace the whole switch&#8230;.<\/p>\n\n\n\n<p>I have been watching several videos lately and I would like to be able to get a tool to give a quick summary of the video so I can have notes (and check if the tool is good). Some tools: <a href=\"https:\/\/www.summarize.tech\/\">summarize.tech<\/a>, <a href=\"https:\/\/sumtube.ai\/\">sumtubeai<\/a><\/p>\n\n\n\n<p><a href=\"https:\/\/www.youtube.com\/watch?v=vHpZEMesriU\">video1<\/a>, <a href=\"https:\/\/www.youtube.com\/watch?v=K2tGt2XWd9Q\">video2<\/a>, <a href=\"https:\/\/www.youtube.com\/watch?v=yrwSOMFZvHY\">video3<\/a>, <a href=\"https:\/\/www.youtube.com\/watch?v=ORqd9QAC8OY\">video4<\/a>, <a href=\"https:\/\/www.youtube.com\/watch?v=QVVe2rCHtN0\">video5<\/a>, <a href=\"https:\/\/www.youtube.com\/watch?v=B_5N_aDu3u0\">video6<\/a>, <a href=\"https:\/\/www.youtube.com\/watch?v=nDLb8_wgX50\">video7<\/a>, <a href=\"https:\/\/www.youtube.com\/watch?v=WEP5ubPMGDU\">video8<\/a>, <a href=\"https:\/\/www.youtube.com\/watch?v=ngvOyccUzzY\">video9<\/a>, <a href=\"https:\/\/www.youtube.com\/watch?v=IRCZ1Mt2a8M\">video10<\/a>, <a href=\"https:\/\/www.youtube.com\/watch?v=E5swtIjpxxA\">video11<\/a><\/p>\n\n\n\n<p><a href=\"https:\/\/www.cognition-labs.com\/introducing-devin\">Devin<\/a> and <a href=\"https:\/\/twitter.com\/Figure_robot\/status\/1767913661253984474\">Figure01<\/a>: Looks amazing and scary. I will need one robot for my dream bakery.<\/p>\n\n\n\n<p>I wanted to &#8220;extract&#8221; some pages from different pdfs in just one file. &#8220;<a href=\"https:\/\/www.howtogeek.com\/827186\/how-to-make-and-combine-pdf-files-on-the-linux-command-line\/\">qpdf<\/a>&#8221; looks like the tool for it.<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">qpdf --empty --pages first.pdf 1-2 second.pdf 1 -- combined.pdf<\/pre>\n\n\n\n<p><a href=\"https:\/\/en.wikipedia.org\/wiki\/Levulinic_acid\">levulinic acid<\/a>: I learnt about it from this <a href=\"https:\/\/www.bbc.com\/news\/business-36037874\">news<\/a>.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Meta GenAI infra: link. Interesting they have built two cluster one Ethernet and the other Infiniband, both without bottlenecks. I don&#8217;t understand if Gran Teton is where they install the NVIDIA GPUs? And for storage, I would expect something based on ZFS or similar. For performance, &#8220;We also optimized our network routing strategy&#8221;. And it &hellip; <a href=\"https:\/\/blog.thomarite.uk\/index.php\/2024\/03\/18\/meta-genai-infra-oracle-rdma-cerebras-co-packaged-optics-devin-figure01-summarize-youtube-videos-pdf-linux-cli\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Meta GenAI Infra, Oracle RDMA, Cerebras, Co-packaged optics, devin, figure01, summarize youtube videos, pdf linux cli, levulinic acid&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3,9,32,2],"tags":[],"class_list":["post-1644","post","type-post","status-publish","format-standard","hentry","category-unix","category-cooking","category-cpu","category-networks"],"_links":{"self":[{"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/posts\/1644","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/comments?post=1644"}],"version-history":[{"count":7,"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/posts\/1644\/revisions"}],"predecessor-version":[{"id":1677,"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/posts\/1644\/revisions\/1677"}],"wp:attachment":[{"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/media?parent=1644"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/categories?post=1644"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/tags?post=1644"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}