{"id":1324,"date":"2023-05-29T17:21:24","date_gmt":"2023-05-29T16:21:24","guid":{"rendered":"https:\/\/blog.thomarite.uk\/?p=1324"},"modified":"2023-05-29T17:21:40","modified_gmt":"2023-05-29T16:21:40","slug":"amd-mi300-meta-dc","status":"publish","type":"post","link":"https:\/\/blog.thomarite.uk\/index.php\/2023\/05\/29\/amd-mi300-meta-dc\/","title":{"rendered":"AMD MI300 + Meta DC"},"content":{"rendered":"\n<p>Reading different articles: <a href=\"https:\/\/www.techradar.com\/news\/amds-extraordinary-next-gen-cpu-is-so-fast-itll-be-used-in-the-most-powerful-supercomputer-ever\">1<\/a>, <a href=\"https:\/\/www.techradar.com\/news\/amd-plans-to-bring-ram-closer-to-cpu-cores-but-dont-expect-it-on-pcs-soon\">2<\/a>, <a href=\"https:\/\/www.nextplatform.com\/2023\/05\/08\/ai-hype-will-drive-datacenter-gpu-prices-sky-high\/\">3<\/a>  I was made aware of this new architecture of CPU-GPU-HMB3 from AMD. <\/p>\n\n\n\n<p>As well, <a href=\"https:\/\/www.hpcwire.com\/2023\/05\/18\/meta-completes-research-supercluster-announces-next-gen-datacenter\/\">Meta<\/a> has a new DC design for ML\/AI using Nvidia and Infiniband.<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">Now, Meta \u2013 working with Nvidia, Penguin Computing and Pure Storage \u2013 has completed the second phase of the RSC. The full system includes 2,000 DGX A100 systems, totaling a staggering 16,000 A100 GPUs. Each node has dual AMD Epyc \u201cRome\u201d CPUs and 2TB of memory. The RSC has up to half an exabyte of storage and, according to Meta, one of the largest known flat InfiniBand fabrics in the world, with 48,000 links and 2,000 switches. (\u201cAI training at scale is nothing if we cannot supply the data fast enough to the GPUs, right?\u201d said Kalyan Saladi \u2013 a software engineer at Meta \u2013 in a presentation at the event.)<\/pre>\n\n\n\n<p>An again, <a href=\"https:\/\/www.datacenterfrontier.com\/data-center-design\/article\/33005296\/meta-previews-new-data-center-design-for-an-aipowered-future\">cooling<\/a> is critical.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Reading different articles: 1, 2, 3 I was made aware of this new architecture of CPU-GPU-HMB3 from AMD. As well, Meta has a new DC design for ML\/AI using Nvidia and Infiniband. Now, Meta \u2013 working with Nvidia, Penguin Computing and Pure Storage \u2013 has completed the second phase of the RSC. The full system &hellip; <a href=\"https:\/\/blog.thomarite.uk\/index.php\/2023\/05\/29\/amd-mi300-meta-dc\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;AMD MI300 + Meta DC&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[32,2],"tags":[],"class_list":["post-1324","post","type-post","status-publish","format-standard","hentry","category-cpu","category-networks"],"_links":{"self":[{"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/posts\/1324","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/comments?post=1324"}],"version-history":[{"count":2,"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/posts\/1324\/revisions"}],"predecessor-version":[{"id":1326,"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/posts\/1324\/revisions\/1326"}],"wp:attachment":[{"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/media?parent=1324"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/categories?post=1324"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/tags?post=1324"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}