{"id":1831,"date":"2024-08-31T15:52:46","date_gmt":"2024-08-31T14:52:46","guid":{"rendered":"https:\/\/blog.thomarite.uk\/?p=1831"},"modified":"2025-04-18T22:11:09","modified_gmt":"2025-04-18T21:11:09","slug":"tesla-tcp-leopold-aig-race-cursor-sonnet","status":"publish","type":"post","link":"https:\/\/blog.thomarite.uk\/index.php\/2024\/08\/31\/tesla-tcp-leopold-aig-race-cursor-sonnet\/","title":{"rendered":"Tesla TCP, Cerebras Inference, Leopold AIG race, Cursor + Sonnet, AI AWS Engineering Infra, NVLink HGX B200 and UALink, Netflix encoding challenges, Food waste snacks, career advice AWS, Thick Skin"},"content":{"rendered":"\n<p><\/p>\n\n\n\n<p><a href=\"https:\/\/chipsandcheese.com\/2024\/08\/27\/teslas-ttpoe-at-hot-chips-2024-replacing-tcp-for-low-latency-applications\/\">Testa TCP replacement<\/a>: Instead of buying and spending a lot of money, built what you need. I assume very smart people around and real network engineering taking place.It is like a re-write of TCP but doesnt break it so your switches can still play with it. It seems videos are not available in the <a href=\"https:\/\/hc2024.hotchips.org\/\">hotchips<\/a> webpage yet. And this <a href=\"https:\/\/www.servethehome.com\/tesla-dojo-exa-scale-lossy-ai-network-using-the-tesla-transport-protocol-over-ethernet-ttpoe\/\">link<\/a> looks even better, even mentions Arista as the switching vendor. (<a href=\"https:\/\/www.youtube.com\/watch?v=fqjbDudFVSo\">video<\/a> from hotchips24)<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"570\" src=\"https:\/\/blog.thomarite.uk\/wp-content\/uploads\/2024\/08\/image-6-1024x570.png\" alt=\"\" class=\"wp-image-1982\" srcset=\"https:\/\/blog.thomarite.uk\/wp-content\/uploads\/2024\/08\/image-6-1024x570.png 1024w, https:\/\/blog.thomarite.uk\/wp-content\/uploads\/2024\/08\/image-6-300x167.png 300w, https:\/\/blog.thomarite.uk\/wp-content\/uploads\/2024\/08\/image-6-768x427.png 768w, https:\/\/blog.thomarite.uk\/wp-content\/uploads\/2024\/08\/image-6-1536x855.png 1536w, https:\/\/blog.thomarite.uk\/wp-content\/uploads\/2024\/08\/image-6-2048x1140.png 2048w, https:\/\/blog.thomarite.uk\/wp-content\/uploads\/2024\/08\/image-6-1200x668.png 1200w\" sizes=\"auto, (max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><\/figure>\n\n\n\n<p><a href=\"https:\/\/www.servethehome.com\/cerebras-enters-ai-inference-blows-away-tiny-nvidia-h100-gpus-by-besting-hbm\/\">Cerebras Inference<\/a>: From hotchips 2024. I am still blow away for the waferscale solution. Obviously, the presentation says its product is the best but I wonder, can you install a &#8220;standard&#8221; linux and run your LLM\/Inference that easily?<\/p>\n\n\n\n<p>Leopold AIG race: Via <a href=\"https:\/\/www.linkedin.com\/posts\/sharada-yeluri_openai-agi-llms-activity-7232761965968789505-8R91\/\">linkedin<\/a>, then the <a href=\"https:\/\/situational-awareness.ai\/leopold-aschenbrenner\/\">source<\/a>. I read the chapter 3 regarding the race to the Trillion-Dollar cluster. It all looks Sci-Fi, but I think it may be not that far from reallity.<\/p>\n\n\n\n<p><a href=\"https:\/\/araneoides.eomail1.com\/web-version?ep=1&amp;lc=7301525e-4b4e-11ef-bab3-45aafcfcef5f&amp;p=8e8675d0-63d7-11ef-abcf-6b5a6073790a&amp;pt=campaign&amp;t=1724697918&amp;s=356d4a6d25e50baabcd8a4ed97604beff463bb9bb840499b3b3e3cd3d1467ca6\">Cursor + Sonet<\/a>: Replacement for copilot? <a href=\"https:\/\/x.com\/karpathy\/status\/1827143768459637073\">original<\/a> I haven&#8217;t used Copilot but at some point I would like to get into the wagon and try things and decide for myself.<\/p>\n\n\n\n<p><a href=\"https:\/\/www.aboutamazon.com\/news\/aws\/aws-infrastructure-generative-ai\">AI AWS Engineering Infra<\/a>: low-latency and large-scale networking (\\o\/), energy efficiency, security, AI chips.<\/p>\n\n\n\n<p><a href=\"https:\/\/www.servethehome.com\/ingrasys-shows-big-nvidia-nvlink-switch-chips-change-to-the-hgx-b200-b100\/\">NVLink HGX B200<\/a>: To be honest, I always forger the concept of NVLink and I told my self it is an &#8220;in-server&#8221; switch to connect all GPUs in a rack. <a href=\"https:\/\/www.linkedin.com\/posts\/sharada-yeluri_llms-genai-activity-7214314891904499712-vemG\/\">Still<\/a> this can help:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>At a high level, the consortium&#8217;s goal (<strong>UltraEthernet<\/strong>\/ UA) is to develop an open standard alternative to Nvidia&#8217;s NVLInk that can be used for intra-server or inter-server high-speed connectivity between GPU\/Accelerators to build scale-up AI\/HPC systems. The plan is to use AMD&#8217;s interconnect (Infinity Fabric) as the baseline for this standard.<\/p>\n<\/blockquote>\n\n\n\n<p><a href=\"https:\/\/www.theverge.com\/2024\/6\/22\/24171581\/netflix-bet-advanced-encoding-anne-aaron\">Netflix encoding challenges<\/a>: From encoding per quality of connection, to per-title, to per-shot. Still there are challenges for live streaming. Amazon does already live streaming for sports, have they &#8220;solved&#8221; the problem? I dont use Netflix or similar but still, the challenges and engineering behind is quite interesting.<\/p>\n\n\n\n<p><a href=\"https:\/\/www.linkedin.com\/posts\/harald-friedl_circulareconomy-zerowaste-linkedintopvoices-activity-7203292149931487232-OduF\/\">Food Waste snacks<\/a>: Indeed, we need more of this.<\/p>\n\n\n\n<p>Some <a href=\"https:\/\/www.linkedin.com\/posts\/leofurtadonyc_careergrowth-activity-7197189217716686849-YN46\/\">career advice<\/a> from AWS: I &#8220;get&#8221; the point but still you want to be up to speed  (at certain level) with new technologies, you dont want to become a dinosaur (ATM, frame-relay, pascal, etc). <\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>Again, it&#8217;s not about how much you technically know but how you put into use what you know to generate amazing results for a value chain.<br><br>Get the data &#8211; be a data-driven nerd if you will &#8211; define a problem statement, demonstrate how your solution translates to real value, and fix it.<\/p>\n<\/blockquote>\n\n\n\n<p><a href=\"https:\/\/benmeer.com\/newsletter\/thick-skin\/\">Thick Skin<\/a>:<\/p>\n\n\n\n<p>\u201cNot taking things personally is a superpower.\u201d \u2013James Clear<\/p>\n\n\n\n<p>Because \u201cno\u201d is normal.<\/p>\n\n\n\n<p>Before John Paul DeJoria built his billion-dollar empire with Patr\u00f3n and hair products, he hustled door-to-door selling encyclopedias. His&nbsp;<a href=\"https:\/\/link.mail.beehiiv.com\/ss\/c\/u001.zgWOu7NBgTR6LzrrinFP4a5JgoESmMMeq0xM-0870e2m9PZ6LKd8UhD0N9zhAKcOJE3KljtUxNjPrnOANFYj-D7wWWO3ijhaoTm-f9gpYsqCie2oUEd-YvKVPmEO6E5K3j9_wHkm8_4bxqF_y5rVHbuXDs3i_aVqKh-UGUzUdQZriW4BGYmF_UzZMLdT2Jw23zJGI2JxAF69rGHgBHIvkD9dktd5qREWARmKONHmlf4\/47n\/zonYwIpaS9y26KtzRoOf2A\/h2\/h001.ns7AkOvPIBLphtucBBHm4nUimWGe2MzZ4blOCWYwU6A\" target=\"_blank\" rel=\"noreferrer noopener\">wisdom shared at Stanford Business School<\/a>&nbsp;on embracing rejection is pure gold (start clip at 5:06).<\/p>\n\n\n\n<p>You see, life is a numbers game. Today&#8217;s winners often got rejected the most (but persevered). They kept taking smart shots on goal and, eventually, broke through.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Testa TCP replacement: Instead of buying and spending a lot of money, built what you need. I assume very smart people around and real network engineering taking place.It is like a re-write of TCP but doesnt break it so your switches can still play with it. It seems videos are not available in the hotchips &hellip; <a href=\"https:\/\/blog.thomarite.uk\/index.php\/2024\/08\/31\/tesla-tcp-leopold-aig-race-cursor-sonnet\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Tesla TCP, Cerebras Inference, Leopold AIG race, Cursor + Sonnet, AI AWS Engineering Infra, NVLink HGX B200 and UALink, Netflix encoding challenges, Food waste snacks, career advice AWS, Thick Skin&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[13,2,23],"tags":[],"class_list":["post-1831","post","type-post","status-publish","format-standard","hentry","category-aws","category-networks","category-programming"],"_links":{"self":[{"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/posts\/1831","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/comments?post=1831"}],"version-history":[{"count":11,"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/posts\/1831\/revisions"}],"predecessor-version":[{"id":1983,"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/posts\/1831\/revisions\/1983"}],"wp:attachment":[{"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/media?parent=1831"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/categories?post=1831"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/tags?post=1831"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}