AWS re:Invent 2024 – Monday Night:
- Graviton evolution: ARM based chip for EC2. 50% new capacity of last 2y is Graviton.
- Nitron Cards: security chip too.
- AES Trainium2: min 47. 2xHead per rack and then accelerators, and switch. Trainnium != CPU|GPU
- Neurnlink: min 60, I guess this is the equivalent of NVLink, etc
- Ultraserver, quite beefy pic, min 61.
- Networking: min 73: 10p10u is a fabric = 10petabits under 10micro latency.
- Cabling proprietary trunk connector 16:1 fiber. min 77. I pretty use i have used pig-tails some years ago, so not sure why this is new?
- Firefly optic plug: loopback testing. This is interesting for DC operations. Min 78.
- AWS design their own optics, reduced failure
- Network topology: Min 81, new protocol SIDR – Scalable Intent Driven Routing. <1s reconvergence. not centralized.
- And this is a better summary than mine.
AWS re:Invent 2024 – NET201: The only interesting thing is minute 29 with the usage of hollow core fiber, to improve latency. I assume it is used in very specific parts of the network, looks a bit fragile. Elastic Fabric Adapter, not really good explanation what it is, where doest it run: network, server, nic? but it seems important. Looks like SIDR?
AWS re:Invent 2024 – NET403: I think 401 and 402 were more interesting. There were repeated things from the two other talks. Still worth watching and hopefully there is a new one in 2025.
Oracle Cloud Infra – AI: First time I visit the OCI page about their AI infra.
GenCast: weather predict by Google Mind. Not sure until what point, this can be used by anybody? And how much hardware you need to run it?
we’ve made GenCast an open model and released its code and weights, as we did for our deterministic medium-range global weather forecasting model.
Videos:
510km nonstop – Ross Edgley: I have read several of his books and it is the first time I watch a full interview. Still I am not clear what his dark side is.
A man with few friends or not circle at all – Jordan B Peterson: I need to watch this more often