Unexpected in Quantum Computing: A bit of a summary of the current state of quantum computing. In short, still quite to go (it seems you need 20 million qubits to break RSA-2048)
Huawei AI Cloud: Power hungry, all optics, etc. Interesting take from China to NVIDIA. And even more interesting, how to fence off all the tariffs and restrictions…
Google Ironwood TPUv7: “It scales up to 9,216 liquid cooled chips linked with breakthrough Inter-Chip Interconnect (ICI) networking spanning nearly 10 MW” I wonder how is the network… but doesnt give low level details, just marketing.
Daylight: Looks so nice!!! And it seems it can read kindle books. Tempting
NVIDIA Photonics: I read about co-packaged from some Sherada post’s… but I didn’t see it coming so fast in production. With my network operations hat on…. how is the troubleshooting done? It the part where the fiber breaks, you replace the whole device? I guess this has been thought very deeply.
The power consumed by optics in the network is enormous and so is the capital expense. Anecdotally, we have heard it said many times that the majority of the cost in a datacenter-scale cluster is in the optical transceivers at both ends of a link and the fiber optic cable between them. Some the pieces that link switches to network interface cards is 75 percent to 80 percent of the cost of a network, with the switches and the NICs making up the other 20 percent to 25 percent.
Xsight: Another network silicon vendor. The article mentions Tofino P4.. I hope doesn’t end that way. I didn’t know anything about Avigdor Willenz
In part, that expectation for big change comes from the fact that Avigdor Willenz is the company’s founding investor. Willenz founded Galileo Technology, a maker of Ethernet switch ASICs that sold to Marvell in 2001 for $2.7 billion, and that wealth has been spread around. Willenz invested in Annapurna Labs, which sold to Amazon Web Services in 2015 for $350 million and which has created its Nitro DPUs, Graviton CPUs, and Trainium and Inferentia AI engines. He was president (now chairman) and first investor in distributed flash block storage maker Lightbits Labs. Willenz was a co-founder of AI chip maker Habana Labs, which sold to Intel in 2019 for $2 billion and is the foundation of its Gaudi compute engine line.
Finger Strength: “I’ve never seen strength like this before” true story
Google TPUv6 Analysis: “… cloud infrastructure and which also is being tuned up by Google and Nvidia to run Google’s preferred JAX framework (written in Python) and its XLA cross-platform compiler, which speaks both TPU and GPU fluently.” So I guess this is a cross-compiler for CUDA?
“The A3 Ultra instances will be coming out “later this year,” and they will include Google’s own “Titanium” offload engine paired with Nvidia ConnectX-7 SmartNICs, which will have 3.2 Tb/sec of bandwidth interconnecting GPUs in the cluster using Google’s switching tweaks to RoCE Ethernet.” So again custom ethernet tweaks for RoCE, I hope it makes to the UEC? Not sure I understand having a Titanium offload and a connectx-7, are they not the same?
Alphafold: It is open to be used. Haven’t read properly the license.
OpenAI API key: ********************************************************************************************************************************************************************
Tip: To save this key for later, run one of the following and then restart your terminal. MacOS: echo 'export OPENAI_API_KEY=your_api_key' >> ~/.zshrc Linux: echo 'export OPENAI_API_KEY=your_api_key' >> ~/.bashrc Windows: setx OPENAI_API_KEY your_api_key
Zero Trust SSH. From Cloudflare. And this video I watched some months ago (and it is already 4y).
Finger Strength: I follow similar protocol, although not everyday, for warm up and I think it works. I am not getting that super results but at least my fingers are stronger…. and I am not getting injuries!!!! \o/
Create different networks (inter-GPU, front-end, storage, mgmt),
Inter-GPU:
– non-blocking, rails-optimized (fig.3)
Inter-GPU challenges:
– Packet loss: Use PFC +ECN (flow aware)
– Network delay: “Rich” QoS – proprietary QoS to handle mice flows. Needs good telemetry
– Network congestion: Some kind of communication switch-NIC
– Non-uniform utilization: Most vendors have something proprietary here, some dynamic LB and static-pinning?
– Simultaneous Elephant flows with large bursts: dynamic buffer protection (proprietary)
Videos:
Raoul Pal: Crypto Investment. His company. Go long run, invest a bit you can lose
Scott Galloway: Interesting his political analysis. Trump won and it seems Latins voted massively for him.
Bruce Dickinson: I read Bruce’s books some years ago so I was surprised to see him in a podcast. Need to finish it.
Eric Schmidt: I read one of his books some time ago so again, surprised to find him in a podcast. Still think Google has become evil and most of the good things he says are gone.
Javier Milei: I am not economist but it “seems” things are improving in Argentina. He is a character nonetheless. Need to finish it.
Matthew McConaughey: His book was really refreshing, and seeing him talking is the same. Raw, real.
Alex Honnold: You have to try hard if you want to do hard things.
I finished this book this week. I have been climbing for a while and I really love it. But as well, for several years I think I am not improving. I dont make a living with climbing but I want to try more difficult routes and challenge myself.
So I decided I was going to start to try different things to get stronger and climb harder. First of all, early this year, after watching this video, I decided to put in use my beastmaker board that was gathering dust…
It took me a weekend of DIY for completing it…. But has been worth it. Although I haven’t managed to get an schedule to do it twice a day. I do it on weekends morning and some non-climbing weekdays. I think I feel some improvement though.
Later on, I started to do weighted pull-ups as recommended by a fellow climber from the gym. This was the excuse to buy a harness after soooo many years! 🙂
Since last year, I had a finger injury so that kept me out of proper climbing for several months but I discovered endurance. I was only able to make easy routes and put low stress in my finger so with time I managed an expected endurance. So I was happy with that and I am trying to get an endurance session each week (if my skin agrees with that).
As well, I had watched this video several times and it helped too.
In the last couple of months I started to get back to the normal climbing checking how my finger was feeling. So I decided to keep adding things. And the book has clarified many things. I really need to improve my finger strength. Something I have ignored as I always thought it was too much for me and it was easy to get injured.
Prioritise fingers and flexibility. Work in your “core”
Do high-intensity strength training when you are fresh and well rested.
Finger strength takes time, it is a slow process, dont rush it. And dont get injured!
Important is to warm-up and stretch. So this is always do so I am happy I have it in my routine.
The book gives a lot examples (and have very nice pictures) for exercises.
So I need to try things and build my training plan. And very likely get back to the book to refresh things.
