Category: climbing

Huawei AI Cloud, Ironwood TPUv7, do the thing, TV garden Worldwide, Hacker Laws, Daylight, NVIDIA Photonics, Xsight, Finger Strength

Huawei AI Cloud: Power hungry, all optics, etc. Interesting take from China to NVIDIA. And even more interesting, how to fence off all the tariffs and restrictions…

Google Ironwood TPUv7: “It scales up to 9,216 liquid cooled chips linked with breakthrough Inter-Chip Interconnect (ICI) networking spanning nearly 10 MW” I wonder how is the network… but doesnt give low level details, just marketing.

Do the thing.

TV garden: TVs from around the world…. just in case you want to learn a language?

Hacker Laws: So many I dont know

Daylight: Looks so nice!!! And it seems it can read kindle books. Tempting

NVIDIA Photonics: I read about co-packaged from some Sherada post’s… but I didn’t see it coming so fast in production. With my network operations hat on…. how is the troubleshooting done? It the part where the fiber breaks, you replace the whole device? I guess this has been thought very deeply.

The power consumed by optics in the network is enormous and so is the capital expense. Anecdotally, we have heard it said many times that the majority of the cost in a datacenter-scale cluster is in the optical transceivers at both ends of a link and the fiber optic cable between them. Some the pieces that link switches to network interface cards is 75 percent to 80 percent of the cost of a network, with the switches and the NICs making up the other 20 percent to 25 percent. 

Xsight: Another network silicon vendor. The article mentions Tofino P4.. I hope doesn’t end that way. I didn’t know anything about Avigdor Willenz

In part, that expectation for big change comes from the fact that Avigdor Willenz is the company’s founding investor. Willenz founded Galileo Technology, a maker of Ethernet switch ASICs that sold to Marvell in 2001 for $2.7 billion, and that wealth has been spread around. Willenz invested in Annapurna Labs, which sold to Amazon Web Services in 2015 for $350 million and which has created its Nitro DPUs, Graviton CPUs, and Trainium and Inferentia AI engines. He was president (now chairman) and first investor in distributed flash block storage maker Lightbits Labs. Willenz was a co-founder of AI chip maker Habana Labs, which sold to Intel in 2019 for $2 billion and is the foundation of its Gaudi compute engine line.

Finger Strength: “I’ve never seen strength like this before” true story

TFCC wrist injury: part of life…

TPUv6, Alphafold, OOB design, OpenInterpreter, Walkie-Talkies, Zero Trust SSH, Videos, Finger Strength

Google TPUv6 Analysis: “… cloud infrastructure and which also is being tuned up by Google and Nvidia to run Google’s preferred JAX framework (written in Python) and its XLA cross-platform compiler, which speaks both TPU and GPU fluently.” So I guess this is a cross-compiler for CUDA?

“The A3 Ultra instances will be coming out “later this year,” and they will include Google’s own “Titanium” offload engine paired with Nvidia ConnectX-7 SmartNICs, which will have 3.2 Tb/sec of bandwidth interconnecting GPUs in the cluster using Google’s switching tweaks to RoCE Ethernet.” So again custom ethernet tweaks for RoCE, I hope it makes to the UEC? Not sure I understand having a Titanium offload and a connectx-7, are they not the same?

Alphafold: It is open to be used. Haven’t read properly the license.

OOB Design:

Open Interpreter: The next step in LLMs is to control/interact with your system.

In my laptop fails because I have the free version 🙁 need to try a different one, but looks promising!

open-interpreter main$ interpreter --model gpt-3.5-turbo

●                                                                                                                                                                                                                                                                  

Welcome to Open Interpreter.                                                                                                                                                                                                                                       

───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────

▌ OpenAI API key not found                                                                                                                                                                                                                                       

To use gpt-4o (recommended) please provide an OpenAI API key.                                                                                                                                                                                                      

To use another language model, run interpreter --local or consult the documentation at docs.openinterpreter.com.                                                                                                                                                   

───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────

OpenAI API key: ********************************************************************************************************************************************************************


Tip: To save this key for later, run one of the following and then restart your terminal.                                                                                                                                                                          
MacOS: echo 'export OPENAI_API_KEY=your_api_key' >> ~/.zshrc                                                                                                                                                                                                       
Linux: echo 'export OPENAI_API_KEY=your_api_key' >> ~/.bashrc                                                                                                                                                                                                      
Windows: setx OPENAI_API_KEY your_api_key                                                                                                                                                                                                                          

───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────

▌ Model set to gpt-3.5-turbo                                                                                                                                                                                                                                     

Open Interpreter will require approval before running code.                                                                                                                                                                                                        

Use interpreter -y to bypass this.                                                                                                                                                                                                                                 

Press CTRL-C to exit.                                                                                                                                                                                                                                              

> what is my os?
Traceback (most recent call last):

Walkie-Talkies: Out of James Bond world.

Zero Trust SSH. From Cloudflare. And this video I watched some months ago (and it is already 4y).

Finger Strength: I follow similar protocol, although not everyday, for warm up and I think it works. I am not getting that super results but at least my fingers are stronger…. and I am not getting injuries!!!! \o/

Cisco AI/ML DC Infra Challenges: I am not quiet fan of Cisco products but this is a good overview.

Key points:

  • Create different networks (inter-GPU, front-end, storage, mgmt),
  • Inter-GPU:
    • – non-blocking, rails-optimized (fig.3)
  • Inter-GPU challenges:
  • – Packet loss: Use PFC +ECN (flow aware)
  • – Network delay: “Rich” QoS – proprietary QoS to handle mice flows. Needs good telemetry
  • – Network congestion: Some kind of communication switch-NIC
  • – Non-uniform utilization: Most vendors have something proprietary here, some dynamic LB and static-pinning?
  • – Simultaneous Elephant flows with large bursts: dynamic buffer protection (proprietary)

Videos:

  • Raoul Pal: Crypto Investment. His company. Go long run, invest a bit you can lose
  • Scott Galloway: Interesting his political analysis. Trump won and it seems Latins voted massively for him.
  • Bruce Dickinson: I read Bruce’s books some years ago so I was surprised to see him in a podcast. Need to finish it.
  • Eric Schmidt: I read one of his books some time ago so again, surprised to find him in a podcast. Still think Google has become evil and most of the good things he says are gone.
  • Javier Milei: I am not economist but it “seems” things are improving in Argentina. He is a character nonetheless. Need to finish it.
  • Matthew McConaughey: His book was really refreshing, and seeing him talking is the same. Raw, real.
  • Alex Honnold: You have to try hard if you want to do hard things.

Beastmaking

I finished this book this week. I have been climbing for a while and I really love it. But as well, for several years I think I am not improving. I dont make a living with climbing but I want to try more difficult routes and challenge myself.

So I decided I was going to start to try different things to get stronger and climb harder. First of all, early this year, after watching this video, I decided to put in use my beastmaker board that was gathering dust…

It took me a weekend of DIY for completing it…. But has been worth it. Although I haven’t managed to get an schedule to do it twice a day. I do it on weekends morning and some non-climbing weekdays. I think I feel some improvement though.

Later on, I started to do weighted pull-ups as recommended by a fellow climber from the gym. This was the excuse to buy a harness after soooo many years! 🙂

Since last year, I had a finger injury so that kept me out of proper climbing for several months but I discovered endurance. I was only able to make easy routes and put low stress in my finger so with time I managed an expected endurance. So I was happy with that and I am trying to get an endurance session each week (if my skin agrees with that).

As well, I had watched this video several times and it helped too.

In the last couple of months I started to get back to the normal climbing checking how my finger was feeling. So I decided to keep adding things. And the book has clarified many things. I really need to improve my finger strength. Something I have ignored as I always thought it was too much for me and it was easy to get injured.

Prioritise fingers and flexibility. Work in your “core”

Do high-intensity strength training when you are fresh and well rested.

Finger strength takes time, it is a slow process, dont rush it. And dont get injured!

Important is to warm-up and stretch. So this is always do so I am happy I have it in my routine.

The book gives a lot examples (and have very nice pictures) for exercises.

So I need to try things and build my training plan. And very likely get back to the book to refresh things.