Google TPUv6 Analysis: “… cloud infrastructure and which also is being tuned up by Google and Nvidia to run Google’s preferred JAX framework (written in Python) and its XLA cross-platform compiler, which speaks both TPU and GPU fluently.” So I guess this is a cross-compiler for CUDA?
“The A3 Ultra instances will be coming out “later this year,” and they will include Google’s own “Titanium” offload engine paired with Nvidia ConnectX-7 SmartNICs, which will have 3.2 Tb/sec of bandwidth interconnecting GPUs in the cluster using Google’s switching tweaks to RoCE Ethernet.” So again custom ethernet tweaks for RoCE, I hope it makes to the UEC? Not sure I understand having a Titanium offload and a connectx-7, are they not the same?
Alphafold: It is open to be used. Haven’t read properly the license.
Open Interpreter: The next step in LLMs is to control/interact with your system.
In my laptop fails because I have the free version 🙁 need to try a different one, but looks promising!
open-interpreter main$ interpreter --model gpt-3.5-turbo
●
Welcome to Open Interpreter.
───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
▌ OpenAI API key not found
To use gpt-4o (recommended) please provide an OpenAI API key.
To use another language model, run interpreter --local or consult the documentation at docs.openinterpreter.com.
───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
OpenAI API key: ********************************************************************************************************************************************************************
Tip: To save this key for later, run one of the following and then restart your terminal.
MacOS: echo 'export OPENAI_API_KEY=your_api_key' >> ~/.zshrc
Linux: echo 'export OPENAI_API_KEY=your_api_key' >> ~/.bashrc
Windows: setx OPENAI_API_KEY your_api_key
───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
▌ Model set to gpt-3.5-turbo
Open Interpreter will require approval before running code.
Use interpreter -y to bypass this.
Press CTRL-C to exit.
> what is my os?
Traceback (most recent call last):
Walkie-Talkies: Out of James Bond world.
Zero Trust SSH. From Cloudflare. And this video I watched some months ago (and it is already 4y).
Finger Strength: I follow similar protocol, although not everyday, for warm up and I think it works. I am not getting that super results but at least my fingers are stronger…. and I am not getting injuries!!!! \o/
Cisco AI/ML DC Infra Challenges: I am not quiet fan of Cisco products but this is a good overview.
Key points:
- Create different networks (inter-GPU, front-end, storage, mgmt),
- Inter-GPU:
- – non-blocking, rails-optimized (fig.3)
- Inter-GPU challenges:
- – Packet loss: Use PFC +ECN (flow aware)
- – Network delay: “Rich” QoS – proprietary QoS to handle mice flows. Needs good telemetry
- – Network congestion: Some kind of communication switch-NIC
- – Non-uniform utilization: Most vendors have something proprietary here, some dynamic LB and static-pinning?
- – Simultaneous Elephant flows with large bursts: dynamic buffer protection (proprietary)
Videos:
- Raoul Pal: Crypto Investment. His company. Go long run, invest a bit you can lose
- Scott Galloway: Interesting his political analysis. Trump won and it seems Latins voted massively for him.
- Bruce Dickinson: I read Bruce’s books some years ago so I was surprised to see him in a podcast. Need to finish it.
- Eric Schmidt: I read one of his books some time ago so again, surprised to find him in a podcast. Still think Google has become evil and most of the good things he says are gone.
- Javier Milei: I am not economist but it “seems” things are improving in Argentina. He is a character nonetheless. Need to finish it.
- Matthew McConaughey: His book was really refreshing, and seeing him talking is the same. Raw, real.
- Alex Honnold: You have to try hard if you want to do hard things.
