Dating summary: Really good all points, most of them I feel them or experienced.
Backwards Law: Emotions are weather, you can’t control them. You can control what you do with the emotions
You never know who you are until you have adversity in life.
SR-IOV (Single Root I/O Virtualization) is an extension to the PCI Express specification that lets a single physical device, like a network adapter, present itself as multiple separate virtual devices. Each virtual machine gets its own direct access to the hardware, bypassing the hypervisor’s software layer and delivering network performance close to what you’d get on bare metal. It was designed by the PCI-SIG standards body specifically to solve the performance bottleneck that virtualization creates when many VMs share one network card.
From this article about Meta Superintelligence, came across this link about Meta backbone designs at scale for EBB
opensm: I can’t find many blog posts with real hands-on about IB things. And this is a good one. It doesnt just show you the configuration, but the problems you can find. It seems it is better to use the Mellanox’s opensm
- systemctl status opensm –no-pager
- sudo sminfo
- sudo ibnetdiscover
- sudo saquery NR | grep -E “lid|NodeDescription”
- sudo tail -f /var/log/opensm.log
IB cable EEPROM: Interesting how critical can be having the correct cable from the EEPROM.
The label on a cable is marketing. The EEPROM inside it is a contract, and InfiniBand only honors contracts.
- mstlink -d –show_module
Veritasium: 1 billion heartbeats