Tesla TCP, Cerebras Inference, Leopold AIG race, Cursor + Sonnet, AI AWS Engineering Infra, NVLink HGX B200 and UALink, Netflix encoding challenges, Food waste snacks, career advice AWS, Thick Skin

Testa TCP replacement: Instead of buying and spending a lot of money, built what you need. I assume very smart people around and real network engineering taking place.It is like a re-write of TCP but doesnt break it so your switches can still play with it. It seems videos are not available in the hotchips webpage yet. And this link looks even better, even mentions Arista as the switching vendor.

Cerebras Inference: From hotchips 2024. I am still blow away for the waferscale solution. Obviously, the presentation says its product is the best but I wonder, can you install a “standard” linux and run your LLM/Inference that easily?

Leopold AIG race: Via linkedin, then the source. I read the chapter 3 regarding the race to the Trillion-Dollar cluster. It all looks Sci-Fi, but I think it may be not that far from reallity.

Cursor + Sonet: Replacement for copilot? original I haven’t used Copilot but at some point I would like to get into the wagon and try things and decide for myself.

AI AWS Engineering Infra: low-latency and large-scale networking (\o/), energy efficiency, security, AI chips.

NVLink HGX B200: To be honest, I always forger the concept of NVLink and I told my self it is an “in-server” switch to connect all GPUs in a rack. Still this can help:

At a high level, the consortium’s goal (UltraEthernet/ UA) is to develop an open standard alternative to Nvidia’s NVLInk that can be used for intra-server or inter-server high-speed connectivity between GPU/Accelerators to build scale-up AI/HPC systems. The plan is to use AMD’s interconnect (Infinity Fabric) as the baseline for this standard.

Netflix encoding challenges: From encoding per quality of connection, to per-title, to per-shot. Still there are challenges for live streaming. Amazon does already live streaming for sports, have they “solved” the problem? I dont use Netflix or similar but still, the challenges and engineering behind is quite interesting.

Food Waste snacks: Indeed, we need more of this.

Some career advice from AWS: I “get” the point but still you want to be up to speed (at certain level) with new technologies, you dont want to become a dinosaur (ATM, frame-relay, pascal, etc).

Again, it’s not about how much you technically know but how you put into use what you know to generate amazing results for a value chain.

Get the data – be a data-driven nerd if you will – define a problem statement, demonstrate how your solution translates to real value, and fix it.

Thick Skin:

“Not taking things personally is a superpower.” –James Clear

Because “no” is normal.

Before John Paul DeJoria built his billion-dollar empire with Patrón and hair products, he hustled door-to-door selling encyclopedias. His wisdom shared at Stanford Business School on embracing rejection is pure gold (start clip at 5:06).

You see, life is a numbers game. Today’s winners often got rejected the most (but persevered). They kept taking smart shots on goal and, eventually, broke through.

Cloudflare backbone 2024, Cisco AI, Leetcode, Alibaba HPN, Altman UBI, xAI 100k GPU, Crowdstrike RCA, Github deleted data, DGX SuperPod, how ssh works, Grace Hooper Nvidia

Cloudflare backbone 2024: Everything very high level. 500% backbone capacity increase since 2021. Use of MPLS + SR-TE. Would be interesting to see how the operate/automate those many PoPs.

Cisco AI: “three of the top four hyperscalers deploying our Ethernet AI fabric” I assume it is Google, Microsoft and Meta? AWS is the forth and biggest.

Huawei Cloud Monitor: Haven’t read the paper RD-Probe. I would expect a git repo with the code 🙂 And refers to AWS pdf and video.

Automated Leetcode: One day, I should have time to use it a learn more programming, although AI can solve them quicker than me 🙂

Alibaba Cloud HPN: linkedin, paper, AIDC material

LLM Traffic Pattern: periodically burst flows, few flows (LB harder)

Sensitive to failures: GPU, link, switch, etc

Limitations of Traditional Clos: ECMP (hash polarization) and SPOF in TORs

HPN goals:

-Scalability: up to 100k GPU

-Performance: low latency (minimum amount of hops) and maximum network utilization

-Reliability: Use two TORs with LACP from the host.

Tier1

– Use single-chip switch 51.2Tbps. They are more reliable. Dual TOR

– 1k GPUs in a segment (like nv-link) Rail-optimized network

Tier2: Eliminating load imbalance: Using dual plane. It has oversubscription

Tier3: connects several pod. Can reach 100k GPUs. Independent front-end network

Altman Universal Base Income Study: It doesnt fixt all problems, but in my opinion, it helps, and it is a good direction.

xAI 100k GPU cluster: 100k liquid-cooled H100s on single RDMA fabric. Looks like Supermicro involved for servers and Juniper only front-end network. NVIDIA provides all ethernet switches with Spectrum-4. Very interesting.

Crowdstrike RCA:

Github access deleted data: Didn’t know about it. Interesting and scary.

Nvidia DGX SuperPod: reference architecture. video. 1 pod is 16 racks with 4 DGX each (128×8=1024 GPU per pod), 2xIB fabric: compute + storage, fat tree, rail-optimized, liquid cooling. 32k GPU fills a DC.

How SSH works: So powerful, and I am still so clueless about it

Chips and Cheese GH200: Nice analysis for Nvidia Grace CPU (ARM Neoverse) and Hopper H100 GPU

Find Love

I decided to read this book after watching this video some months ago. As I am not able to make a move in my dating live… and it is nearly 6y. I know I am not going to discover the grail of dating but at least I can try to refresh ideas, find encouragement, you name it, to start the work.

The book is crystal clear. Get your shit together, know yourself, know what you want, know what you dont want, dont fall in some traps, etc.

One of the things that I have collected and stays with me so far, it is the importance of having a “tribe” a.k.a a social network. And maybe this is not the most important point in the book. Still, I have a very small tribe, they are few but they are the best. So I have to work in increase my social network, and that is not just good for dating.

Something I have been doing in the last months is going to Bachata social dancing on Wednesdays after class and Saturday nights. It is hard for me. It is getting out our my confort zone. But this is the only way to improve, and it is not just improving my bachata skills. It is being comfortable being uncomfortable, knowing that you may be rejected when asking for a dance, or dancing once with a person and that person will not want to dance with you (because I am not a good dancer) again. But step by step (literally) is getting a bit better. Still long way to go, but I must carry on. Sometimes I talk to people so it is good. I feel less weird in those moments because you are coming on your own (and I am not the only one) and looks like everybody is having a good time and socialising.

Chapter 1

Identify and understand your attachment style: I am fearful-avoidant. But I would like to be Secure.

The village/tribe concept: Until not long ago (maybe when online dating started), your dating pool was around your social circle. It can be a tribe, a village, your neighbourhood, work, sport, etc. And your close members of that tribe will want the best for your.

Be clear about your goal in the relationship: short-term, long-term, family, etc

Chapter 2

You have to know yourself, that means work on you and go through your traumas, problems, etc and heal. Then you can start dating properly, as you will have a better vision (less noise). Have an open mind and be a lifelong learner to be your best self.

Soulmates are made not found.

Chapter 3

1st Be happy with yourself + self awareness -> successful relationship

=>

Good relationship -> makes you happier/healthier

Chapter 4

We are living in a changing world so we have to adapt and find the best approach to find our partner. And that includes online dating

Chapter 5

This is basic statistics and probability. The more people you can meet, the more chances you will have to find a partner. This is your job. And way to increase your social reach is using “those” weak connections (a friend you dont see often, a place, etc)

Chapter 6

Say what you want, be intentional. First impressions are important so make a strong one (I am going to struggle here). Work in your “social capital”: identify the things in your life you are passionate about and work towards becoming exceptional at them, and the important thing, it is not the goal, it is the journey.

Chapter 7: Green Flags

What you want and what you need are not the same. This applies to dating too. So make rational decisions about the criteria for your partner. There is a reference to Gary Chapman’s “The 5 Love Languages“. It is important to identify them, and they dont have to match. But they are not all.

Green Flags:

  • Emotional Fitness
  • Courageous Vision:
  • Resilient Resourcefulness:
  • Open-minded Understanding:
  • Compassionate Support

Summary here: Choose someone who matches your values, who will challenge you to grow and has the character to be for the good and bad times.

Chapter 8: Red Flags

Value your self-worth and refuse to settle for anything less than you deserve. That means you have to be very honest with your self and do the work.

Read Flags: Narcissism, Psychopathy, Machiavellianism and Sadism

Chapter 9: Commitment

Four elements of commitment readiness: trust, effective conflict resolution, high relationship satisfaction and not thinking there are better options available (you will be forever in the “game”)

Three things to make a relationship to work in the long term:

  • No Defensiveness, No Stonewalling, No Criticism, No Contempt
  • Relationship equity
  • Feeling your are becoming better, your best self

And you need to talk about all the above with your partner -> that means assertiveness and courage.

The Dark Forest

I finished the second part of The Three-Body Problem. It has hooked me again until the end. To be picky, how the hibernation was figured out? 🙂 And it is clear that being limited by the Sophons had to have an impact…

I liked the two axioms for cosmic civilization: 1) survival is the primary need of civilization 2) civilization continuosly grows and expands, but the total matter in the universe remains constant (that reminds me to you can’t destroy energy, just transform it). Plus “benevolence” and “malice”. You have all the tools now to survive in the dark forest that is the galaxy 🙂

And love. That came out of the blue.

Kwik Reading

I bought this course and completed it two months ago more or less. I am using the basic for my normal reading, although I should repeat it at some point to verify my improvement.

DAY 0

FAST
F=Forget (old habits, limitations)
A=Active (motivation, schedule)
S=State (be present, mood)
T=Teach (teach, your learn twice)

========

DAY 1: Finding Your Starting Place

  • consistent -> schedule it! create a habit: when you most awake and less distraction. 1st thing in morning? 10 minutes only!

WPM: 190

========

DAY 2

education
focus (if information gets quick enugh, your brain doesnt distract
regression (re-reading)s -> avoid it, creates momemtun!

  • visual pacer !!! -> something to underlay the words! finger or ruler
    • help to focus
    • eyes attract to movement
    • neurologic (smell + taste // seight + touch )

========

DAY 3

how to use a visual pacer:

========

DAY 4

move arm, not finger
upright posture (proper breathing) – tilt the book – face the book

========

DAY 5

mind over matter

indentation reading: start about an inch in and stop about an inch before the end.

========

DAY 6

eye health:
relax your eye muscles and activate both your left and right brain. I call this technique, a “lazy-8” or an “infinity technique.”: 1 minute before readings

========

DAY 7

read a book a week: 45m reading nornal -> 30m speeding read ?

========

DAY 8

subvocalization – Do you often hear your voice reading along with you?
-> “123 Technique” say 123 while you are reading –> keep in mind it is impossible to stop it.

========

DAY 9

using your left hand as the ruler!

========

DAY 10

speed drill: 4-3-2-1 (need to do it again!)

========

DAY 11

activating peripheral vision -> learn to juggle 3 balls (youtube)

========

DAY 12

boasting comprehension: read
finger
better questions -> your questions makes you on focus in x (questions are the answers)
(who, what, where, when, why)

========

DAY 13

FAQ: read everyday! 15 minutes (use finger, indentation, lazy eight, left hand)
4321 – 3 times per week
questions: 5-9 before reading
flexible speed reading
small habits, long result

========

DAY 14

boosting comprehension p2-> taking notes:

  • capture (left side: notes – logical) – create (right side: your impressions)
  • mind mapping
  • quadrants

========

DAY 15

boosting comprehension p3 -> relate

  • explain what you read to somebody: (1st buddy, 2nd call a friend, 3rd plant) – Externalize, speak aloud (dont talk to yourself!)

========

DAY 16

the importance of brain breaks
more primancy (first) and more recency (last)
each 30 minutes, 5 minutes brain break (10x deep breath, hidrate, stretch/move)

What is the primary response of your brain? Controlling movement.
super brain yoga:
left hand, touch your right ear
right hand, touch your left ear
sit ups at the same time

========

DAY 17

the power of reading backwards p1

  • skimming and then reading
    — Always use a visual pacer.
    — You can either go down the center of a page (traditional “speed reading”) or
    — You can also do a zig-zag method.
    ** The last and my favorite method of skimming is going one line forward and one line backwards.
    (left to right, next line right to left, etc etc) has to be quick! – creates confusion and question

========

DAY 18

introducing eye fixations

  • Average reader sees one word at a time.
  • Kwik Reader sees groups of words -> Eye Fixations: you need to see groups of words. start with some warm-up exercises to activate your peripheral vision 🙂
    • devide the page with one line. You have to parts, the divide each again.
      You will have four parts and 3 lines. You will stop only in the lines so you fixation will be three instead of the 10 average stops per line.

========

DAY 19

reading technical information

  • you won’t be able to read at the speed you would read light fiction

Step #1: Build a Map (5-Part Map Building Process)

  • Look at the pictures
  • Spot unfamiliar words
  • Ask 5-9 questions: (who, what, where, when, why)
  • Organize the chapter: check the table of contents or index -> build a mind map (or quadrant)
  • Visualize

Step #2: Skim through the chapter

Step #3: Read the chapter

========

DAY 20

5 levels of transformation

  • Environment (level 5)
  • Behavior (level 4)
  • Capability (level 3)
  • Beliefs & values (level 2)
  • Identity (level 1)

Level 1 Who – identity
Level 2 Why – beliefs and values
Level 3 How – capabilities
Level 4 What – behaviour
Level 5 Where & When – environment

========

DAY 21

Building a reading habit

B=MAT

B = Behavior/Habit. Pick a behavior you would like to incorporate.
M = Motivation. Give a score to your motivation. – I am 8, so what I need to get 10 — book time for reading everyday at work (lunch time) and weekend.
A = Ability. How can you increase the ability?
T = Trigger. What reminds you to do the behavior? -> book time in calendar / bring book to office the

Inch, Dig, Microarch, LLM101, Eureka, D-Wave, Etched Transformers, MatMul, Born To Run, Paris Bakeries, Demons

Inch by inch

Biggest impacts on health (35m): Tracking, Environment and Genetics.

Just Dig it: Very interesting company. I just dont understand if it is an ONG or for profit. Still, very cool mission

Microarch club: Looks very interesting but I can’t find time to listen to it.

LLM101: Another if you have time.

Eureka labs: Company behind LLM101

D-Wave 2024: Now everything is about AI, but quantum computing still can be a thing? I remember when the news came out about the fist commercial quantum computer

Etched: Transformers chip

MatMul free: I already linked this paper but these are “applications”: link1 link2

Interview about Born to Run: I liked the book and somehow now youtube shows me things related. This is the first video I watch from Rich Roll’s channel and I liked it. It starts with the announcement of the 2nd book that I think I will buy at some point. And I need to check Eric Orton work as I want to improve my running (and recover from my injury) and see how i can do it with my “broken” knee and age.. I am starting to do the exercises recommended at the end as want to see if I can get to a bit more minimal shoes at some point. Let’s see how it goes.

Paris Bakeries: I need to get back to Paris. I am going to start collecting sites to visit there:

Apollonia Poilâne
Cedric Grolet
pastry combos

Overcome your demons: I read this book a couple of years ago, and this video is a reminder that I need to read it again.

The Diary of a CEO

I have watched many videos from this channel and to be honest I thought the book should be interesting to read:

Pillar 1: The self

1: Fill your 5 buckets in the right order: knowledge (what you know)-> skills (what you can do) -> network (who you know)-> resources (what you have) -> reputation (what they think of you).

You can’t pour from empty buckets.

These 5 buckets and order makes sense to me. It starts within you and then you can’t expand. You have your shit together? Then you can reach out. And the first two are the foundations and must be rock solid.

2: To master it, you must create an obligation to teach it

Based on the Feynman Technique, the author version: 1)Learn, 2) Teach it to a child, 3) Share it and 4) Review.

3: You must never disagree

Key factor for master communications, negotiations, conflicts, etc. Based on studies, disagreement “shuts down” part of your brain.

Even when you are right, if you want to reach to a positive outcome, listen to the other person and be sure he/she feels “heard” and then reply in a way that makes it feel “understood”. So build bridges and not walls. Disagree less, understand more.

4: You don’t get to choose what you believe.

Based on Daniel Kahneman, we dont have evidence from most of our important beliefs, we just trust our environment (family, tribe, etc) And it make sense, if I were born in somewhere else, I am sure I would have different beliefs.

So how to change a belief depends on: 1) Person’s current evidence 2) Their confidence in their current evidence 3) The new evidence 4) The confidence in that new evidence

So we can change belief if the new evidence sounds as good news and it is not a direct attack to the current one.

But thinking of yourself… to change your own-belief you need to get out of your comfort zone (where your existing evidence is believed), and get to the growth zone, where you can find new evidence for changing that believe: ie: afraid of talking to girls…. you will have to talk to one (not a million in one day), rinse and repeat.

Growth happens when you start doing the things you aren’t qualified to do.

5: You must lean in to bizarre behaviour:

“lean out” = being so arrogantly sure you are right that you refuse to listen/learn/read new info. This happens when something (a change) threats your status-quo = cognitive dissonance

So lean in, because change is only going to get faster.

lean-in: study and ask honest questions: why am I believing what i believe? Can be wrong? Do I understand (I am leaning out)? Am I following a trend?

“Shimon Peres solution” = hold two conflictive instances and resist the urge to force two things to make sense

For me this is a bit hard to swallow to be honest:

Don’t block people that you don’t agree with, follow more of them. Don’t run from ideas that make you uncomfortable, run towards them.

If you live avoiding risk, you are risking missing out on life (love, work, etc)

6: Ask, don’t tell.

Questions elicit an active response. They make people think. Use “Will you xxx?” for your questions and get to Yes/No. And this helps to make changes. “Will you go to dance tonight (alone)?” “Will you talk to talk to a girl?”

Ask questions of your actions, and your actions will answer

7: Never compromise your self-story:

You can’t quit when no one is watching (Chris Eubank Jr boxer)

Everything you do – with or without an audience – provides evidence to you about who you are and what you are capable of

You self-story and the mental toughness/grit/resilience that you have is more important than anything else for achieving your goals in business and life.

Choose to make the hard thing. Prove to yourself (in a thousand tiny ways, at every possible chance) that you have what it takes to overcome the challenges of life. If you do, you will have a robust, positive, evidence-based self-story.

8: Never fight a bad habit:

I need to read “Hooked” by Nir Eyal (I read already other book from him). So an habit loop consist of: 1) routine (actual behaviour), 2) cue: the trigger of the routine 3) reward: (result/impact of the routine)

So if you want to change a habit, you need want to change the cue and the reward. And figure it our which one it is. Make a change at the time (willpower is limited so use it wisely)

Your habits are your future (and your base for anything else)

9: Always prioritise your first foundation:

You only get one mind and one body… use/invest/care for them wisely

Pillar 2: The Story

This is very marketing/sales specific pillar. Our decisions are not driven by sense, they are driven by nonsense created by social cues, irrational fear and survival instincts.

10: Useless absurdity will define you more than useful practicalities

This mainly for marketing and reminds me to the pickup artists trying to differentiate from the rest of guys, or football players to tattoos, etc.

Your public story will be defined not by all the useful practical things that you do, in many cases, not even by the products that you sell, but by the useless absurdity that your brand is associated with.

I think that help at the beginning but still you need to have a good product, if not, that hype will wear off sooner or later. And this is not for the risk-averse people.

Normality is ignored. Absurdity sells.

11: Avoid wallpaper (neutral/blunt) at all costs:

Habituation: in-built neurological capability that helps us to focus on what matters and ignore the things that our brain doesn’t consider important (concentration camps, ghettos, etc)

Semantic satiation: Related to the above, the more something is repeated, the quicker lose its meaning. There are exceptions like terms related to survival.

Optimal level of exposure: Based on the above points, too much exposure reduces the attention but you need some to get some liking. So this is used in marketing, music businesses to get you.

In order to be heard, tell stories in an unrepetitive, unfiltered and unconventional way.

12: You must piss people off

Related to 11). Indifference (people dont love or hate you) is the least profitable outcome for a marketer. But be aware of the “wallpaper effect”

13: Shoot your psychological moonshots first

This is the scariest law of all as it is how we are manipulated by the big companies (ie Uber)

A psychological moonshot is a relatively small investment that drastically improves the perception of something.

So these are five of them:

Customers will judge their entire experience on just two moments: the best (or worst) part and the end (driver kindness).

Idleness aversion: Keeping waiting customer busy by giving them something to watch or engage with, they would be significantly happier and less likely to cancel.

Operational transparency: explain each step going on behind the scenes to show the rate of progress during the wait.

Uncertainty anxiety: Customers dont want faster delivery, they want less uncertainty about the delivery. It is less stressful psychologically to know something negative is going to happen (pizza delayed 30 minutes) than to be left in uncertainty (no idea when the pizza is coming)

Goal-gradient effect: Speeding up near the finish lane. What motivates us most is how close we are to achieving a goal: we work faster the closer we are to success (ie. cafe’s reward programs, linkedin profile, etc)

It is nearly always cheaper, easier and more effective to invest in perception than reality.

Biggest progress in the next 50 years won’t come from improvements in technology, but in psychology and design thinking.

Invest in shaping perceptions. Our truth is the story we choose to believe.

A lot of references to Rory Sutherland.

Another example of Moonshot is the ordering screens from McDonals, reported to increase sales 10% and customer satisfaction without changing anything else.

14: Friction can create value

Sometimes your customers will want your product more if you make their experience at certain level, worse (ie: Cocacola (sweet) vs redbul (bitter but give you wings… search engine taking some time but showing what is doing.. cook your meat in a stone) Making things easier isn’t necessarily the path to a psychological moonshot (law 13)

Value doesn’t exist. It’s a perception we reach with expectations we meet.

15: The frame matters more than the picture:

Framing: How something is framed affects how consumers perceive and value the brand (iphone, luxury clothing, etc) Reality is nothing more than perception and context is king. Context creates THE value

16: Use Goldilocks to your advantage

Goldilocks is a type of anchoring: cognitive bias where individuals rely too heavily on seemingly irrelevant information (anchor) when making a decision: ie presenting two extreme options next to the option you want to sell (properties, flight tickets (economy, standard, premium), etc) = Never show people only one option.

17: Let them try and they will buy

Based on “endowment effect”: cognitive bias that causes people to overvalue an item simply because they own it, regardless of its objective value (Apple stores)

18: Fight for the first 5 sec

For the author, this is the most important part of his marketing company success: we told the most captivating, surprising and emotional stories.

When a storyteller understands that absolutely nobody cares about them as much as they do, they tell captivating, emotional, punchy stories that you have no choice than paying attention.

In a world where our attention spans is shrinking, attention might just be the most generous gift that anyone can give.

Pillar 3: The Philosophy

19: You must sweat the small stuff

The easiest way to do big things is by focusing in the small things (that others ignore). The base here is “kaizen” = continuous improvement (Toyota) But this is not an overnight success, it takes time (a lot), investment (ideas coach) and belief. But dont pay for creating suggestions, if you attach a financial reward to ideas, it can eliminate people’s genuine creative energy and ambition. And when a hobby becomes a job, motivation drops (being a baker???)

20: A small miss now creates a big miss later

Related to the above but in the negative way. +1% improvement compounds a lot in the long rung, but -1% does too. And the idea is keizen is not just for business, you can use it in your personal and sentimental life.

Pursuit of perfection is a matter of discipline, not heroism.

21: You must out-fail the competition

From the world of IT, this is the new normal. Fail fast and often.

From my lovely JB: Failure and invention are inseparable twins. To invent you have to experiment. Big winners pay for so many experiments (kind of investing I guess)

The biggest cost is not failing, it is missing an opportunity to grow and wasting time to learn a new lesson regardless of the outcome.

Get to the 51% certainty and make the decision. Perfect decisions exist only in hindsight. The real cost of indecision in business is wasted time, that could have been used failing your way to knowledge.

Ideas to introduce this pro-failure culture: 1) Remove bureaucracy: small teams, with authority, trust, resources and no sign-offs 2) Fix the incentives: words need evidence, incentives and examples to bring them to life (you need to prove that you want to implement a pro-failure culture) 3) Promote and fire: clear, people who play ball with the culture, promote. The mood-hoovers, out. 4) Measure accurately: establish visible KPI and clear goals and make everybody responsible. 5) Share the failure: evident

22: You must become a Plan-A thinker

Maybe you should put all your eggs in one basket. Having a back-up plan has been shown to potentially hinder your performance by making your less driven to hit your primary goal.

Yes, this can ge difficult to swallow. But being risky doesnt mean being reckless.

23: Don’t be an ostrich = don’t hid from Problems/Reality in business and life.

We are motivated (too) by avoiding discomfort. Most people dont want to acknowledge that uncomfortable truth that distraction is always an unhealthy escape from reality.

Pain in life is unavoidable, but the pain that we create by trying to avoid pain is avoidable.

How to deal with discomfort and avoiding procrastination: 1) pause and acknowledge (that something is not right). 2) review yourself: feelings, behaviour and emotions. 3) speak your truth: talking about our disconnections, create more connectedness. 4) seek the truth: listen to understand.

When you refuse to accept an uncomfortable truth, you are choosing to accept an uncomfortable future.

24: You must make pressure your privilege

This is another pill difficult to swallow, but I get the point. Pressure can be good if it is at certain level and your relationship with it. It is like the tension for that exam, futsal game, combat, etc. There is where you grow and show your value. As well, too much comfort, is not good for your mind, body and emotions. I dont want a job that stress me out everyday, where I lose sleep, appetite, joy of sport, etc. I want to improve and like building muscle or learning anything you need to put effort and that needs some kind of pressure on it. If you believe stress is all bad, then it will be bad. If you find value, you grow (and survive). And to be clear, pressure as privilege is when it is viewed as something voluntary, meaningful and high autonomy. The contrary: compulsory, meaningless and low autonomy is psychological pain.

So how to make your pressure your privilege: 1) see it: dont deny it, acknowledge it. 2) share it: it is a way to create resilience. 3) frame it: recognize the positive role and powerful signal it represents. 4) use it: dont fight it, use it.

If you are looking for growth, choose the challenge.

25: The power of negative manifestation:

Key question: “Why will this idea fail?” This fight the following bias: 1) Optimism bias: you focus only in good things and ignore bad ones 2) confirmation bias: you only pay attention to information that supports your ideas. 3) self-serving bias: it leads us to believe that our success or failure is a result of our own skill and effort. 4) sunk-cost fallacy bias: this makes us stick with a decision – even when evidence suggest that is was a bad one. The is the law to know to cut your loses short. 5) groupthinking bias: this prevents a group fro asking “why will this fail?” because they dont want to disagree with the group.

Similar technique is the “pre-morten” analysis: thinking of failures before a project has started. This is different from “what could go wrong?” How to setup this: 1) set the state: gather relevant team members and explain the goal of this analysis 2) fast-forward to failure: imagine a failed scenario with all its details 3) brainstorm reasons for failure: each one individually and on paper. 4) share and discuss: foster an open and non-judgemental discussion. 5) develop contingency plans: based on identified risks and challenges.

You can apply this not just to business: career path, partner and investing.

26: Your skills are worthless, but your context is valuable

Lessons: 1) our skills hold no intrinsic value: value is what someone is willing to pay. 2) The value of any skill is determined by the context in which it is required (amen). 3) The perception of a skill’s rarity influences how much people value it 4) people will asses the worth of your skill based on how much value they believe it can generate for them.

27: The discipline equation: death, time and discipline

We have a limited time, acknowledge your mortality, then you can prioritise what truly matters.

Discipline is the ongoing commitment to pursuing a goal, independent of motivation fluctuations, by consistently exercising self-control, delayed gratification and perseverance.

discipline = value of the goal + reward of pursuing – cost of pursuing.

We don’t have to be smarter than the rest. We have to be more disciplined than the rest.

Warren Buffet

Pillar 4: The Team

28: Ask who, not how

Richard Branson, dyslexic, created business with $24B annual sales. “I am just good with people. Being dyslexic. I had no choice but to delegate”

“I’ve long given up hope of becoming an expert in the things I am not good at” you find who is the best for that and you focus in your best. Everybody wins.

Every company is simply a recruitment company (the CEO can’t do everything well)

Your ego will insist that you do. Your potential will insist that you delegate.

But if you are the last link in the chain????

29: Create a cult mentality

This one touched a fiber on me… I can’t tolerate companies that try to brainwash you with their culture. But I get the point for this law.

In my first job, I enjoyed the team, we had our culture, although our management and company culture were horrendous.

And honestly, this is what I am looking for in a job. I had a bit for a bit in my longest spell, because the CTO was the smartest guy I ever met and he set the bar for everybody else.

The most important decision you will make when you create a company is hiring the first ten people.

Steve Jobs: Just get A players. Then they will only want A players, etc etc

Ingredients of a cult: 1) Sense of community and belonging. 2) Shared vision. 3) An inspirational leader. 4) An “us vs them” mentality.

But, cults are not sustainable long term. So create a culture that is sustainable: 1) people are authentically engaged 2) with a mission they care about 3) trusted with a high degree of autonomy 4) sufficiently challenged in their work 5) given a sense of forward motion and progress and 6) surrounded by a caring, supportive group of people that they love to work with.

30: The three bars for building great teams

They are: fire, hire and train. Fire the bar lowers, hire/promote bar raisers, train the rest.

Hesitating to fire someone that is negative for the company, can be the biggest regret in a business. Nobody is above the “culture/team” (Sir Alex Ferguson at MU)

The definition of the word “company” is just a group of people.

31: Leverage the power of progress

Based on Sir David Brailsford’s theory of “marginal gains” for British Cycling team.

People want a feeling of progression, and if we aim for perfection, we will fail, because perfection is so far away

it is quite easy to make small incremental changes and make them stick (atomic habits) and that produces leverage.

The key to overcoming that discomfort and preventing procrastination is to split the task into easy, achievable micro-goals (I feel that)

How to create the perspective of progress: 1) create meaning 2) set clear and actionable goals 3) providing autonomy 4) removing friction 5) broadcasting the progress

32: You must be an inconsistent leader

Every person is different so you need to be able to treat each one in a different way (motivation wise) (ie Sir Alex Ferguson again, he was a emotional savant) So one-size-fits-all, doesnt work.

Great leaders are fluid, flexible and full of fluctuation. They are whatever shape they need to be to complete your motivation.

33: Learning never ends:

This is cristal clear. Keep learning, keep growing and be happy.

Thinking in Systems

I struggle to give a good summary of this book. My take is how to see systems (a very generic word) in the big picture as most systems are too complex to understand how fully work (economy, stock market, etc). In general, once we see the relationship between structure and behaviour, we can start to understand the system and modify it. You can’t know a system just by its parts. Look for the interconnections of those parts.

A system is formed by “stock” (water in a reservoir, mineral deposits, etc) and the stock changes overtime due to the actions of “flows” (rain = inflow, evaporation = outflow, mining = outflow, etc) Inflow increases the stock. Outflow decreases the stock. If the rate of inflow and outflow is identical, you have a system in a state of dynamic equilibrium. You want to see the systems behaviour based on time. Generally, stocks change slowly compared with the rate of change of in flows. So stocks act like a “buffer” in systems. A feedback loop is formed when changes in a stock affect the flows into or out of that same stock. You have two types of feedback loops: balancing (seek stability and resistance to change) and amplifying/reinforcing (can cause healthy growth or destruction) (ie: learning piano, the more I practice, the more I learn, the more keep practicing and so on). Doubling time = 70/growth rate (It takes 14 years to double your money in a back at a rate of 5%) In real systems, a single stock can be influenced by several types of feedback loops (with different directions and strengths)

The information delivered by a feedback loop can only affect future behaviour (can’t have an impact fast enough to correct the behaviour triggered the current feedback). And there will always be delays in responding. As well, because systems often have competing feedback loops working at the same time, the loop that dominates the system will determine the behaviour. You can have shifting dominance of feedback loops (dead rate vs birth rate)

System dynamics models explore possible futures and ask “what if” questions. Testing the value of a model: 1) Are the driving factors likely to unfold this way? 2) If they did, would the system react this way? 3) What is driving the driving factors?

Dynamic systems studies are designed to explore what would happen if a number of driving factors unfold in a range of different ways.

Systems largely cause their own behaviour. Systems with similar feedback structures produce similar dynamic behaviours, even if the outward appearance is not similar (population vs industrial economy, coffee cup cooling vs radioactivity decay)

A delay in a balancing feedback loop makes a system likely to oscillate (ie: response of orders and deliveries in a car dealer). Delays are pervasive and are strong determinants of behaviour. Changing the length of a delay may (or nor) make a large change in the behaviour of a system.

Examples of two-stock systems:

  • A renewable stock (capital) constrained by a non-renewable stock (oil): oil company: Non-renewable resources are stock-limited. The entire stock (oil) is available at once and can be extracted at any rate (limited by extraction capital). The faster the extraction rate, the shorted the lifetime of the resource.
  • A renewable stock (capital) constrained by a renewable stock (fish): fishing company: Renewable resources are flow-limited. They can support extraction indefinitely but only at a finite flow rate equal to the regeneration rate;

No-physical system can grow forever in a finite environment.

— Part 2

  • 3) Why systems work so well?

Resilience: + dynamic -> learn. – sacrifice resilience for stability

Delf-organization: capability to make its own structure more complex. Produces heterogeneous + unpredictability

Hierarchy: evolve from bottom up. The top serves the purpose of the lower layers.

  • 4) Why systems surprise us?

World is greater than our knowledge. We can make only models in our heads (never exact to reality)

Behaviour = performance over time. System structure is the source of behavior.

The non-linear relationships: This is something we struggle to deal with (and to notice)

We need to create boundaries so we can ask question

What’s the limiting factor: there is always a limit to growth

Bounded rationality may not lead to the better decision that improve the system (this kills the idea of the market takes care by itself for the best – there is always somebody that makes a killing and can’t be good)

  • 5) System traps and opportunities?

Policy resistance (drugs): Seek mutual satisfactory for all goals from all parts

Tragedy of the commons (immigration): Educate users to understand consequences of abuse. Privatise or regulate.

Drift to low performance: Enforce standards by best actual performance.

Escalation (violence/war – nuclear heads): Not getting involve in first place or refuse to complete.

Success to the successful: Diversification: try something else. Limit the winner prize.

??? Solution to a systemic problem reduces (or disguises) the symptoms, but does nothing to solve the underlying problem: Focus on long-term restructuring instead of short-term relief.

?? Rule beating: perverse behavior that gives appearance of obeying the rules or achieving the goals, but that actually distorts the system. Design or redesign rules based on feedback, always aiming to achieve of the goal of the rule.

?? Seeking the wrong goal (GNP is not a good goal)

— Part 3

  • 6) Leverage points: Places to intervene

MIT’s Jay Forrester: The source of all problems is growth (populations and economic) Leverage points frequently are not intuitive

Numbers: constants and parameters such as subsidies, taxes, standards, etc

Buffers: the size of stabilizing stocks relative to their flows.

Stock-and-flow-structures: Physical systems and their nodes of intersection (energy conservation: straight out bent pipes and enlarge the too small ones)

Delays: the length of time relative to the rates of system changes.

Balancing Feedback loops: the strength of the feedbacks relative to the impacts they are trying to correct. Big mistake is to remove these “emergency response mechanisms because they are not used often and they look costly (ie: emergency cooling system in nuclear plant)

Reinforcing feedback loops: The strength of the gain of driving loops

Information flows: The structure of who does and doesn’t have access to information

Rules: Incentives, punishments, constraints

Self-Organization: The power to add, change or evolve system structure.

Goals: The purpose or function of the system.

Paradigms: The mindset out of which the system (its goals, structure, rules, delays, parameters, etc) arises

Transcending paradigms: Keep oneself unattached in the arena of paradigms, to stay flexible

  • 7) Living in a world of systems

Getting the behaviour of the system forces you to focus on facts, not theories.

Get your models outside of your head: discuss with others, this creates mental flexibility.

Honor, respect and distribute information: Information is power.

Keep your language as concrete, meaningful and truthful as possible.

Pay attention to what is important, not just what is quantifiable: how you measure justice, democracy, freedom, etc?

Make feedback policies for feedback systems: Jimmy Carter examples: oil tax depending on the import levels (more import, more tax), Mexico immigration (help Mexico to improve society instead of creating walls and putting more security in the border)

Improve a system as a whole (hierarchies exist to serve the bottom layer, not the top)

Listen to the Wisdom of the System (before trying to make any change): Example, Aid worker trying to improve things in Guatemala.

Locate and apply responsibility in the system.

Stay humble (you will make mistakes), stay a learner

Complexity is expected: it is part of evolution

Expand the time horizons: ie Native Americans think of the consequences for the 7th generation. We think too short-term

Seeing systems as a whole requires more than interdisciplinary. We need to learn and communicate

Dont weight the bad news more heavily than the good ones. Keep the standards absolute.

Scale Systems 2024, MS GenAI for beginners, Federer, Whisper WebGPU, Starlink TCP

Scale Systems 2024 (videos): GenAI Training: Short but interesting video. Main failures: GPU, memory and network cables 🙂 For the Network side, I liked this screenshot. Still they are able to build two 24k GPU cluster with IB and RoCE2.

MS: GenAI for beginners.

Federer: Effortless is a myth (without hard work there is nothing), It’s only a point (resilience, present), life is bigger than the court.

Whisper WebGPU: Real-time in-browser speech recognition

Free Matrix Multiplication: This looks like a big deal.

Starlink TCP: Very quick summary, control protocols with Selective Ack perform better. The ping analysis is quite good. Being able to see that each 15s you are changing satellite, is cool.

Intro LLM, LLM bootcamp, Computex 2024, UALink, Aurora, Arista AI Center, Kubenet, Nutrigenomia, Videos

Intro LLM

LLM Bootcamp 2023:

NVIDIA Computex 2024: It seems they are going to yearly cadence for networking kit. They showed plans for 2025 and 2026… I liked the picture of a NVLink spine and the huge heatsinks for B200….

UALink: The competition for NVLink. This is for GPU-to-GPU communication. UltraEthernet is for connecting pods.

Aurora supercomputer: Exascale broken. Based on HPE slingshot interconnect (nearly 85k endpoints) Everything else is Intel.

Arista AI Center: it seems they are going to team-up with NVIDIA. Some EOS running on the nics.

Kubenet: Seems interesting but only supporting Nokia SRLinux at the moment.

Nutrigenomia:

“Lo que hicimos fue un trabajo personalizado en el que cuidamos todos los aspectos de la nutrición y buscamos la regeneración y la correcta expresión de sus genes.”

fisiogenómica: Yo lo llamo así porque mezcla fisioterapia, nutrición y nutrigenómica. En cada persona tenemos que buscar por síntomas, análisis e intervenciones qué alimentos limitar por producir una mala expresión genética, pero todas las pautas están basadas en la Pirámide de la Dieta Mediterránea”

Videos:

Bear Grylls: Be kind, never give up.