The Thinking Machine

“ The deep-learning revolution was as much a revolution in hardware as software.

“ The deep-learning revolution was as much a revolution in hardware as software. ” e.style.display='none');if(typeof getContentsSections==='function')setTimeout(getContentsSections,50)" /> Nvidia's rise is an improbable marriage. Neural networks — software modeled on biological brains — had been considered obsolete toys since the 1960s. Parallel computing — processing many calculations simultaneously on a single chip — had a zero percent commercial success rate before Nvidia. Neither had obvious customers; both were starved of funding and dismissed by serious researchers. When AlexNet was trained on two $500 gaming GPUs in 2012, the synthesis was revealed. The GPU's parallel architecture was perfectly suited to the matrix multiplication at the heart of neural-net training. Nvidia had spent a decade building CUDA, a free software platform that turned gaming cards into supercomputers. Neural nets were the killer app nobody saw coming. Two fringe technologies, detested by the establishment, interlocked to become the most consequential computing innovation of the century. TAKEAWAY 2

“ Back then, there wasn't a counselor to talk to. Back then, you just had to toughen up and move on. ” e.style.display='none');if(typeof getContentsSections==='function')setTimeout(getContentsSections,50)" /> In 1973, ten-year-old Jensen Huang was sent from Thailand to Oneida Baptist Institute — a juvenile-reform school in one of America's poorest counties. His parents stayed behind in Bangkok. His roommate was a seventeen-year-old knife fighter who showed him his stab wounds. Classmates called him racial slurs daily and tried to shake him off a rope bridge into the river below. Huang didn't crumble. He became the top student, taught himself to fight, cleaned toilets, and cut brush with a scythe. He did a hundred push-ups every night — a habit he maintained for life. Decades later, he donated a building to the school and called his time there "one of the best things ever to happen to him." The pattern was set early: adversity as fuel, fundamentals as religion. TAKEAWAY 3

“ Our company is thirty days from going out of business. ” e.style.display='none');if(typeof getContentsSections==='function')setTimeout(getContentsSections,50)" /> In 1996, Nvidia's first chip flopped. Huang laid off two-thirds of his staff, bet the last of the company's cash on an unproven hardware emulator, and skipped physical prototyping entirely — something no semiconductor firm had ever done. The resulting chip, built from what amounted to a digital napkin sketch, saved the company with weeks to spare. The near-death experience became doctrine. For years, Huang opened staff presentations with the mantra above. Nvidia shipped new products every six months — twice the industry pace. When profits soared, he immediately reinvested in speculative technologies. When the stock crashed 90% (which happened twice), the culture barely flinched. Desperation sharpened decisions. Comfort killed companies. Huang…