I suspect GPU intensive compute is going to be one of our nastiest ZIRP hangovers (Elon et al are just gonna be equiv to “walks of shame”). This isn’t zero-marginal-cost tech and it’s under-priced by a factor of at least 10x. Physics: it’s a real thing. Cybernetics: It’s a real thing. …artificial intelligence companies are…
Like all wars, tech gets pushed forward. In Ukraine it has been drones and in Gaza is it is AI/ML systems. If you don’t think the ghouls at Palantir and Anduril aren’t creaming their Elven what-ever-dark-elves-call-pants, you’re dreaming. Their sales hordes are already skittering over the pavements and through the sewers of DC, London, Brussels…
The biggest event of the week was the Sleeper Agents paper from Anthropic. I expect that to inform our thoughts for a while to come, and to lay foundation for additional work. We also had the first third of the IMO solved at almost gold metal level by DeepMind, discovering that math competition geometry is…
Nature always bats last… On a really bright front, if AI/ML drives innovation in power generation, I’m there for that. It’s no secret that AI models like those behind OpenAI’s ChatGPT require an astronomical amount of electricity. The process is ludicrously energy intensive, with experts estimating that the industry could soon suck up as much electricity as an…
When I started training models in 2021 I joked to my wife that I had found something more computationally expensive than crypto mining. Whenever I was asked about AI and the risk to humanity (2023), I would point out that there were very real physical limits to what was going on. AI training is eye-bleedinglying…
“Nice sanctions you’ve got there, be a shame if some one routed around them.” As a friend pointed out, black market Nvida chips are probably easier to get than black market pseudo. China is still finding ways to skirt US export controls on Nvidia chips, Reuters reported. A Reuters review of publicly available tender documents showed…
I LOOOOOOVE the cultural weirdness of this. It’s an unintended consequence of GenAI systems when they bump into legal systems. https://www.theverge.com/2024/1/15/24038880/psa-wear-fake-fingers-to-make-real-photos-look-ai-generated