Huge “foundation models” are turbo-charging AI progress

RelatedCollectionsHighlights

One of the views, famously, in the stories of progress, is how many people view the Manhattan Project as this massive moment of scientific discovery, and we did a lot of things at once, and we managed to make the nuclear bomb. But there’s another view of the Manhattan Project, which is that we assembled a lot of things that were on the shelf and ju

Ben Thompson • An Interview With Daniel Gross and Nat Friedman about the Democratization of AI

If you made a thousand versions of an LLM, that’s good at a thousand different things, and you have to load each of those into the GPUs and serve them, it becomes very expensive. The big holy grail right now that everybody’s looking for is: are there techniques, where you can just do small modifications where you can get really good results? There

Sarah Wang • What Builders Talk About When They Talk About AI | Andreessen Horowitz

“The kind of computing these LLMs are doing, this kind of intelligence, is just different. Is that an existential risk? Well, I come back to the fact that we have no idea how the human brain works.” It’s easier to imagine catastrophic things than see the opportunities, he points out.

How much do you think we’re going to get tons of specialization versus no, once the brain gets big enough and we do these fine tunings, that’s going to be it. It will be like AWS, GCP, and Azure.

Ali: I think the answer is closer to the latter. It’s going to have lots of specialization. Having said that, it’s not a dichotomy in the sense that maybe ... See more

Ben Thompson • An Interview With Daniel Gross and Nat Friedman about the Democratization of AI

Sarah Wang • What Builders Talk About When They Talk About AI | Andreessen Horowitz

Ali Ghodsi • AI Food Fights in the Enterprise