Huge “foundation models” are turbo-charging AI progress
economist.com
Saved by Sterling Proffer
Huge “foundation models” are turbo-charging AI progress
“Intelligence is the new transistor,” concluded Schiffmann. “It’s a fundamental primitive that you’ll build things on, [and it] will enable all kinds of good things and all kinds of bad things... The goal is just to enable the good over the bad.”
Gauri Sood • Neural Networks and Novelty: A Window Into Harvard’s Innovators | Harvard Independent
Generative AI’s first year out the gate—“Act 1”—came from the technology-out . We discovered a new “hammer”—foundation models—and unleashed a wave of novelty apps that were lightweight demonstrations of cool new technology.
Sonya Huang • Generative AI’s Act Two
- Microsoft introduced Phi 1.5 – a compact AI model with multimodal capabilities, meaning it can process images as well as text. Despite being significantly smaller than OpenAI's GPT-4, with only 1.3 billion parameters, it demonstrates advanced features like those found in larger models. Phi 1.5 is open-source, emphasizing the trend towards efficient
FOD#27: "Now And Then"
By powerful AI, I have in mind an AI model—likely similar to today’s LLM’s in form, though it might be based on a different architecture, might involve several interacting models, and might be trained differently—with the following properties:
In terms of pure intelligence4, it is smarter than a Nobel Prize winner across most relevant fields – biolo