Nathan Storey

In 2019, OpenAI announced GPT-2 with this post: https://t.co/jjP8IXmu8D Today (~5 years later) you can train your own for ~$672, running on one 8XH100 GPU node for 24 hours. Our latest llm.c post gives the walkthrough in some detail: https://t.co/XjLWE2P0Hp Incredibly,... See more

DeepSeekV2 is a big deal. Not only because its significant improvements to both key components of Transformer: the Attention layer and FFN layer. It has also completed disrupted the Chines LLM market and forcing the competitors to drop the price to 1% of the original price. ⬇️ https://t.co/eDNeRHAzTp

Cool experiment where researchers assemble an AI translation “company” with AI agents with simulated backgrounds filling various roles, from editors to proofreaders. The AI “company” creates accurate translations of Chinese web novels that people prefer to GPT-4, and human, ones https://t.co/7lxg2jEjZi