
The architecture of today's LLM applications

First of all, I'd say you have a bigger problem where your company is trying to find nails with a hammer. That is where your sentiment comes from, and could be an obstacle for both you and the company. It's the same deal when I see people keep on talking about RAG, and nowadays "modular RAG", when really, you could treat everything as a software co... See more
r/MachineLearning - Reddit
Every model, whether LLM or ML, will operate best if it is focused and specializes in specific conclusions it is trying to make. For example, I will make ChatGPT bots for very specific parts of my research, reading, and trading processes. Create specialized bots and models, then structure them hierarchically. The goal is to run a suite of bots, mod
... See moreCapital Flows • AI & the New Age of Learning

Application layer AI companies are not just UIs on top of a foundation model. Far from it. They have sophisticated cognitive architectures that typically include multiple foundation models with some sort of routing mechanism on top, vector and/or graph databases for RAG, guardrails to ensure compliance, and application logic that mimics the way a h... See more