r/LocalLLaMA - Reddit

LMQL is a programming language for LLMs.Robust and modular LLM prompting using types, templates, constraints and an optimizing runtime.

Anything that comes out of an LLM is a proposition, not a solution. A proposition needs to be checked. Thus, LLMs are mostly interesting for shallow problems (repeatable and can be evaluated by humans quickly). Using them for generating solutions for complicated situations is misusing them.

For any conversational use case, such as chatbots, we need conversational memory. The idea behind conversational memory is simple: rather than sending just the most recent interaction to our LLM, we send a history of interactions + the most recent interaction to our LLM — typically in a chat log style format.

With and without conversational memory.

D... See more