Testing framework for LLM Part

HoneyHive is a collaboration platform to test and evaluate, monitor and debug your LLM apps, from prototype to production. It enables you to continuously improve LLM apps in production with human feedback, quantitative rigour and safety best-practices.

Some techniques I have seen in the wild

Create a semi-strict programming language like promptlang - https://github.com/ruvnet/promptlang

this style was popular back in the early days of gpt-3.5 when it landed, for some reason, it fell out of fashion

Write a super long persona mapping prompt with a well defined action space

Best example of this is the V... See more