GitHub - sqrkl/lm-evaluation-harness: A framework for few-sh...

GitHub - sqrkl/lm-evaluation-harness: A framework for few-shot evaluation of language models.

github.com

RelatedHighlights

GitHub - arthur-ai/bench: A tool for evaluating LLMs

Deep-ML

deep-ml.com

Just a moment...

researchgate.net

Large variety of ready-to-use LLM evaluation metrics (all with explanations) powered by

ANY

LLM of your choice, statistical methods, or NLP models that runs

locally on your machine

:

G-Eval

Summarization

Answer Relevancy

Faithfulness

Contextual Recall

Contextual Precision

RAGAS

Hallucination

Toxicity

Bias

etc.

GitHub - arthur-ai/bench: A tool for evaluating LLMs

Deep-ML

Just a moment...

GitHub - confident-ai/deepeval: The LLM Evaluation Framework