GitHub - turboderp/exllamav2: A fast inference library for running LLMs locally on modern consumer-class GPUs

GitHub - turboderp/exllamav2: A fast inference library for running LLMs locally on modern consumer-class GPUs

turboderpgithub.com
Thumbnail of GitHub - turboderp/exllamav2: A fast inference library for running LLMs locally on modern consumer-class GPUs

Shortwave — rajhesh.panchanadhan@gmail.com [Gmail alternative]

GitHub - confident-ai/deepeval: The LLM Evaluation Framework

GitHub - MadcowD/ell: A language model programming library.

github.com
Thumbnail of GitHub - MadcowD/ell: A language model programming library.