GitHub - okuvshynov/slowllama: Finetune llama2-70b and codellama on MacBook Air without quantization

eneral-purpose models

• 1.1B: TinyDolphin 2.8 1.1B. Takes about ~700MB RAM and tested on my Pi 4 with 2 gigs of RAM. Hallucinates a lot, but works for basic conversation.


• 2.7B: Dolphin 2.6 Phi-2. Takes over ~2GB RAM and tested on my 3GB 32-bit phone via llama.cpp on Termux.


• 7B: Nous Hermes Mistral 7B DPO. Takes about ~4-5GB RAM depending on contex

... See more

OpenAI Whisper - llamafile

Whisperfile is a high-performance implementation of OpenAI's

Whisper created by Mozilla Ocho as

part of the llamafile

project, based on the

whisper.cpp software written

by Georgi Gerganov, et al.

Model creator: OpenAI

Original models: openai/whisper-release

Origin of quantized weights: ggerganov/whisper.cpp

The model is packaged in... See more

LLM-PowerHouse: A Curated Guide for Large Language Models with Custom Training and Inferencing

Welcome to LLM-PowerHouse, your ultimate resource for unleashing the full potential of Large Language Models (LLMs) with custom training and inferencing. This GitHub repository is a comprehensive and curated guide designed to empower developers, researche... See more