GitHub - guywaldman/orch: Rust framework for LLM orchestration
Serverless Postgres (experimental)
Serverless Postgres using Oriole, Fly Machines, and Tigris for S3 Storage.
Overview
This is a MVP for Serverless Postgres.
1/ It uses Fly.io, which can automatically pause your database after all connections are released (and start it again when new connections join).
2/ It uses Oriole, a Postgres extension with expe... See more
Serverless Postgres using Oriole, Fly Machines, and Tigris for S3 Storage.
Overview
This is a MVP for Serverless Postgres.
1/ It uses Fly.io, which can automatically pause your database after all connections are released (and start it again when new connections join).
2/ It uses Oriole, a Postgres extension with expe... See more
GitHub - kiwicopple/serverless-postgres
LoRAX (LoRA eXchange) is a framework that allows users to serve thousands of fine-tuned models on a single GPU, dramatically reducing the cost of serving without compromising on throughput or latency.
📖 Table of contents
📖 Table of contents
- 📖 Table of contents
- 🌳 Features
- 🏠 Models
- 🏃♂️ Getting started with Docker
- Launch LoRAX Server
- Prompt via REST API
- Prompt via Python
predibase • GitHub - predibase/lorax: Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
GPT4All: An ecosystem of open-source on-edge large language models.
Important
GPT4All v2.5.0 and newer only supports models in GGUF format (.gguf). Models used with a previous version of GPT4All (.bin extension) will no longer work.
GPT4All is an ecosystem to run powerful and customized large language models that work locally on consumer grade CPUs a... See more
Important
GPT4All v2.5.0 and newer only supports models in GGUF format (.gguf). Models used with a previous version of GPT4All (.bin extension) will no longer work.
GPT4All is an ecosystem to run powerful and customized large language models that work locally on consumer grade CPUs a... See more
nomic-ai • GitHub - nomic-ai/gpt4all: gpt4all: open-source LLM chatbots that you can run anywhere
What is Kestra
Kestra is a universal open-source orchestrator that makes both scheduled and event-driven workflows easy. By bringing Infrastructure as Code best practices to data, process, and microservice orchestration, you can build reliable workflows and manage them with confidence.
In just a few lines of code, you can create a flow directly from... See more
Kestra is a universal open-source orchestrator that makes both scheduled and event-driven workflows easy. By bringing Infrastructure as Code best practices to data, process, and microservice orchestration, you can build reliable workflows and manage them with confidence.
In just a few lines of code, you can create a flow directly from... See more