Rust for Data Engineering
milvus is immensely popular; however, other libraries such as qdrant, weviate, and chroma have been catching up.
Ben Auffarth • Generative AI with LangChain: Build large language model (LLM) apps with Python, ChatGPT, and other LLMs
You’ve got a vector database that has all the right database fundamentals you require, has the right incremental indexing strategy for your use case, has a good story around your metadata filtering needs, and will keep its index up-to-date with latencies you can tolerate. Awesome.
Your ML team (or maybe OpenAI) comes out with a new version of their... See more
Your ML team (or maybe OpenAI) comes out with a new version of their... See more
6 Hard Problems Scaling Vector Search
I went to a ClickHouse meetup here in Dubai.
Never used the tool, but I'm happy to learn.
ClickHouse is:
- a database
- built for analytics
- open source
Furthermore, it:
- can be run on a single node or in a cluster
- stores data in columnar format
- uses both "vectorized query execution" and "runtime code generation" to maximize CPU usage
In the meetup, Cl... See more
Never used the tool, but I'm happy to learn.
ClickHouse is:
- a database
- built for analytics
- open source
Furthermore, it:
- can be run on a single node or in a cluster
- stores data in columnar format
- uses both "vectorized query execution" and "runtime code generation" to maximize CPU usage
In the meetup, Cl... See more
Feed | LinkedIn
