Polars — Processing hundreds of GBs of textual data on a daily basis at MDPI
pola.rs
Polars — Processing hundreds of GBs of textual data on a daily basis at MDPI
The bank bought a Hadoop cluster with fifty server nodes and eight hundred processor cores that is capable of handling a petabyte of data.
Thomas H. Davenport • Big Data at Work: Dispelling the Myths, Uncovering the Opportunities
GitHub - kylebarron/parquet-wasm: Rust-based WebAssembly bindings to read and write Apache Parquet data
kylebarrongithub.com
You’ve got a vector database that has all the right database fundamentals you require, has the right incremental indexing strategy for your use case, has a good story around your metadata filtering needs, and will keep its index up-to-date with latencies you can tolerate. Awesome.
Your ML team (or maybe OpenAI) comes out with a new version of their... See more
Your ML team (or maybe OpenAI) comes out with a new version of their... See more
6 Hard Problems Scaling Vector Search
