Notes on scale + quality
mail.google.com
Notes on scale + quality
Scaling, the primary way to grow a business, is simply doing more of what you are already doing. Scaling is a replication process. To do it well, you need the right hiring, training, and execution processes along with the right information, measurement, and reward systems overseen by competent managers.
Edward Hess • Grow to Greatness: Smart Growth for Entrepreneurial Businesses
- Scalability is crucial - systems need to be designed with the assumption that query volume, document corpus size, indexing complexity etc. could increase by 10x. What works at one scale may completely break at a higher scale.
- Sharding the index, either by document or by word, is important to distribute the indexing and querying load across machines.
Claude
“I have a theory that chasing things that scale makes you need therapy, and the therapy is pursuing things that can’t scale. I once wrote that every entrepreneur’s dream is to succeed at building an impossibly hard business and then finally open a local coffee shop to be happy.”