How we saved 100 terabytes of memory by optimizing 1.1.1.1’s DNS cache

Five Rust-level memory optimizations to the DNS cache layout of Big Pineapple cut per-entry memory by 56%, freeing approximately 100 TB of memory across Cloudflare's fleet.

Scaling a Monolith to 1M LOC: 113 Pragmatic Lessons from Tech Lead to CTO

For context, I work in a Django/React TS/React Native codebase on a 20-person team at MorphMarkethttps://www.morphmarket.com/. I have 17 years experience wit...

Why your LLM bill is exploding — and how semantic caching can cut it by 73%

Caches: LRU v. random

📝 Guest Post: Caching LLM Queries for Improved Performance and Cost Savings*

If you're looking for a way to improve the performance of your large language model (LLM) application while reducing costs, consider utilizing a semantic cache to store LLM responses.

Web Caching Explained by Buying Milk at the Supermarket

This visual explanation will help you understand all the common ways to implement caching