see also post on large in-memory search
large allocation request -> free list search is harder and slower.
I thought in low latency, time costs outweigh space costs, but no. Garbage collection is a major performance issue in low latency systems. I guess so is object creation. I guess that’s why memory efficiency affects latency. GC probably takes more cpu time if there’s less stuff to scan.
distributed cache isn’t much used in low latency systems, perhaps because
* network latency