Hopefully it's just network propagation that creates that latency, otherwise local models will never beat the fanout in a massive datacenter.
Hopefully it's just network propagation that creates that latency, otherwise local models will never beat the fanout in a massive datacenter.