The Inference Edge: What Makes the Right Compute Site?