A Year in LLM Serving: Workload Evolution, Caching and Load-Balancing

arXiv:2608.13573v1 Announce Type: new Abstract: Large Language Model LLM serving has become a critical cloud workload, and realistic traces are essential for motivating and benchmarking serving systems. However, existing LLM serving workload studies remain limited in scale and scope.