Energy Efficiency of Locally Deployed LLMs: A Preliminary Quantitative GPU Power Benchmark on Consumer Hardware

arXiv:2608.00008v1 Announce Type: new Abstract: The local deployment of large language models LLMs is gaining traction due to privacy concerns and the desire for onpremise inference.