Open Access Research Article CC BY 4.0 Published 4 February 2026

KV Cache and Inference Scheduling: Energy Modeling for High-QPS Services

Wenwen Liu1.

  1. 1 Bytedance

* Corresponding author: Wenwen Liu · liuwenwen.jessica@bytedance.com

Loading document…

Copyright © 2026 The Author(s). Published by Southern United Academy of Sciences.
This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Journal of Industrial Engineering and Applied Science (JIEAS)
Published by Southern United Academy of Sciences Limited ISNI: 0000000512776460, operated by the Publications Division.