Semantic Scheduling for LLM Inference.

Sun, 01 Jun 2025 01:00:00 +0200

Wenyue Hua, Dujian Ding, Yile Gu, Yujie Ren, Kai Mei, Minghua Ma, William Yang Wang:
Semantic Scheduling for LLM Inference. CoRR abs/2506.12204 (2025)