A Review of Optimization Techniques for Large Language Model Inference.

Wed, 01 Jan 2025 00:00:00 +0100

Yujia Cao , Xi Tao , Weipeng Cao, Chuanfei Xu, Zhong Ming:
A Review of Optimization Techniques for Large Language Model Inference. KSEM (5) 2025: 257-265