MixLLM: LLM Quantization with Global Mixed-precision between Output-features and Highly-efficient System Design
Paper
•
2412.14590
•
Published
•
15
Zhen Zheng
JamesTheZ
AI & ML interests
Large scale machine learning system optimization.
Organizations
None yet
authored
2
papers
about 1 year ago
authored
3
papers
almost 2 years ago
Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity
Paper
•
2309.10285
•
Published
•
1
ZeroQuant(4+2): Redefining LLMs Quantization with a New FP6-Centric Strategy for Diverse Generative Tasks
Paper
•
2312.08583
•
Published
•
11
FP6-LLM: Efficiently Serving Large Language Models Through FP6-Centric Algorithm-System Co-Design
Paper
•
2401.14112
•
Published
•
20