使用 TensorRT-LLM 部署 Model-Optimizer 量化模型:统一 Hugging Face Checkpoint 工作流
【免费下载链接】Model-Optimizer A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks…
2026/9/26 4:38:01