Model-Optimizer 自定义 Hugging Face 模型量化插件开发:以 DBRX MoE 为例实现 TensorRT-LLM 部署
【免费下载链接】Model-Optimizer A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks…
2026/9/26 15:50:26