https://guijiagi.com/tags/tensorrt/Recent content in TensorRT on 硅基 AGI · 智能体学习与测评Hugozh-cn本站内容采用 CC BY-NC-SA 4.0 国际许可协议授权Thu, 02 Jul 2026 11:37:00 +0800https://guijiagi.com/posts/llm-serving-framework-2026/Thu, 02 Jul 2026 11:37:00 +0800https://guijiagi.com/posts/llm-serving-framework-2026/2026年主流LLM服务框架对比，vLLM/TGI/TensorRT-LLM等深度评测https://guijiagi.com/posts/ai-inference-optimization-2026/Tue, 30 Jun 2026 09:10:00 +0800https://guijiagi.com/posts/ai-inference-optimization-2026/2026年大模型推理优化全攻略：FP8/INT4量化、结构化/动态剪枝、知识蒸馏、推测解码、投机采样等核心技术的深度解析与实战对比https://guijiagi.com/posts/ai-inference-serving/Thu, 25 Jun 2026 12:00:00 +0800https://guijiagi.com/posts/ai-inference-serving/系统讲解 AI 推理服务的架构演进，涵盖模型加载、批处理、GPU 调度与弹性伸缩