https://guijiagi.com/tags/%E6%8E%A8%E7%90%86%E5%8A%A0%E9%80%9F/Recent content in 推理加速 on 硅基 AGI · 智能体学习与测评Hugozh-cn本站内容采用 CC BY-NC-SA 4.0 国际许可协议授权Thu, 16 Jul 2026 11:33:00 +0800https://guijiagi.com/posts/b1-38dc2b9b/Thu, 16 Jul 2026 11:33:00 +0800https://guijiagi.com/posts/b1-38dc2b9b/深入解析Flash Attention的算法原理、GPU内存层次优化与实际性能表现https://guijiagi.com/posts/article-71/Mon, 13 Jul 2026 04:40:00 +0800https://guijiagi.com/posts/article-71/深入解析Speculative Decoding的数学原理、工程实现和最新变体，包括投机采样、批量投机等前沿技术https://guijiagi.com/posts/latency-optimization-llm-serving/Thu, 02 Jul 2026 11:35:00 +0800https://guijiagi.com/posts/latency-optimization-llm-serving/从首Token延迟到生成速度，LLM服务延迟优化的完整技术栈https://guijiagi.com/posts/specul-ive-decoding-2026/Thu, 02 Jul 2026 10:55:00 +0800https://guijiagi.com/posts/specul-ive-decoding-2026/从Draft-Verify到Medusa头，系统梳理推测解码的演进与2026年最新方案https://guijiagi.com/posts/flash-attention-3-explained/Thu, 02 Jul 2026 10:54:00 +0800https://guijiagi.com/posts/flash-attention-3-explained/从Flash Attention 1到3，解析注意力计算的性能极限突破之路https://guijiagi.com/posts/inference-framework-comparison-2026/Tue, 30 Jun 2026 17:30:00 +0800https://guijiagi.com/posts/inference-framework-comparison-2026/2026年主流大模型推理框架深度对比：vLLM、SGLang、TensorRT-LLM、TGI的性能、功能与选型指南https://guijiagi.com/posts/llm-quantization-int4-2026/Tue, 30 Jun 2026 16:30:00 +0800https://guijiagi.com/posts/llm-quantization-int4-2026/大模型量化技术全景：PTQ、AWQ、GPTQ、LLM.int8() 等主流量化方案原理对比，以及 INT4 推理的精度-效率权衡https://guijiagi.com/posts/speculative-decoding-practice/Tue, 30 Jun 2026 11:45:00 +0800https://guijiagi.com/posts/speculative-decoding-practice/深入实践Speculative Decoding技术，实现大模型推理速度3倍提升https://guijiagi.com/posts/llm-inference-speedup-2026/Tue, 30 Jun 2026 11:40:00 +0800https://guijiagi.com/posts/llm-inference-speedup-2026/全面对比2026年三大推理引擎vLLM、SGLang和TensorRT-LLM的性能与特性https://guijiagi.com/posts/multi-token-prediction-mtp-inference-acceleration/Tue, 30 Jun 2026 09:20:00 +0800https://guijiagi.com/posts/multi-token-prediction-mtp-inference-acceleration/深入解析多Token预测(MTP)技术原理、训练方法和推理加速效果，对比分析主流实现方案https://guijiagi.com/posts/multi-token-prediction/Tue, 30 Jun 2026 09:20:00 +0800https://guijiagi.com/posts/multi-token-prediction/深入介绍多Token预测（MTP/Multi-Token Prediction）技术，如何通过将每次生成多个token来加速大模型推理https://guijiagi.com/posts/ai-inference-optimization-2026/Tue, 30 Jun 2026 09:10:00 +0800https://guijiagi.com/posts/ai-inference-optimization-2026/2026年大模型推理优化全攻略：FP8/INT4量化、结构化/动态剪枝、知识蒸馏、推测解码、投机采样等核心技术的深度解析与实战对比https://guijiagi.com/posts/speculative-decoding-principles/Sun, 28 Jun 2026 11:07:00 +0800https://guijiagi.com/posts/speculative-decoding-principles/深入解析投机解码的算法原理、Draft Model 设计、接受率优化与2026年最新工程实践https://guijiagi.com/posts/tensorrt-llm-2026/Sun, 28 Jun 2026 11:00:00 +0800https://guijiagi.com/posts/tensorrt-llm-2026/深度解析 NVIDIA TensorRT-LLM 2026 的架构优化、部署流程、性能调优与生产实践https://guijiagi.com/posts/speculative-decoding-practical-3x-speedup-guide/Sun, 28 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/speculative-decoding-practical-3x-speedup-guide/Speculative Decoding投机解码实战配置指南：原理详解、Draft模型选择与3倍加速实测https://guijiagi.com/posts/llm-inference-acceleration-2026-vllm-sglang-tensorrt/Sun, 28 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/llm-inference-acceleration-2026-vllm-sglang-tensorrt/三大推理引擎全面对比：vLLM、SGLang、TensorRT-LLM在2026年的性能与功能评测https://guijiagi.com/posts/llm-inference-acceleration-2026/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/llm-inference-acceleration-2026/大模型推理加速技术全景解析，从KV Cache到投机解码的完整技术栈https://guijiagi.com/posts/llm-inference-acceleration-survey/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/llm-inference-acceleration-survey/大模型推理加速技术全景https://guijiagi.com/posts/speculative-decoding-explained/Thu, 25 Jun 2026 12:00:00 +0800https://guijiagi.com/posts/speculative-decoding-explained/从 Speculative Decoding 到 Medusa 和 EAGLE，全面解析投机解码如何在不损失质量的前提下将 LLM 推理速度提升 2-4 倍。https://guijiagi.com/posts/speculative-decoding-deep/Thu, 25 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/speculative-decoding-deep/深入解析投机解码原理、Medusa/EAGLE/Lookahead 等加速方案