https://guijiagi.com/tags/%E6%8E%A8%E7%90%86%E4%BC%98%E5%8C%96/Recent content in 推理优化 on 硅基 AGI · 智能体学习与测评Hugozh-cn本站内容采用 CC BY-NC-SA 4.0 国际许可协议授权Thu, 16 Jul 2026 11:01:00 +0800https://guijiagi.com/posts/b1-40a7d213/Thu, 16 Jul 2026 11:01:00 +0800https://guijiagi.com/posts/b1-40a7d213/系统梳理大模型推理优化的核心技术路径，涵盖KV Cache、连续批处理、投机解码等前沿方案https://guijiagi.com/posts/b2-40a7d213/Thu, 16 Jul 2026 10:04:00 +0800https://guijiagi.com/posts/b2-40a7d213/系统梳理大模型推理优化技术栈，涵盖KV Cache、注意力优化、量化、投机解码等核心技术https://guijiagi.com/posts/article-91/Mon, 13 Jul 2026 08:00:00 +0800https://guijiagi.com/posts/article-91/系统梳理大模型压缩的三大技术路线，从原理到工程落地，让大模型跑在每一台设备上https://guijiagi.com/posts/article-87/Mon, 13 Jul 2026 07:20:00 +0800https://guijiagi.com/posts/article-87/深入解析Prefix Cache的原理、实现与工程优化，大幅降低大模型推理的首token延迟https://guijiagi.com/posts/article-82/Mon, 13 Jul 2026 06:30:00 +0800https://guijiagi.com/posts/article-82/深入解析Continuous Batching的原理、实现与工程优化，理解vLLM/TGI等推理框架的核心技术https://guijiagi.com/posts/article-49/Mon, 13 Jul 2026 01:00:00 +0800https://guijiagi.com/posts/article-49/从logit蒸馏到agent蒸馏，知识蒸馏技术的最新进展与实践指南https://guijiagi.com/posts/b2-7b5c9e69/Mon, 13 Jul 2026 01:00:00 +0800https://guijiagi.com/posts/b2-7b5c9e69/从logit蒸馏到agent蒸馏，知识蒸馏技术的最新进展与实践指南https://guijiagi.com/posts/article-41/Sun, 12 Jul 2026 23:40:00 +0800https://guijiagi.com/posts/article-41/从PagedAttention到多级缓存，KV Cache优化的技术全栈解析https://guijiagi.com/posts/b2-280c75eb/Sun, 12 Jul 2026 23:40:00 +0800https://guijiagi.com/posts/b2-280c75eb/从PagedAttention到多级缓存，KV Cache优化的技术全栈解析https://guijiagi.com/posts/article-15/Sun, 12 Jul 2026 19:20:00 +0800https://guijiagi.com/posts/article-15/系统性地介绍大模型推理成本优化的各种技术手段，从量化压缩到请求调度的全栈优化方案https://guijiagi.com/posts/b2-5902a9c6/Sun, 12 Jul 2026 19:20:00 +0800https://guijiagi.com/posts/b2-5902a9c6/系统性地介绍大模型推理成本优化的各种技术手段，从量化压缩到请求调度的全栈优化方案https://guijiagi.com/posts/article-08/Sun, 12 Jul 2026 18:10:00 +0800https://guijiagi.com/posts/article-08/在统一硬件环境下，全面对比三种主流量化方案在推理速度、显存占用和模型质量上的表现https://guijiagi.com/posts/b2-834c7318/Sun, 12 Jul 2026 18:10:00 +0800https://guijiagi.com/posts/b2-834c7318/在统一硬件环境下，全面对比三种主流量化方案在推理速度、显存占用和模型质量上的表现https://guijiagi.com/posts/llm-load-balancing-strategy/Thu, 02 Jul 2026 11:23:00 +0800https://guijiagi.com/posts/llm-load-balancing-strategy/从轮询到感知调度，LLM推理服务负载均衡的完整策略分析https://guijiagi.com/posts/continuous-batching-internals/Thu, 02 Jul 2026 11:09:00 +0800https://guijiagi.com/posts/continuous-batching-internals/解析vLLM连续批处理的内部机制，如何动态调度请求提升GPU利用率https://guijiagi.com/posts/kv-cache-optimization-techniques/Thu, 02 Jul 2026 10:53:00 +0800https://guijiagi.com/posts/kv-cache-optimization-techniques/从PagedAttention到量化缓存，系统梳理KV Cache的各类优化方案https://guijiagi.com/posts/kv-cache-optimization-guide/Tue, 30 Jun 2026 11:50:00 +0800https://guijiagi.com/posts/kv-cache-optimization-guide/全面解析KV Cache优化技术，从PagedAttention到MLA的深度对比https://guijiagi.com/posts/moe-architecture-comparison/Tue, 30 Jun 2026 11:30:00 +0800https://guijiagi.com/posts/moe-architecture-comparison/深度对比三大MoE架构大模型的技术细节和性能表现https://guijiagi.com/posts/prompt-engineering-cot-variants/Tue, 30 Jun 2026 10:45:00 +0800https://guijiagi.com/posts/prompt-engineering-cot-variants/深入讲解Chain-of-Thought的各种变体，包括CoT、CoT-SC、ToT、GoT等，以及2026年最新实践技巧与代码实现https://guijiagi.com/posts/kv-cache-management-2026-frontier/Tue, 30 Jun 2026 09:20:00 +0800https://guijiagi.com/posts/kv-cache-management-2026-frontier/深入分析2026年大模型推理优化的核心方案——KV Cache管理，涵盖压缩、卸载、共享等前沿技术https://guijiagi.com/posts/test-time-compute-theory-practice/Sun, 28 Jun 2026 11:17:00 +0800https://guijiagi.com/posts/test-time-compute-theory-practice/深入解析Test-time Compute的原理、方法与实践，探讨推理时计算Scaling的新范式https://guijiagi.com/posts/continuous-batching-vllm/Sun, 28 Jun 2026 11:08:00 +0800https://guijiagi.com/posts/continuous-batching-vllm/深入解析连续批处理（Continuous Batching）的原理、vLLM实现细节与2026年高吞吐推理系统设计https://guijiagi.com/posts/kv-cache-principles/Sun, 28 Jun 2026 11:04:00 +0800https://guijiagi.com/posts/kv-cache-principles/深入解析KV Cache的工作原理、内存计算、优化策略与2026年最新技术进展https://guijiagi.com/posts/kv-cache-optimization-pagedattention-to-mla/Sun, 28 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/kv-cache-optimization-pagedattention-to-mla/大模型KV Cache优化技术全景解析：PagedAttention、GQA、MQA、MLA原理与实测对比https://guijiagi.com/posts/kv-cache-optimization-2026/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/kv-cache-optimization-2026/全面解析KV Cache优化策略，从内存管理到压缩淘汰的完整技术方案https://guijiagi.com/posts/kv-cache-guide/Wed, 24 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/kv-cache-guide/深入解析 KV Cache 的工作原理、内存计算与优化技术，包括 PagedAttention、量化 KV Cache 等https://guijiagi.com/posts/llm-inference-optimization/Wed, 24 Jun 2026 11:30:00 +0800https://guijiagi.com/posts/llm-inference-optimization/LLM 推理性能优化的完整技术栈，涵盖显存、计算和通信优化https://guijiagi.com/posts/vllm-deployment-guide/Wed, 24 Jun 2026 11:10:00 +0800https://guijiagi.com/posts/vllm-deployment-guide/vLLM 的架构原理、部署配置和性能调优全指南