https://guijiagi.com/tags/vllm/Recent content in VLLM on 硅基 AGI · 智能体学习与测评Hugozh-cn本站内容采用 CC BY-NC-SA 4.0 国际许可协议授权Thu, 16 Jul 2026 11:39:00 +0800https://guijiagi.com/posts/b1-f50aea03/Thu, 16 Jul 2026 11:39:00 +0800https://guijiagi.com/posts/b1-f50aea03/对比分析三大主流推理引擎的架构设计、性能特征与适用场景，给出选型建议https://guijiagi.com/posts/b2-e0dd1517/Thu, 16 Jul 2026 10:38:00 +0800https://guijiagi.com/posts/b2-e0dd1517/深度对比2026年三大主流大模型推理引擎的架构设计、性能表现与适用场景https://guijiagi.com/posts/b2-40a7d213/Thu, 16 Jul 2026 10:04:00 +0800https://guijiagi.com/posts/b2-40a7d213/系统梳理大模型推理优化技术栈，涵盖KV Cache、注意力优化、量化、投机解码等核心技术https://guijiagi.com/posts/article-87/Mon, 13 Jul 2026 07:20:00 +0800https://guijiagi.com/posts/article-87/深入解析Prefix Cache的原理、实现与工程优化，大幅降低大模型推理的首token延迟https://guijiagi.com/posts/article-82/Mon, 13 Jul 2026 06:30:00 +0800https://guijiagi.com/posts/article-82/深入解析Continuous Batching的原理、实现与工程优化，理解vLLM/TGI等推理框架的核心技术https://guijiagi.com/posts/llm-serving-framework-2026/Thu, 02 Jul 2026 11:37:00 +0800https://guijiagi.com/posts/llm-serving-framework-2026/2026年主流LLM服务框架对比，vLLM/TGI/TensorRT-LLM等深度评测https://guijiagi.com/posts/vllm-2026-community/Thu, 02 Jul 2026 11:26:00 +0800https://guijiagi.com/posts/vllm-2026-community/2026年vLLM社区发展动态与技术创新，LLM推理引擎的标杆https://guijiagi.com/posts/vllm-docker-deploy-2026/Thu, 02 Jul 2026 11:16:00 +0800https://guijiagi.com/posts/vllm-docker-deploy-2026/使用Docker快速部署vLLM推理服务，包含完整的生产配置与优化实践https://guijiagi.com/posts/paged-attention-impl-detail/Thu, 02 Jul 2026 11:10:00 +0800https://guijiagi.com/posts/paged-attention-impl-detail/深入解析vLLM中PagedAttention的实现细节，从块管理到内存共享https://guijiagi.com/posts/continuous-batching-internals/Thu, 02 Jul 2026 11:09:00 +0800https://guijiagi.com/posts/continuous-batching-internals/解析vLLM连续批处理的内部机制，如何动态调度请求提升GPU利用率https://guijiagi.com/posts/inference-framework-comparison-2026/Tue, 30 Jun 2026 17:30:00 +0800https://guijiagi.com/posts/inference-framework-comparison-2026/2026年主流大模型推理框架深度对比：vLLM、SGLang、TensorRT-LLM、TGI的性能、功能与选型指南https://guijiagi.com/posts/llm-inference-speedup-2026/Tue, 30 Jun 2026 11:40:00 +0800https://guijiagi.com/posts/llm-inference-speedup-2026/全面对比2026年三大推理引擎vLLM、SGLang和TensorRT-LLM的性能与特性https://guijiagi.com/posts/kv-cache-management-2026-frontier/Tue, 30 Jun 2026 09:20:00 +0800https://guijiagi.com/posts/kv-cache-management-2026-frontier/深入分析2026年大模型推理优化的核心方案——KV Cache管理，涵盖压缩、卸载、共享等前沿技术https://guijiagi.com/posts/ai-inference-optimization-2026/Tue, 30 Jun 2026 09:10:00 +0800https://guijiagi.com/posts/ai-inference-optimization-2026/2026年大模型推理优化全攻略：FP8/INT4量化、结构化/动态剪枝、知识蒸馏、推测解码、投机采样等核心技术的深度解析与实战对比https://guijiagi.com/posts/continuous-batching-vllm/Sun, 28 Jun 2026 11:08:00 +0800https://guijiagi.com/posts/continuous-batching-vllm/深入解析连续批处理（Continuous Batching）的原理、vLLM实现细节与2026年高吞吐推理系统设计https://guijiagi.com/posts/vllm-2026-deployment-guide/Sun, 28 Jun 2026 11:00:00 +0800https://guijiagi.com/posts/vllm-2026-deployment-guide/从单机部署到分布式集群，全面覆盖 vLLM 2026 的安装、配置、优化与生产运维实践https://guijiagi.com/posts/speculative-decoding-practical-3x-speedup-guide/Sun, 28 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/speculative-decoding-practical-3x-speedup-guide/Speculative Decoding投机解码实战配置指南：原理详解、Draft模型选择与3倍加速实测https://guijiagi.com/posts/llm-inference-acceleration-2026-vllm-sglang-tensorrt/Sun, 28 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/llm-inference-acceleration-2026-vllm-sglang-tensorrt/三大推理引擎全面对比：vLLM、SGLang、TensorRT-LLM在2026年的性能与功能评测https://guijiagi.com/posts/vllm-vs-sglang-benchmark/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/vllm-vs-sglang-benchmark/vLLM vs SGLang性能基准https://guijiagi.com/posts/vllm-opensource-inference/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/vllm-opensource-inference/vLLM开源推理引擎https://guijiagi.com/posts/vllm-production-guide/Thu, 25 Jun 2026 12:00:00 +0800https://guijiagi.com/posts/vllm-production-guide/从架构原理到生产部署，全面解析 vLLM 高吞吐推理引擎的核心技术、性能调优与运维方案。https://guijiagi.com/posts/local-llm-deployment/Thu, 25 Jun 2026 12:00:00 +0800https://guijiagi.com/posts/local-llm-deployment/全面对比 2026 年四大本地 LLM 部署方案：Ollama、vLLM、LM Studio、TGI 的性能、易用性、并发能力与生产环境适用性分析。https://guijiagi.com/posts/continuous-batching/Thu, 25 Jun 2026 12:00:00 +0800https://guijiagi.com/posts/continuous-batching/深度解析 vLLM 连续批处理（Continuous Batching）如何通过动态请求调度和 PagedAttention 实现高吞吐 LLM 推理服务。https://guijiagi.com/posts/sglang-vs-vllm/Thu, 25 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/sglang-vs-vllm/从 RadixAttention 到缓存共享，深度对比 SGLang 与 vLLM 的架构差异、性能表现与适用场景。https://guijiagi.com/posts/vllm-deployment-deep/Thu, 25 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/vllm-deployment-deep/深入解析 vLLM 架构、PagedAttention 原理、Continuous Batching、量化支持与分布式推理部署。https://guijiagi.com/posts/vllm-advanced-guide/Wed, 24 Jun 2026 16:00:00 +0800https://guijiagi.com/posts/vllm-advanced-guide/深入 vLLM 高级配置，从 PagedAttention 到张量并行、量化推理与 LoRA 动态加载https://guijiagi.com/posts/vllm-deployment-guide/Wed, 24 Jun 2026 11:10:00 +0800https://guijiagi.com/posts/vllm-deployment-guide/vLLM 的架构原理、部署配置和性能调优全指南