https://guijiagi.com/categories/%E6%8A%80%E6%9C%AF-/-%E5%B7%A5%E5%85%B7/Recent content in 技术 / 工具 on AI 实战派 · 从技术到赚钱Hugozh-cn本站内容采用 CC BY-NC-SA 4.0 国际许可协议授权Wed, 07 Oct 2026 18:54:00 +0800https://guijiagi.com/posts/2026-10-07-gptq-awq-quantization-deep-dive/Wed, 07 Oct 2026 18:54:00 +0800https://guijiagi.com/posts/2026-10-07-gptq-awq-quantization-deep-dive/同样是把权重压到 4bit，GPTQ 用二阶误差补偿，AWQ 保护显著权重。拆解两派原理、质量差异与选型建议。https://guijiagi.com/posts/2026-10-07-flashattention-kv-cache-deep-dive/Wed, 07 Oct 2026 18:48:00 +0800https://guijiagi.com/posts/2026-10-07-flashattention-kv-cache-deep-dive/注意力是 O(N²) 的显存怪兽，KV Cache 又随并发与长度膨胀。拆解 FlashAttention 怎么省显存，以及长上下文的成本账。https://guijiagi.com/posts/2026-10-07-prompt-structured-output-json/Wed, 07 Oct 2026 18:42:00 +0800https://guijiagi.com/posts/2026-10-07-prompt-structured-output-json/模型偶尔吐出的 JSON 缺括号、带多余文字。从 prompt 约束到 JSON mode 再到语法约束，三层手段把格式锁死。https://guijiagi.com/posts/2026-10-07-ollama-lmstudio-local-tips/Wed, 07 Oct 2026 18:36:00 +0800https://guijiagi.com/posts/2026-10-07-ollama-lmstudio-local-tips/Ollama 偏命令行、LM Studio 偏图形界面。从模型选型、上下文长度到 API 调用，讲清两个本地工具的分工与坑。https://guijiagi.com/posts/2026-10-07-speculative-decoding-speedup/Wed, 07 Oct 2026 18:30:00 +0800https://guijiagi.com/posts/2026-10-07-speculative-decoding-speedup/draft 模型先猜、主模型批量验证，吞吐能提 1.5 到 3 倍。但词表不匹配会反噬。手把手讲清怎么开、怎么调。