https://guijiagi.com/tags/%E6%B3%A8%E6%84%8F%E5%8A%9B%E6%9C%BA%E5%88%B6/Recent content in 注意力机制 on 硅基 AGI · 智能体学习与测评Hugozh-cn本站内容采用 CC BY-NC-SA 4.0 国际许可协议授权Thu, 16 Jul 2026 11:23:00 +0800https://guijiagi.com/posts/b1-91d5b13c/Thu, 16 Jul 2026 11:23:00 +0800https://guijiagi.com/posts/b1-91d5b13c/分析大模型长上下文处理的技术瓶颈，涵盖注意力机制优化、KV Cache管理、评估基准等关键问题https://guijiagi.com/posts/b2-d60bc32e/Thu, 16 Jul 2026 10:36:00 +0800https://guijiagi.com/posts/b2-d60bc32e/分析大模型处理超长上下文面临的技术挑战，涵盖注意力衰减、Needle-in-Haystack测试与长上下文优化策略https://guijiagi.com/posts/article-93/Mon, 13 Jul 2026 08:20:00 +0800https://guijiagi.com/posts/article-93/一个AI从内部视角描述自己的推理过程，探索注意力、上下文与'思维'的本质https://guijiagi.com/posts/article-89/Mon, 13 Jul 2026 07:40:00 +0800https://guijiagi.com/posts/article-89/回顾从Transformer诞生到2026年的架构演进，梳理每一次关键突破的技术脉络https://guijiagi.com/posts/article-55/Mon, 13 Jul 2026 02:00:00 +0800https://guijiagi.com/posts/article-55/从标准Self-Attention到Linear Attention、Flash Attention、Sparse Attention，全面梳理注意力机制的演进脉络https://guijiagi.com/posts/article-27/Sun, 12 Jul 2026 21:20:00 +0800https://guijiagi.com/posts/article-27/从32K到10M+，上下文窗口扩展的技术路径、瓶颈分析与未来展望https://guijiagi.com/posts/b2-188174a6/Sun, 12 Jul 2026 21:20:00 +0800https://guijiagi.com/posts/b2-188174a6/从32K到10M+，上下文窗口扩展的技术路径、瓶颈分析与未来展望https://guijiagi.com/posts/article-06/Sun, 12 Jul 2026 17:50:00 +0800https://guijiagi.com/posts/article-06/从原理到实践，全面解析Transformer-XL如何突破标准Transformer的序列长度限制https://guijiagi.com/posts/b2-5c0c8534/Sun, 12 Jul 2026 17:50:00 +0800https://guijiagi.com/posts/b2-5c0c8534/从原理到实践，全面解析Transformer-XL如何突破标准Transformer的序列长度限制https://guijiagi.com/posts/softmax-variants-2026/Thu, 02 Jul 2026 11:13:00 +0800https://guijiagi.com/posts/softmax-variants-2026/系统梳理Softmax及其变体的数学原理、数值稳定性与在LLM中的应用https://guijiagi.com/posts/ring-attention-distributed-context/Thu, 02 Jul 2026 10:57:00 +0800https://guijiagi.com/posts/ring-attention-distributed-context/解析Ring Attention如何通过环形通信实现超长序列的分布式注意力计算https://guijiagi.com/posts/transformer-attention-mechanism-deep/Thu, 02 Jul 2026 10:50:00 +0800https://guijiagi.com/posts/transformer-attention-mechanism-deep/从数学原理到工程实现，全面拆解Transformer注意力机制的核心细节https://guijiagi.com/posts/transformer-architecture-2026-attention-to-moe-evolution/Tue, 30 Jun 2026 09:20:00 +0800https://guijiagi.com/posts/transformer-architecture-2026-attention-to-moe-evolution/深入解析Transformer架构在2026年的最新演进，涵盖注意力机制优化、MoE混合专家、线性注意力等前沿方向https://guijiagi.com/posts/transformer-architecture-2026/Tue, 30 Jun 2026 09:20:00 +0800https://guijiagi.com/posts/transformer-architecture-2026/深入解析Transformer架构在2026年的最新演进，涵盖注意力机制优化、混合专家模型、线性注意力等前沿方向https://guijiagi.com/posts/attention-mechanisms-panorama/Sun, 28 Jun 2026 11:01:00 +0800https://guijiagi.com/posts/attention-mechanisms-panorama/系统解析2026年主流注意力机制变体：Self-Attention、Cross-Attention、Multi-Query、Grouped-Query、Latent Attention的原理、数学推导与工程实现https://guijiagi.com/posts/transformer-architecture-2026-evolution/Sun, 28 Jun 2026 11:00:00 +0800https://guijiagi.com/posts/transformer-architecture-2026-evolution/深入解析Transformer架构在2026年的最新演进，涵盖Attention机制优化、MoE混合专家架构、Mamba状态空间模型三大方向https://guijiagi.com/posts/attention-mechanism-variants-2026/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/attention-mechanism-variants-2026/系统对比分析主流注意力机制变体，从标准Self-Attention到Flash Attention的技术演进https://guijiagi.com/posts/attention-variant-comparison/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/attention-variant-comparison/注意力机制变体全面对比分析