https://guijiagi.com/tags/rope/Recent content in RoPE on 硅基 AGI · 智能体学习与测评Hugozh-cn本站内容采用 CC BY-NC-SA 4.0 国际许可协议授权Thu, 16 Jul 2026 10:36:00 +0800https://guijiagi.com/posts/b2-d60bc32e/Thu, 16 Jul 2026 10:36:00 +0800https://guijiagi.com/posts/b2-d60bc32e/分析大模型处理超长上下文面临的技术挑战，涵盖注意力衰减、Needle-in-Haystack测试与长上下文优化策略https://guijiagi.com/posts/article-80/Mon, 13 Jul 2026 06:10:00 +0800https://guijiagi.com/posts/article-80/系统解析Rotary Position Embedding的数学原理、关键变体与工程实现，理解为什么它成为主流位置编码方案https://guijiagi.com/posts/article-27/Sun, 12 Jul 2026 21:20:00 +0800https://guijiagi.com/posts/article-27/从32K到10M+，上下文窗口扩展的技术路径、瓶颈分析与未来展望https://guijiagi.com/posts/b2-188174a6/Sun, 12 Jul 2026 21:20:00 +0800https://guijiagi.com/posts/b2-188174a6/从32K到10M+，上下文窗口扩展的技术路径、瓶颈分析与未来展望https://guijiagi.com/posts/rope-rotation-position-encoding/Thu, 02 Jul 2026 10:51:00 +0800https://guijiagi.com/posts/rope-rotation-position-encoding/深入解析RoPE旋转位置编码的数学原理、长度外推方法及2026年最新改进https://guijiagi.com/posts/long-context-evolution-positional-encoding-to-ring-attention/Tue, 30 Jun 2026 09:20:00 +0800https://guijiagi.com/posts/long-context-evolution-positional-encoding-to-ring-attention/全面梳理大模型长上下文技术的演进路线，涵盖位置编码外推、分块注意力、环形注意力等前沿方案https://guijiagi.com/posts/long-context-techniques-2026/Tue, 30 Jun 2026 09:20:00 +0800https://guijiagi.com/posts/long-context-techniques-2026/系统梳理大模型长上下文处理技术的演进历程，从位置编码方案到环形注意力机制https://guijiagi.com/posts/positional-encoding-comparison/Sun, 28 Jun 2026 11:02:00 +0800https://guijiagi.com/posts/positional-encoding-comparison/深入对比RoPE旋转位置编码、ALiBi线性偏置、NoPE无位置编码三种方案的数学原理、长文本外推能力与实测性能https://guijiagi.com/posts/positional-encoding/Thu, 25 Jun 2026 12:00:00 +0800https://guijiagi.com/posts/positional-encoding/系统梳理 Transformer 位置编码的演进历程，深入分析 Sinusoidal、Learned、Relative、RoPE、ALiBi 等方案的数学原理与工程实现。https://guijiagi.com/posts/positional-encoding-guide/Thu, 25 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/positional-encoding-guide/系统解析 Transformer 位置编码的演进脉络与长度外推技术https://guijiagi.com/posts/rope-rotation-embedding/Thu, 25 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/rope-rotation-embedding/深入解析 RoPE 数学原理及主流长度外推方法 NTK/YaRN/Longrope