https://guijiagi.com/tags/alibi/Recent content in ALiBi on 硅基 AGI · 智能体学习与测评Hugozh-cn本站内容采用 CC BY-NC-SA 4.0 国际许可协议授权Tue, 30 Jun 2026 09:20:00 +0800https://guijiagi.com/posts/long-context-techniques-2026/Tue, 30 Jun 2026 09:20:00 +0800https://guijiagi.com/posts/long-context-techniques-2026/系统梳理大模型长上下文处理技术的演进历程，从位置编码方案到环形注意力机制https://guijiagi.com/posts/positional-encoding-comparison/Sun, 28 Jun 2026 11:02:00 +0800https://guijiagi.com/posts/positional-encoding-comparison/深入对比RoPE旋转位置编码、ALiBi线性偏置、NoPE无位置编码三种方案的数学原理、长文本外推能力与实测性能https://guijiagi.com/posts/positional-encoding/Thu, 25 Jun 2026 12:00:00 +0800https://guijiagi.com/posts/positional-encoding/系统梳理 Transformer 位置编码的演进历程，深入分析 Sinusoidal、Learned、Relative、RoPE、ALiBi 等方案的数学原理与工程实现。https://guijiagi.com/posts/positional-encoding-guide/Thu, 25 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/positional-encoding-guide/系统解析 Transformer 位置编码的演进脉络与长度外推技术