https://guijiagi.com/tags/transformer/Recent content in Transformer on 硅基 AGI · 智能体学习与测评Hugozh-cn本站内容采用 CC BY-NC-SA 4.0 国际许可协议授权Mon, 13 Jul 2026 07:40:00 +0800https://guijiagi.com/posts/article-89/Mon, 13 Jul 2026 07:40:00 +0800https://guijiagi.com/posts/article-89/回顾从Transformer诞生到2026年的架构演进，梳理每一次关键突破的技术脉络https://guijiagi.com/posts/article-80/Mon, 13 Jul 2026 06:10:00 +0800https://guijiagi.com/posts/article-80/系统解析Rotary Position Embedding的数学原理、关键变体与工程实现，理解为什么它成为主流位置编码方案https://guijiagi.com/posts/article-65/Mon, 13 Jul 2026 03:40:00 +0800https://guijiagi.com/posts/article-65/回顾从BERT到GPT再到大模型时代的语言模型演进历程，梳理关键技术节点和思想脉络https://guijiagi.com/posts/article-55/Mon, 13 Jul 2026 02:00:00 +0800https://guijiagi.com/posts/article-55/从标准Self-Attention到Linear Attention、Flash Attention、Sparse Attention，全面梳理注意力机制的演进脉络https://guijiagi.com/posts/article-06/Sun, 12 Jul 2026 17:50:00 +0800https://guijiagi.com/posts/article-06/从原理到实践，全面解析Transformer-XL如何突破标准Transformer的序列长度限制https://guijiagi.com/posts/b2-5c0c8534/Sun, 12 Jul 2026 17:50:00 +0800https://guijiagi.com/posts/b2-5c0c8534/从原理到实践，全面解析Transformer-XL如何突破标准Transformer的序列长度限制https://guijiagi.com/posts/rope-rotation-position-encoding/Thu, 02 Jul 2026 10:51:00 +0800https://guijiagi.com/posts/rope-rotation-position-encoding/深入解析RoPE旋转位置编码的数学原理、长度外推方法及2026年最新改进https://guijiagi.com/posts/transformer-attention-mechanism-deep/Thu, 02 Jul 2026 10:50:00 +0800https://guijiagi.com/posts/transformer-attention-mechanism-deep/从数学原理到工程实现，全面拆解Transformer注意力机制的核心细节https://guijiagi.com/posts/post-llm-era-paradigm/Thu, 02 Jul 2026 10:32:00 +0800https://guijiagi.com/posts/post-llm-era-paradigm/LLM时代终将过去，什么架构将取代Transformer？https://guijiagi.com/posts/transformer-architecture-2026-attention-to-moe-evolution/Tue, 30 Jun 2026 09:20:00 +0800https://guijiagi.com/posts/transformer-architecture-2026-attention-to-moe-evolution/深入解析Transformer架构在2026年的最新演进，涵盖注意力机制优化、MoE混合专家、线性注意力等前沿方向https://guijiagi.com/posts/transformer-architecture-2026/Tue, 30 Jun 2026 09:20:00 +0800https://guijiagi.com/posts/transformer-architecture-2026/深入解析Transformer架构在2026年的最新演进，涵盖注意力机制优化、混合专家模型、线性注意力等前沿方向https://guijiagi.com/posts/transformer-architecture-2026-evolution/Sun, 28 Jun 2026 11:00:00 +0800https://guijiagi.com/posts/transformer-architecture-2026-evolution/深入解析Transformer架构在2026年的最新演进，涵盖Attention机制优化、MoE混合专家架构、Mamba状态空间模型三大方向https://guijiagi.com/posts/transformer-alternatives-survey/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/transformer-alternatives-survey/Transformer替代架构Surveyhttps://guijiagi.com/posts/attention-mechanism-variants-2026/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/attention-mechanism-variants-2026/系统对比分析主流注意力机制变体，从标准Self-Attention到Flash Attention的技术演进https://guijiagi.com/posts/transformer-alternatives-2026/Thu, 25 Jun 2026 12:00:00 +0800https://guijiagi.com/posts/transformer-alternatives-2026/深度解析 Mamba、S4/S6、RWKV 等替代 Transformer 的新一代架构，从状态空间模型到线性注意力，全面对比优劣。https://guijiagi.com/posts/attention-mechanism-evolution/Thu, 25 Jun 2026 12:00:00 +0800https://guijiagi.com/posts/attention-mechanism-evolution/全面梳理注意力机制从 2014 年到 2025 年的演进历程，涵盖 Bahdanau Attention、Self-Attention、Multi-Head、Linear Attention、Flash Attention 等关键技术。https://guijiagi.com/posts/attention-mechanism-explained/Thu, 25 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/attention-mechanism-explained/深入解析 Transformer Attention 机制的数学原理、变体演进与复杂度分析https://guijiagi.com/posts/transformer-architecture-deep/Wed, 24 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/transformer-architecture-deep/深入剖析 Transformer 架构的每个组件，从自注意力机制到 GPT 解码器-only 架构的演进