https://guijiagi.com/tags/relu/Recent content in ReLU on 硅基 AGI · 智能体学习与测评Hugozh-cn本站内容采用 CC BY-NC-SA 4.0 国际许可协议授权Thu, 02 Jul 2026 11:03:00 +0800https://guijiagi.com/posts/activation-function-survey-2026/Thu, 02 Jul 2026 11:03:00 +0800https://guijiagi.com/posts/activation-function-survey-2026/从ReLU到GELU再到SwiGLU，全面梳理激活函数的演进脉络与2026年新趋势