https://guijiagi.com/tags/rlhf/Recent content in RLHF on 硅基 AGI · 智能体学习与测评Hugozh-cn本站内容采用 CC BY-NC-SA 4.0 国际许可协议授权Thu, 16 Jul 2026 11:05:00 +0800https://guijiagi.com/posts/b1-fd3b570e/Thu, 16 Jul 2026 11:05:00 +0800https://guijiagi.com/posts/b1-fd3b570e/梳理AI对齐的主流技术路线，从RLHF到DPO再到宪法AI的演进逻辑与实现要点https://guijiagi.com/posts/b2-fd3b570e/Thu, 16 Jul 2026 10:05:00 +0800https://guijiagi.com/posts/b2-fd3b570e/全面梳理大模型安全对齐技术体系，涵盖RLHF、DPO、Constitutional AI及红队测试实践https://guijiagi.com/posts/article-85/Mon, 13 Jul 2026 07:00:00 +0800https://guijiagi.com/posts/article-85/系统梳理大模型对齐的完整流程，从数据标注到SFT到RLHF再到DPO的工程实践https://guijiagi.com/posts/article-63/Mon, 13 Jul 2026 03:20:00 +0800https://guijiagi.com/posts/article-63/系统梳理大模型安全对齐技术栈，从RLHF到Constitutional AI，从训练阶段到推理阶段的全链路安全方案https://guijiagi.com/posts/article-10/Sun, 12 Jul 2026 18:30:00 +0800https://guijiagi.com/posts/article-10/深入解析Direct Preference Optimization的数学原理和实践优势，探讨它如何简化RLHF流程https://guijiagi.com/posts/b2-c244c3f2/Sun, 12 Jul 2026 18:30:00 +0800https://guijiagi.com/posts/b2-c244c3f2/深入解析Direct Preference Optimization的数学原理和实践优势，探讨它如何简化RLHF流程https://guijiagi.com/posts/loss-function-llm-training/Thu, 02 Jul 2026 11:14:00 +0800https://guijiagi.com/posts/loss-function-llm-training/从交叉熵到对比学习，系统梳理LLM训练中的各类损失函数及其作用https://guijiagi.com/posts/rlhf-implementation-2026/Thu, 02 Jul 2026 10:44:00 +0800https://guijiagi.com/posts/rlhf-implementation-2026/系统介绍2026年RLHF的实现方法、工具链与最佳实践https://guijiagi.com/posts/alignment-evolution-rlhf-to-orpo/Tue, 30 Jun 2026 17:10:00 +0800https://guijiagi.com/posts/alignment-evolution-rlhf-to-orpo/大模型对齐技术演进：RLHF、DPO、ORPO、GRPO等核心算法原理、实现要点与2026年最新进展https://guijiagi.com/posts/ai-alignment-2026-rlhf-to-constitutional/Tue, 30 Jun 2026 10:15:00 +0800https://guijiagi.com/posts/ai-alignment-2026-rlhf-to-constitutional/系统梳理2026年AI对齐技术的完整演进路径，从RLHF到Constitutional AI再到可扩展监督，分析各方案的优劣与适用场景https://guijiagi.com/posts/dpo-preference-alignment-guide/Tue, 30 Jun 2026 09:40:00 +0800https://guijiagi.com/posts/dpo-preference-alignment-guide/DPO已成为偏好对齐的主流方案，本文详解DPO的数据构建、训练配置与超参调优全流程https://guijiagi.com/posts/rlhf-alternatives-2026-dpo-grpo-simpo/Tue, 30 Jun 2026 09:20:00 +0800https://guijiagi.com/posts/rlhf-alternatives-2026-dpo-grpo-simpo/深入对比2026年主流的RLHF替代方案：DPO、GRPO、SimPO的技术原理、优缺点和适用场景https://guijiagi.com/posts/rlhf-alternatives-2026/Tue, 30 Jun 2026 09:20:00 +0800https://guijiagi.com/posts/rlhf-alternatives-2026/全面对比2026年主流RLHF替代方案，涵盖DPO、GRPO、SimPO等对齐技术的原理、优缺点和适用场景https://guijiagi.com/posts/llm-alignment-constitutional-ai/Tue, 30 Jun 2026 09:20:00 +0800https://guijiagi.com/posts/llm-alignment-constitutional-ai/系统梳理大模型对齐技术的发展脉络，从RLHF到Constitutional AI再到2026年最新的对齐方案https://guijiagi.com/posts/llm-training-pipeline-pretrain-sft-rlhf-dpo/Sun, 28 Jun 2026 11:10:00 +0800https://guijiagi.com/posts/llm-training-pipeline-pretrain-sft-rlhf-dpo/系统解析大模型训练的四个阶段：预训练、监督微调、RLHF、DPO的原理、流程与2026年最佳实践https://guijiagi.com/posts/ai-alignment-2026-rlhf-constitutional/Sun, 28 Jun 2026 10:50:00 +0800https://guijiagi.com/posts/ai-alignment-2026-rlhf-constitutional/2026年AI对齐技术全景：RLHF、Constitutional AI、DPO及最新对齐方法的深度解析https://guijiagi.com/posts/dpo-training-practice-preference-alignment-data-engineering/Sun, 28 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/dpo-training-practice-preference-alignment-data-engineering/深入解析 DPO（Direct Preference Optimization）训练流程，涵盖偏好数据构建、训练配置和效果评估https://guijiagi.com/posts/grpo-algorithm-deepseek-reinforcement-learning/Sun, 28 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/grpo-algorithm-deepseek-reinforcement-learning/深入解析 DeepSeek 提出的 GRPO（Group Relative Policy Optimization）算法，理解其原理、优势和实践方法https://guijiagi.com/posts/constitutional-ai-practice/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/constitutional-ai-practice/深入解析宪法AI（Constitutional AI）的核心原理、实施步骤与工程实践经验https://guijiagi.com/posts/rlhf-technique-deep-dive/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/rlhf-technique-deep-dive/强化学习RLHF技术原理详解https://guijiagi.com/posts/rlhf-dpo-grpo/Thu, 25 Jun 2026 12:00:00 +0800https://guijiagi.com/posts/rlhf-dpo-grpo/从 RLHF 的 PPO 到 DPO 的无奖励模型，再到 GRPO 的群组相对策略优化，深度解析三种主流 LLM 对齐算法的原理与优劣。https://guijiagi.com/posts/ai-alignment-2026/Thu, 25 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/ai-alignment-2026/深度解析 AI 对齐技术的演进路径，从 RLHF 的局限到 Constitutional AI、DPO/KTO 及可扩展监督的最新进展。https://guijiagi.com/posts/dpo-vs-rlhf/Thu, 25 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/dpo-vs-rlhf/深入对比 RLHF 三阶段流程与 DPO 直接偏好优化的原理、优劣势和工程实践https://guijiagi.com/posts/ai-alignment-techniques/Wed, 24 Jun 2026 11:50:00 +0800https://guijiagi.com/posts/ai-alignment-techniques/系统梳理 AI 对齐的技术路径、方法对比和实践选择