https://guijiagi.com/categories/%E6%B5%8B%E8%AF%84%E6%96%B9%E6%B3%95/Recent content in 测评方法 on 硅基 AGI · 智能体学习与测评Hugozh-cn本站内容采用 CC BY-NC-SA 4.0 国际许可协议授权Thu, 16 Jul 2026 11:43:00 +0800https://guijiagi.com/posts/b1-979fd626/Thu, 16 Jul 2026 11:43:00 +0800https://guijiagi.com/posts/b1-979fd626/构建AI Agent测试体系的方法论，涵盖确定性测试、概率测试和端到端测试的工程实践https://guijiagi.com/posts/b1-fc9cb559/Thu, 16 Jul 2026 11:25:00 +0800https://guijiagi.com/posts/b1-fc9cb559/系统梳理大模型评测体系，涵盖知识基准、能力评测、对齐评测与真实场景测试方法论https://guijiagi.com/posts/b1-b4f957a6/Thu, 16 Jul 2026 11:22:00 +0800https://guijiagi.com/posts/b1-b4f957a6/介绍AI红队测试的系统化方法论，涵盖攻击面分析、测试设计、漏洞分类与修复验证https://guijiagi.com/posts/b1-07dc2328/Thu, 16 Jul 2026 11:15:00 +0800https://guijiagi.com/posts/b1-07dc2328/系统化测评AI Agent的规划与执行能力，涵盖任务分解、长期规划、错误恢复等维度https://guijiagi.com/posts/b2-743cce1d/Thu, 16 Jul 2026 10:45:00 +0800https://guijiagi.com/posts/b2-743cce1d/系统构建大模型评估框架，涵盖知识能力、推理能力、安全性、对齐度等多维度评估方法https://guijiagi.com/posts/b2-d5b0a891/Thu, 16 Jul 2026 10:16:00 +0800https://guijiagi.com/posts/b2-d5b0a891/系统构建AI Agent能力评估框架，涵盖任务完成率、工具使用效率、自主决策能力等核心评测维度https://guijiagi.com/posts/b2-7f4985ab/Thu, 16 Jul 2026 10:08:00 +0800https://guijiagi.com/posts/b2-7f4985ab/全面测评2026年主流代码生成智能体的实际能力，分析各工具在真实开发场景中的表现与适用边界https://guijiagi.com/posts/article-74/Mon, 13 Jul 2026 05:10:00 +0800https://guijiagi.com/posts/article-74/系统性介绍AI Agent评估管线的构建方法，从指标设计到数据集构建到自动化评估全流程实操指南https://guijiagi.com/posts/article-34/Sun, 12 Jul 2026 22:30:00 +0800https://guijiagi.com/posts/article-34/从功能正确性到代码可维护性，构建AI生成代码的多维评估体系https://guijiagi.com/posts/b2-88900a97/Sun, 12 Jul 2026 22:30:00 +0800https://guijiagi.com/posts/b2-88900a97/从功能正确性到代码可维护性，构建AI生成代码的多维评估体系https://guijiagi.com/posts/article-07/Sun, 12 Jul 2026 18:00:00 +0800https://guijiagi.com/posts/article-07/构建系统化的Agent可靠性评估框架，从任务完成率到错误恢复能力的全方位测评方法论https://guijiagi.com/posts/b2-68db480e/Sun, 12 Jul 2026 18:00:00 +0800https://guijiagi.com/posts/b2-68db480e/构建系统化的Agent可靠性评估框架，从任务完成率到错误恢复能力的全方位测评方法论https://guijiagi.com/posts/evaluation-data-curation/Thu, 02 Jul 2026 11:24:00 +0800https://guijiagi.com/posts/evaluation-data-curation/2026年LLM评估数据策划方法论，构建高质量、无偏见的评估数据集https://guijiagi.com/posts/ai-performance-monitoring/Thu, 02 Jul 2026 11:23:00 +0800https://guijiagi.com/posts/ai-performance-monitoring/2026年AI系统性能监控体系构建指南，覆盖延迟、质量、成本与安全监控https://guijiagi.com/posts/model-card-2026-template/Thu, 02 Jul 2026 11:22:00 +0800https://guijiagi.com/posts/model-card-2026-template/2026年模型卡（Model Card）最佳实践与模板，推动AI模型透明度与可问责性https://guijiagi.com/posts/ai-quality-assurance-2026/Thu, 02 Jul 2026 11:21:00 +0800https://guijiagi.com/posts/ai-quality-assurance-2026/2026年AI系统质量保证体系，覆盖测试、监控、治理与持续改进https://guijiagi.com/posts/llm-regression-testing/Thu, 02 Jul 2026 11:20:00 +0800https://guijiagi.com/posts/llm-regression-testing/2026年LLM回归测试策略与实践，防止模型更新和提示修改导致性能退化https://guijiagi.com/posts/a-b-testing-ai-system/Thu, 02 Jul 2026 11:19:00 +0800https://guijiagi.com/posts/a-b-testing-ai-system/2026年AI系统A/B测试方法论，科学比较不同模型和提示的效果https://guijiagi.com/posts/automated-testing-llm-2026/Thu, 02 Jul 2026 11:18:00 +0800https://guijiagi.com/posts/automated-testing-llm-2026/2026年LLM自动化测试技术全面指南，覆盖测试生成、执行与结果分析https://guijiagi.com/posts/human-evaluation-llm-guide/Thu, 02 Jul 2026 11:17:00 +0800https://guijiagi.com/posts/human-evaluation-llm-guide/2026年LLM人工评估方法论，涵盖评估者选择、标注规范与质量控制https://guijiagi.com/posts/agent-benchmark-design-2026/Thu, 02 Jul 2026 11:16:00 +0800https://guijiagi.com/posts/agent-benchmark-design-2026/2026年Agent能力评估基准设计方法，覆盖工具调用、规划与多步推理https://guijiagi.com/posts/llm-evaluation-framework-2026/Thu, 02 Jul 2026 11:15:00 +0800https://guijiagi.com/posts/llm-evaluation-framework-2026/2026年大语言模型评估框架全面解析，覆盖基准选择、指标设计与评估流程https://guijiagi.com/posts/ai-coding-assistant-comparison-2026/Tue, 30 Jun 2026 17:00:00 +0800https://guijiagi.com/posts/ai-coding-assistant-comparison-2026/2026年主流AI编程工具深度横评：Cursor、GitHub Copilot、Claude Code、Codeium在代码生成、调试、重构等场景的能力对比https://guijiagi.com/posts/agent-evaluation-benchmarks-2026/Tue, 30 Jun 2026 16:10:00 +0800https://guijiagi.com/posts/agent-evaluation-benchmarks-2026/2026年主流Agent评测基准深度解析：GAIA、SWE-bench、AgentBench、WebArena等评测体系的能力维度与局限性https://guijiagi.com/posts/llm-evaluation-methodology/Tue, 30 Jun 2026 12:05:00 +0800https://guijiagi.com/posts/llm-evaluation-methodology/系统介绍大模型评估方法论，从基准选择到实际测试的科学评测流程https://guijiagi.com/posts/chinese-llm-20-domain-test/Tue, 30 Jun 2026 11:15:00 +0800https://guijiagi.com/posts/chinese-llm-20-domain-test/覆盖20个专业领域的中文大模型能力深度实测与排名https://guijiagi.com/posts/rag-evaluation-framework-ragas/Tue, 30 Jun 2026 09:40:00 +0800https://guijiagi.com/posts/rag-evaluation-framework-ragas/系统介绍RAGAS评估框架的核心指标体系、自动化评估流程，以及如何构建自定义评估pipelinehttps://guijiagi.com/posts/ragas-evaluation-framework-guide/Tue, 30 Jun 2026 09:40:00 +0800https://guijiagi.com/posts/ragas-evaluation-framework-guide/系统介绍RAGAS评估框架的指标体系、实现方法，以及如何构建自定义RAG评估流水线https://guijiagi.com/posts/ai-translation-2026-comparison/Sun, 28 Jun 2026 12:10:00 +0800https://guijiagi.com/posts/ai-translation-2026-comparison/2026年AI翻译工具深度对比，涵盖DeepL、Google Translate与LLM在专业翻译场景的表现https://guijiagi.com/posts/ai-data-analysis-platforms-comparison/Sun, 28 Jun 2026 12:04:00 +0800https://guijiagi.com/posts/ai-data-analysis-platforms-comparison/2026年AI数据分析平台全面对比，涵盖ChatGPT ADA、Julius AI、Tableau AI等专业工具https://guijiagi.com/posts/ai-writing-assistants-2026-comparison/Sun, 28 Jun 2026 12:03:00 +0800https://guijiagi.com/posts/ai-writing-assistants-2026-comparison/2026年三大AI写作助手深度对比，涵盖语法纠错、风格改写、长文创作与协作场景https://guijiagi.com/posts/ai-search-engines-2026-comparison/Sun, 28 Jun 2026 12:02:00 +0800https://guijiagi.com/posts/ai-search-engines-2026-comparison/2026年三大AI搜索引擎深度对比，涵盖搜索质量、实时性、引用准确性与使用场景https://guijiagi.com/posts/agent-performance-benchmark-methodology-2026/Sun, 28 Jun 2026 11:25:00 +0800https://guijiagi.com/posts/agent-performance-benchmark-methodology-2026/构建Agent性能基准测试体系，涵盖延迟、吞吐量、成本、质量四维评估方法论https://guijiagi.com/posts/agent-ab-testing-platform/Sun, 28 Jun 2026 10:50:00 +0800https://guijiagi.com/posts/agent-ab-testing-platform/构建Agent A/B测试平台，涵盖实验设计、流量分配、统计检验与自动化决策https://guijiagi.com/posts/agent-evaluation-cicd-2026/Sun, 28 Jun 2026 10:15:00 +0800https://guijiagi.com/posts/agent-evaluation-cicd-2026/构建Agent CI/CD测试体系：从单元测试到端到端评估，实现LLM应用的自动化质量保障https://guijiagi.com/posts/rag-evaluation-framework-2026-ragas-custom-metrics/Sun, 28 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/rag-evaluation-framework-2026-ragas-custom-metrics/系统介绍 RAG 系统的评估方法论，涵盖 RAGAS 框架、自定义指标设计和端到端评测流水线https://guijiagi.com/posts/llm-evaluation-pipeline-benchmark-to-custom/Sun, 28 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/llm-evaluation-pipeline-benchmark-to-custom/系统讲解大模型评估流水线的搭建方法，涵盖主流 Benchmark 集成、自定义评测设计和自动化 CI/CDhttps://guijiagi.com/posts/agent-tool-calling-eval/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/agent-tool-calling-eval/Agent工具调用准确率测评https://guijiagi.com/posts/agent-tool-calling-accuracy-eval/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/agent-tool-calling-accuracy-eval/系统介绍AI Agent工具调用准确率的测评方法，涵盖指标设计、测试构建与评估框架https://guijiagi.com/posts/agent-capability-dimensions/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/agent-capability-dimensions/Agent能力评估维度体系https://guijiagi.com/posts/agent-memory-eval/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/agent-memory-eval/Agent长期记忆评估方案https://guijiagi.com/posts/llm-code-gen-eval/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/llm-code-gen-eval/LLM代码生成能力评测https://guijiagi.com/posts/llm-code-generation-evaluation/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/llm-code-generation-evaluation/深入解析大语言模型代码生成能力的评测方法论，涵盖主流基准与实战评估https://guijiagi.com/posts/llm-benchmark-credibility/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/llm-benchmark-credibility/LLM评测榜单可信度分析https://guijiagi.com/posts/rag-eval-metrics/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/rag-eval-metrics/RAG系统评估指标体系https://guijiagi.com/posts/llm-security-eval-framework/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/llm-security-eval-framework/大模型安全性测评框架https://guijiagi.com/posts/llm-inference-speed-benchmark/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/llm-inference-speed-benchmark/大模型推理速度评测标准https://guijiagi.com/posts/multimodal-eval-methodology/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/multimodal-eval-methodology/多模态模型评测方法论https://guijiagi.com/posts/agent-e2e-testing/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/agent-e2e-testing/智能体端到端测试方法https://guijiagi.com/posts/agent-end-to-end-testing-method/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/agent-end-to-end-testing-method/系统介绍AI Agent端到端测试方法论，涵盖场景设计、执行框架与评估指标https://guijiagi.com/posts/agent-multiturn-eval/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/agent-multiturn-eval/智能体多轮对话评估方法https://guijiagi.com/posts/agent-performance-benchmark/Sat, 27 Jun 2026 15:00:00 +0800https://guijiagi.com/posts/agent-performance-benchmark/智能体性能基准测试方法https://guijiagi.com/posts/agent-benchmark-2026/Fri, 26 Jun 2026 14:00:00 +0800https://guijiagi.com/posts/agent-benchmark-2026/全面对比 2026 年主流 AI 智能体基准测试框架，分析评估维度差异，探讨智能体评测的方法论与未来方向https://guijiagi.com/posts/llm-judge-evaluation/Fri, 26 Jun 2026 14:00:00 +0800https://guijiagi.com/posts/llm-judge-evaluation/系统介绍 LLM-as-Judge 评估方法的原理、实现与最佳实践，涵盖评分维度设计、Prompt 构建与结果分析https://guijiagi.com/posts/agent-a-b-testing-framework/Fri, 26 Jun 2026 14:00:00 +0800https://guijiagi.com/posts/agent-a-b-testing-framework/系统介绍 AI 智能体 A/B 测试框架的设计思路、核心组件、统计方法与工程实现，帮助团队科学评估智能体迭代效果。https://guijiagi.com/posts/agent-testing-strategies/Fri, 26 Jun 2026 14:00:00 +0800https://guijiagi.com/posts/agent-testing-strategies/系统介绍 AI Agent 测试的方法论、框架与最佳实践，覆盖单元测试、集成测试、E2E 测试和评估驱动开发全流程。https://guijiagi.com/posts/agent-eval-dataset-construction/Fri, 26 Jun 2026 14:00:00 +0800https://guijiagi.com/posts/agent-eval-dataset-construction/如何为 AGI 智能体构建科学、可复现的评估数据集？从任务设计到标注规范，从偏差控制到动态更新，一份完整的方法论指南。https://guijiagi.com/posts/agent-replay-testing/Thu, 25 Jun 2026 12:00:00 +0800https://guijiagi.com/posts/agent-replay-testing/系统介绍 Agent 回放测试方法，涵盖录制回放机制、确定性验证、状态快照对比与回归测试自动化框架。https://guijiagi.com/posts/agent-benchmark-suite/Thu, 25 Jun 2026 12:00:00 +0800https://guijiagi.com/posts/agent-benchmark-suite/深入对比三大 Agent 基准测试套件：SWE-bench、WebArena 和 GAIA，覆盖设计理念、任务类型、评估方法与适用场景。https://guijiagi.com/posts/user-satisfaction-metrics/Thu, 25 Jun 2026 12:00:00 +0800https://guijiagi.com/posts/user-satisfaction-metrics/构建 AI 产品用户满意度指标体系，涵盖 CSAT、NPS、CES 的 AI 适配，以及 AI 特有的满意度维度如信任度、可控性和透明度。https://guijiagi.com/posts/a-b-testing-for-llm/Thu, 25 Jun 2026 12:00:00 +0800https://guijiagi.com/posts/a-b-testing-for-llm/系统介绍 LLM 产品的 A/B 测试方法，涵盖实验设计、样本量计算、统计显著性检验、业务指标选择与常见陷阱。https://guijiagi.com/posts/llm-creative-eval/Thu, 25 Jun 2026 12:00:00 +0800https://guijiagi.com/posts/llm-creative-eval/系统介绍 LLM 创意写作能力评估方法，涵盖人工评分体系、自动化创意指标、LLM-as-Judge 方法及多维创意评估框架。https://guijiagi.com/posts/hallucination-measurement/Thu, 25 Jun 2026 12:00:00 +0800https://guijiagi.com/posts/hallucination-measurement/系统介绍 LLM 幻觉（Hallucination）的测量与检测方法，涵盖幻觉分类、人工标注体系、自动检测算法与评估框架。https://guijiagi.com/posts/llm-eval-pipeline/Thu, 25 Jun 2026 12:00:00 +0800https://guijiagi.com/posts/llm-eval-pipeline/系统讲解 LLM 评估流水线的完整构建方法，涵盖数据集构建、评估指标选择、自动化执行、结果分析与可视化报告生成。https://guijiagi.com/posts/multimodal-eval-method/Thu, 25 Jun 2026 12:00:00 +0800https://guijiagi.com/posts/multimodal-eval-method/系统介绍多模态大模型评估方法，涵盖视觉理解、跨模态推理、图文一致性、OCR、视频理解等核心维度的评估框架与实现。https://guijiagi.com/posts/llm-benchmark-2026-comprehensive/Thu, 25 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/llm-benchmark-2026-comprehensive/盘点 2026 年主流 LLM Benchmark 的有效性、数据污染问题与新趋势https://guijiagi.com/posts/agent-eval-framework/Thu, 25 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/agent-eval-framework/Agent 评估的完整框架：任务完成率、工具调用、规划质量与效率指标https://guijiagi.com/posts/llm-safety-eval-guide/Thu, 25 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/llm-safety-eval-guide/LLM 安全评估全维度指南：毒性检测、偏见评估、越狱攻击测试与对齐评测https://guijiagi.com/posts/human-eval-best-practices/Thu, 25 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/human-eval-best-practices/LLM 人工评估的全流程最佳实践：评估者招募、标注设计、一致性检验与统计分析https://guijiagi.com/posts/llm-latency-benchmark/Thu, 25 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/llm-latency-benchmark/LLM 推理性能关键指标、测试方法论与主流模型全景对比https://guijiagi.com/posts/llm-as-judge-guide/Thu, 25 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/llm-as-judge-guide/LLM-as-Judge 方法论的全面指南：Judge 选择、偏差控制、校准与 Multi-Judgehttps://guijiagi.com/posts/code-llm-eval/Thu, 25 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/code-llm-eval/代码 LLM 评估全景：从基础 HumanEval/MBPP 到工程级 SWE-Bench Prohttps://guijiagi.com/posts/multimodal-eval-2026/Thu, 25 Jun 2026 10:00:00 +0800https://guijiagi.com/posts/multimodal-eval-2026/2026 年多模态模型评估全景：视觉、音频、视频理解与跨模态推理https://guijiagi.com/posts/multimodal-eval-guide/Wed, 24 Jun 2026 16:00:00 +0800https://guijiagi.com/posts/multimodal-eval-guide/从感知到推理到生成，系统性评估视觉语言模型（VLM）的完整框架https://guijiagi.com/posts/agent-benchmark-methodology/Wed, 24 Jun 2026 14:00:00 +0800https://guijiagi.com/posts/agent-benchmark-methodology/系统讲解 Agent 基准测试的设计原则、测试集构建、评估指标体系及主流基准对比https://guijiagi.com/posts/eval-driven-development/Wed, 24 Jun 2026 14:00:00 +0800https://guijiagi.com/posts/eval-driven-development/介绍 EDD 核心理念、评估集先行、自动化评估流水线、A/B 测试与数据飞轮实践https://guijiagi.com/posts/human-eval-design/Wed, 24 Jun 2026 14:00:00 +0800https://guijiagi.com/posts/human-eval-design/探讨 LLM 人工评测的标注规范、一致性检验、成本控制及主流框架分析https://guijiagi.com/posts/llm-leaderboard-analysis/Wed, 24 Jun 2026 14:00:00 +0800https://guijiagi.com/posts/llm-leaderboard-analysis/对比 LMSYS、OpenCompass、HELM、SuperCLUE 等主流排行榜的机制差异，教你如何选择参考榜单https://guijiagi.com/posts/gaia-benchmark-analysis/Tue, 23 Jun 2026 14:50:00 +0800https://guijiagi.com/posts/gaia-benchmark-analysis/深入解读 GAIA Benchmark 的设计理念、评测维度和最新排行https://guijiagi.com/posts/agent-benchmark/Sat, 13 Jun 2026 12:00:00 +0800https://guijiagi.com/posts/agent-benchmark/聊天机器人有 MMLU，Agent 有什么？本文梳理 Agent 测评的方法论、主流 Benchmark 和实践建议。