高级检索

    面向科学实验操作指导的智能体检索增强生成

    Agentic RAG for Scientific Experiment Operation Assistance

    • 摘要: 科学实验操作辅助需要将规程知识与当前状态对齐,并提供可追溯的操作依据。针对文本检索难以组织程序性技能的问题,提出训练无关的智能体检索增强生成框架SciSkillRAG。离线构建科学技能图谱与事件中心技能卡,在线完成技能检索、约束验证和证据化回答。基于8897条真实标注记录构建8897张技能卡、19243个节点和21955条边。900条测评样本覆盖3个划分和5类任务,隔离测试记录及执行组,保留已知规程家族内的技能复用。宏任务得分为0.882,高于最佳外部基线KG2RAG的0.688;问题类别宏F1为0.911,证据F1为0.672。去除规划器、图路径或验证器后,得分分别降至0.837、0.838和0.662,表明结构化技能知识与智能体机制有助于实验操作的证据推理。

       

      Abstract: Scientific experiments are human-in-the-loop procedural knowledge work: users must follow protocols, manipulate tools and materials under safety constraints, and continuously align observations with step-level states. Existing laboratory assistants often rely on end-to-end vision-language inference or protocol-text retrieval, making operational skills difficult to reuse, audit, and transfer. SciSkillRAG is a training-free agentic retrieval-augmented generation (RAG) framework that constructs a scientific skill graph G and an event-centered skill-card library K from heterogeneous laboratory annotations, and retrieves, verifies, and composes evidence-grounded assistance from observations, standard operating procedure snippets, questions, and history. From 8897 real annotated records, the system builds 8897 skill cards and a graph with 19243 nodes and 21955 edges. The reconstructed 900-case Standard-900R benchmark comprises three splits and five tasks, excluding test sources and execution groups while retaining skill reuse within known SOP families. SciSkillRAG achieves a macro task score of 0.882, outperforming the strongest external baseline KG2RAG at 0.688, with an issue macro-F1 of 0.911 and an evidence F1 of 0.672. Removing the planner, graph path, or verifier reduces the macro score to 0.837, 0.838, and 0.662, respectively. These results demonstrate the role of structured skill knowledge in evidence-grounded assistance for scientific laboratory operations. Task answers, retrieved evidence, and graph relations are evaluated separately.

       

    /

    返回文章
    返回