公开论文雷达

公开 arXiv 研究简报 · 2026-08-04T01:06:59.857942+00:00

先看结论和关键数字,再决定要不要读原文。候选只在首次出现时展示;旧候选若后来通过深读门槛,仍会进入重点。

先看验证是否真测到缺陷,再信任何修复成功率

六张卡分两条线:修复/验证与智能体记忆。共同点是都不信任表面信号,各自搭受控测量。建议先读验证证据卡,它证明近半通过的测试没测到缺陷,会改变你读其余修复卡的方式;再看形式化验证的严格上限、上下文工程的增益;然后转入记忆线的投毒风险、回滚与去LLM化。

推荐阅读顺序

  1. 2607.28871:先建立怀疑:近半通过的验证在原缺陷代码上同样通过,测试通过不等于修好,读其余修复卡都要带这把尺
  2. 2607.28877:把验证做到极致:全输入空间的k-归纳证明,但六例只有ALU可靠,看清严格保证的天花板与代价
  3. 2607.29422:对照前两张看‘加对上下文’的收益:代码结构+运行时+提交历史三路注入,SEC-Bench成功率73%高基线29pp
  4. 2607.27080:转入记忆线:投毒能84.2%持久化、50.3%打通全链,且后端选型决定修复率(差41.3pp)
  5. 2607.27773:记忆坏了怎么回滚:ChronoMem给每次写入打全局快照,用自然语言指令语义回退到历史版本
  6. 2607.29377:最后看成本优化:把记忆构建/路由/检索全移出LLM,只留最终问答,记忆操作耗时降57.6%
共性方法
六项都不把智能体的‘成功’当结果,而是搭一套受控协议去追问它是否真成立:三态重放、七检查点、k-归纳证明、后暴露反事实、消融逐项拆解。无论修复还是记忆,作者都在原始/候选/金标或写入/触发/修复的对照中量化端到端行为,而非只数表面通过。
关键分歧
分歧在立场:一派靠加结构提升成功——形式化流水线、三路上下文注入、记忆版本回滚、去LLM化提速;另一派专测幻觉与风险——近半通过验证没测到缺陷、记忆投毒84.2%持久化。前者答‘怎么做得更好’,后者答‘你看到的成功有多少是真的’。
选择准则
评修复或记忆智能体时,先做一次对照审计——把补丁在原缺陷代码上重放、把恶意记忆按写入到触发验一遍——再信成功率;要严格数学保证只在结构简单的单模块上用形式化,复杂设计别指望。

重点深读(6 / 6 篇)

形式化与程序验证(1 篇)

形式化与程序验证 8/30

Open-Source LLM-Driven Formal Verification: A Multi-Agent Pipeline for RTL Repair

开源工具链能让LLM修复RTL并拿到形式化证明,但目前只在简单单模块上可靠:如果你用LLM修RTL,又只靠仿真确认,那你修的代码只在一部分输入上验证过,全输入空间的正确性没有保证,商业形式化工具又贵又受许可限制。这项工作把LLM接进纯开源工具链(Yosys/SymbiYosys/Z3),用反例引导的多智能体循环修到k-归纳证明通过为止。结果要冷静看:六个基准里只有ALU一例被可靠修复并拿到证明,其余五例暴露出四类结构性失败。

两句看懂

既有LLM辅助RTL修复靠仿真或商业工具验证,无法保证全输入空间正确性;本工作把LLM与开源Yosys/SymbiYosys/Z3结合,构建反例引导的多智能体流水线,用k-归纳给出数学证明。六个基准中ALU一例可靠修复并获证明,其余五例暴露有界覆盖空洞等四类结构性失败模式。

核心判断

开源工具链可使LLM驱动的RTL修复达到k-归纳形式化证明,但当前可靠适用范围仅限结构简单的单模块设计:ALU案例验证可行性,四类失败模式划定边界。

关键要点

1. 旧假设失效:LLM修RTL后用仿真验证只覆盖部分输入空间,给不出全状态正确性保证,商业形式化工具又贵又受许可限制。 2. 方法与受控检验:六个智能体组成流水线,类型化IR把LLM的属性推理与SVA语法生成分开,CEX以VCD波形定位故障信号,用六基准加多轮运行协议检验。 3. 决定性结果与行动:仅ALU一例可靠修复并获k-归纳证明,五例落入四类失败;在结构简单、规约精确的单模块上先部署,复杂设计先别指望。

证据与结果

六基准套件含ALU案例研究,采用多轮运行协议。ALU可靠修复并获k-归纳证明。四类失败模式:①有界覆盖空洞——BMC在预设k步内没找到反例,但证不了更深行为,造成假通过;②规约歧义——自然语言描述不精确,Architect生成错误属性;③时序逻辑缺陷——LLM生成的SVA时序逻辑有误,验证不收敛;④多属性压力——多个属性同时约束,超出Coder修复能力。

打开论文原文
它要解决什么
纯开源工具链能否让LLM驱动的RTL修复达到全输入空间的数学正确性保证?当方法失败时,结构性原因有哪些?
研究路径
闭环这样转:Contract从规约提取RTL接口;Architect输出类型化属性IR,专用编译器转成SVA并内联,保证语法正确;SymbiYosys+Z3先跑BMC找有界反例,再跑k-归纳求证明;验证失败时CEX Analyzer解析VCD波形,把具体故障信号结构化地交回,Coder据此修复,Reviewer审查后重入循环;k-归纳通过即终止并输出正确性证明。整个链路只用开源工具,结果可完全复现。
这对工程意味着什么
第一步行动:挑一个结构简单、规约写得精确的单模块RTL,部署这条流水线跑通k-归纳,先验证可行性再谈推广。要避免的捷径:把仿真通过当成形式化证明——两者覆盖的输入空间范围有本质差异,仿真过了不代表设计对了。
证据定位
ALU案例经多轮运行被可靠修复,并获得k-归纳证明,覆盖全部可达输入状态。六个基准中只有这一例可靠成功。其余五例落入四类失败模式:有界覆盖空洞、规约歧义、时序逻辑缺陷、多属性压力。另记录了Yosys bind指令在属性内联时的实际工程限制。(筛选维度:形式化验证、可复核评测)
适用边界
只有六个基准,样本量小,结论泛化性有限。ALU是单一模块,复杂多模块设计未评测。失败模式是定性归纳,没有跨基准的定量成功率数据。自然语言规约精度对结果的影响未受控。
方法与英文摘要

输入是自然语言规约和含缺陷的RTL模块。Contract智能体提取接口,Architect生成类型化属性IR,专用编译器把IR转成SVA并内联进设计。Verifier调SymbiYosys+Z3跑BMC和k-归纳:通过就终止并输出证明;失败则由CEX Analyzer解析VCD波形定位故障信号,Coder生成修复,Reviewer审查后重入循环,直到k-归纳通过或迭代预算耗尽。评测用六个基准(含ALU案例),采用多轮运行协议。

Verification consumes the majority of modern chip design effort, yet the formal verification tools that provide mathematical guarantees of correctness remain expensive and restrictively licensed. While large language models (LLMs) have shown promise for hardware design, existing approaches to RTL repair validate their results through simulation - which exercises only a subset of inputs - or rely on commercial tools, and few combine formal proof with an entirely open-source toolchain. In this paper, we present a multi-agent pipeline that couples an LLM with an open-source formal backend (Yosys, SymbiYosys, and Z3) to repair RTL through counterexample-guided iteration: the framework generates formal properties, verifies the design, and feeds counterexamples back to the LLM until the design is proved correct by k-induction or an iteration budget is exhausted. Through an ALU case study, we show that the pipeline can detect and repair a real functional bug with a formal proof of correctness. Across a six-benchmark suite, one design is repaired reliably, and we characterize four distinct failure modes: bounded-cover vacuity, specification ambiguity, temporal-logic bugs, and multi-property pressure. We frame this work as a feasibility study with a detailed failure analysis, and additionally report a practical limitation of the Yosys bind directive relevant to the open-source formal verification community.

软件工程与仓库智能(2 篇)

软件工程与仓库智能 6/30

AgenticRepair: Multi-Faceted Program Context Engineering for Agentic Vulnerability Repair

给修复智能体补齐代码结构、运行时和提交历史上下文,漏洞补丁成功率才上得去:安全工程师在乎的是补丁能不能过消毒器;漏洞披露到修复中位超过70天,通用智能体只靠文件导航和编译器反馈往往修不动。AgenticRepair 把代码结构、运行时崩溃、提交历史三类安全上下文分别工程化后注入修复记忆,在 SEC-Bench 300 个实例上达到 73% 成功率,比最强基线高 29 个百分点。

两句看懂

现有智能体修复框架为通用程序修复设计,只有文件导航、代码检索和编译器测试反馈,缺跨文件数据流、运行时崩溃语义和提交历史,漏洞从披露到修复中位超过70天。AgenticRepair 用三个子智能体分别工程化这三类上下文并注入修复记忆,在 SEC-Bench 300 个实例上经 Docker 隔离和消毒器验证拿到 73% 成功率,比最强基线高 29 个百分点。

核心判断

把代码结构、运行时执行、提交历史三类上下文系统工程化并注入修复智能体,能决定漏洞修复成败;SEC-Bench 300 例中成功率 73%,超最强基线 29 个百分点,消融显示三类上下文缺一不可。

关键要点

1. 旧假设失效:通用修复只给文件导航和编译器反馈,缺结构、运行时、历史上下文,披露到修复中位超70天。 2. 方法与对照:三个子智能体分别做代码结构、运行时、提交历史上下文;SEC-Bench 300 例独立 Docker 加 ASan/MSan/UBSan 验证,消融逐一删上下文。 3. 结果与动作:成功率 73%,高最强基线 29 个百分点;删任一类上下文都下降,应把三类上下文工程列为修复智能体必备阶段。

证据与结果

评测固定为 SEC-Bench 300 个真实漏洞实例,每例独立 Docker 环境,补丁必须通过 ASan/MSan/UBSan 才算成功。对比多个基线后成功率 73%,高最强基线 29 个百分点;消融移除代码结构、运行时或提交历史任一类,成功率均下降。早期细调小模型受上下文窗口限制处理不了跨文件漏洞;无上下文工程的智能体因缺安全专属信息修复失败。

打开论文原文
它要解决什么
老问题是:智能体会找文件、会看编译报错,但没有机制组装跨文件数据流、内存操作模式、崩溃语义和漏洞引入历史;真正要问的是,怎样把这三类安全上下文做成可注入修复流程的工程件?
研究路径
代码结构子智能体先扫仓库文件夹,抽出跨文件数据流和内存操作模式;运行时子智能体执行消毒器,读崩溃语义与内存起源;提交历史子智能体检索版本历史,找易碎代码模式何时引入。修复子智能体拿到这三类上下文后合成补丁,再由 ASan/MSan/UBSan 在独立 Docker 中确认漏洞完全消除后才提交。
这对工程意味着什么
第一步:在现有修复智能体里显式加三个上下文阶段——代码结构、运行时崩溃、提交历史,并用独立 Docker 加 ASan/MSan/UBSan 做门槛。要避开的捷径:不要把通用程序修复框架的文件导航加编译器反馈直接当成安全修复方案,供应证据显示它会缺关键上下文并导致修复失败。
证据定位
SEC-Bench 300 个真实漏洞实例上,成功率为 73%,比最强基线高 29 个百分点;消融逐一移除代码结构、运行时或提交历史上下文,成功率都会下降,说明三类上下文互补且各自必要。多智能体脚手架和基础模型能力也都独立影响性能,缺一会掉成功率。(筛选维度:可复核评测、软件工程方法)
适用边界
证据只覆盖 SEC-Bench 中 300 个可被消毒器检测的内存安全类漏洞;逻辑漏洞、注入类漏洞等其他类型是否受益,以及提交历史上下文对历史较浅仓库是否适用,供应文本没有给出证据。
方法与英文摘要

输入只有漏洞描述和消毒器报告。系统拆成三个专职子智能体:一个扫仓库,提取跨文件数据流与内存操作模式;一个跑消毒器,解析崩溃语义与内存起源;一个查提交历史,定位易碎模式的引入路径。三类上下文写入修复子智能体记忆后再合成补丁;每个实例放在独立 Docker 环境,用 ASan/MSan/UBSan 验证漏洞是否完全消除。

Automated vulnerability repair aims to reduce the time and effort required to patch security flaws from a vulnerability triage report. Recent agentic AI approaches have shown promising results in automated program repair. However, vulnerability repair demands richer program context than general bug repair - context that security engineers routinely assemble in practice but that existing agentic approaches do not engineer. We identify three critical gaps: code-structure context capturing cross-file data flows and memory operation patterns, runtime-execution context revealing crash semantics and memory origins, and commit-history context recovering how fragile code patterns were introduced. We present AgenticRepair, an agentic vulnerability repair framework that addresses the gaps through multi-faceted program context engineering. AgenticRepair orchestrates three specialized LLM subagents to engineer the contexts, which are then embedded into the memory of a dedicated repair subagent for context-conditioned patch synthesis. Evaluated on SEC-Bench comprising 300 real-world instances with sanitizer-based patch verification, AgenticRepair achieves a 73% success rate, substantially outperforming the strongest baseline by 29%. Our ablation study confirms that the three context facets are mutually complementary, and that multi-agent scaffolding and base-model capacity each play an essential role. Collectively, these findings establish multi-faceted program context engineering as a promising design direction for agentic vulnerability repair.

软件工程与仓库智能 4/30

Validation Evidence in LLM Repair Agents: How Much of What Passes Actually Tests the Bug?

修复智能体近半数通过的验证其实没测到缺陷本身:如果你靠测试通过数量评估修复智能体,这个数字会系统性高估它,因为通过的测试在原始缺陷代码上可能同样通过。研究者用 BSG-VA 测量后发现:2548个正向事件中46.0%不含缺陷判别信息。

两句看懂

修复智能体把测试通过当成缺陷修复的证据,但通过的测试可能在原始缺陷代码上同样通过,所以通过率会高估真实验证。对110任务643次运行3730个事件的测量显示,46.0%正向事件不含缺陷判别信息;回注B重放结果可把证据不足关闭率降低7.8pp(p=0.0029),但低于预设10pp阈值,实际收益不确定。

核心判断

修复智能体接近半数(46.0%)正向验证事件不含缺陷判别信息。回注B重放结果能统计显著但幅度有限地改善此状况(关闭率降低7.8pp,p=0.0029),效应量低于10pp预设阈值,实际意义仍不确定。

关键要点

1. 旧盲区:此前只把智能体生成的测试当独立制品评估,没测过验证事件对缺陷的判别能力,而通过的测试可能在原始缺陷代码上同样通过。 2. 方法与对照:BSG-VA 在 B/S/G 三态重放每条验证命令并分七类角色,三臂实验用结构匹配的提醒臂隔离内容效应,预设10pp为最小关注效应量。 3. 结果与行动:46.0%正向事件无判别信息,回注B重放只降7.8pp(p=0.0029)低于阈值,工程上应先做后置B重放审计,而不是指望注入干预带来稳定收益。

证据与结果

数据集为 SWE-bench Verified 与 SWE-rebench 各55任务,共110任务,实验模型单一。643次运行、3730个后编辑事件(排除首次生产编辑前事件),其中2548个正向可比事件。三臂实验对比 BCF、提醒臂、基线臂。BCF vs 提醒臂:证据不足关闭率降低7.8pp(p=0.0029),判别证据提升7.4pp(p=0.011),修复成功率无可检测差异,两项均低于10pp阈值。换模型、换脚手架的探索性复现中,B重放内容增量仅在非约束工具循环下可检测。

打开论文原文
它要解决什么
修复智能体运行测试并看到通过时,这个结果多大概率真正针对所报告的缺陷,而非仅确认无回归?
研究路径
智能体执行验证命令时,BSG-VA 做四步:①快照当前工作树;②提取测试专用补丁,剔除并发生产编辑;③在 B、S、G 三态执行同一命令;④按三态结果组合分入七类证据角色,例如 B失败-S通过-G通过 为金标对齐判别,B通过-S通过 为仅回归验证。中位重放开销11秒/运行。
这对工程意味着什么
第一步行动:在你的修复评估流程里加一步原始缺陷代码重放,量化验证事件的缺陷判别比例,而不是只统计测试通过数量。要避免的捷径:只看通过数量,因为通过的测试可能在原始缺陷代码上同样通过,会系统性高估智能体对缺陷的真实验证。
证据定位
2548个正向可比事件中46.0%不含缺陷判别信息;23.8%基线运行以全无判别性证据关闭。BCF相对提醒臂把证据不足关闭率降低7.8pp(p=0.0029),判别证据提升7.4pp(p=0.011),修复成功率无可检测损失;两项均低于预设的10pp阈值,约1/3增益来自提醒本身。(筛选维度:软件工程方法)
适用边界
只测了两个缺陷修复基准各55任务(共110)和单一实验模型;B重放内容效应在换模型、换脚手架的探索性复现中无法稳定复现,泛化性受限;10pp最小关注效应量是预设值,其工程合理性未经独立验证。
方法与英文摘要

BSG-VA 拦截智能体每次验证命令,快照工作树,提取测试专用补丁并排除并发生产编辑,然后在三个状态重放同一命令:B(原始缺陷代码)、S(候选状态)、G(金标修复)。按三态结果组合把事件分入七类证据角色。数据来自两个缺陷修复基准各55任务共110任务,643次运行、3730个后编辑事件。另设三臂实验:BCF臂(向智能体注入B重放结果)、提醒臂(结构匹配但无B内容)、基线臂(不注入),预设10pp为最小关注效应量。

When a repair agent runs a test and sees it pass, the result is treated as evidence about the reported defect. We measure how often that treatment is warranted. BSG-VA (buggy-state/candidate-state/gold-fix validation analysis) captures each validation command at its exact working-tree state, extracts a test-only patch, and replays the command on the original buggy code (B), the candidate state (S), and the developer gold fix (G). The captured outcome and the replay results assign every event an evidence role, from gold-aligned bug-discriminating through regression-only to misleading. Across 3,730 events in 643 rollouts on 110 tasks, 46.0% of positive comparable events carry no bug-discriminating information; 23.8% of baseline rollouts, with no feedback injected, close with a patch whose entire positive evidence base is of this kind. A three-arm experiment tests whether returning the B-replay outcome to the agent changes this pattern. Bug-contrast feedback reduces evidence-inadequate closure by 7.8 percentage points relative to an attention-matched reminder (p = 0.0029) and raises bug-discriminating evidence by 7.4 points (p = 0.011), with no detectable cost to repair success. Both estimates fall below the prespecified 10-percentage-point smallest effect size of interest, so practical magnitude remains uncertain. Roughly a third of the improvement traces to the reminder alone; across two exploratory replications, varying the scaffold and the model, the B-replay content adds a detectable increment only with gpt-5.6-sol under the unconstrained tool-use loop. BSG-VA applies post hoc to any replayable repair trajectory that preserves the required code states and execution environment. Keywords: program repair agents, validation evidence, test adequacy, large language models, software quality, controlled experiment.

代码质量与优化(0 篇)

本轮没有通过深读证据门的重点论文。

UI 与 GUI Agent(0 篇)

本轮没有通过深读证据门的重点论文。

个人知识与本体(3 篇)

个人知识与本体 7/30

Zero-Mem: Zero-Token Memory Operations for LLM Agents

记忆管理不必调用LLM:Zero-Mem把LLM留到最后问答:如果长交互智能体慢在记忆构建、路由和检索,而不是慢在最终回答,这篇工作直接对应你的瓶颈:它把记忆操作全部移出LLM,只保留最终QA读取器一次调用;在相同QA读取器与上下文预算下,记忆操作耗时比最快基线减少57.6%,问答性能维持竞争力。

两句看懂

现有记忆系统在构建、更新和检索路由中持续调用LLM,带来token与时间开销,生成式抽象还可能合并主体或模糊时序更新。该方案用实体-上下文图、时序层级和确定性校准替代这些生成式操作,仅最终QA调用LLM;在相同读取器与上下文预算下,记忆操作耗时比最快基线减少57.6%,QA性能维持竞争力。

核心判断

结构化记忆不需要在最终问答之外生成中间表示;用确定性实体图与时序层级替代生成式记忆操作后,记忆操作耗时比最快基线减少57.6%,QA基准性能维持竞争力。

关键要点

1. 旧问题:生成式记忆在构建、更新、路由中反复调LLM,平坦稠密检索又难处理跨交互证据。 2. 方法:原始轨迹保留,编码器建实体-上下文图与时序层级,确定性校准删冲突证据;对照检查固定QA读取器与上下文预算。 3. 结果与动作:QA维持竞争力,记忆操作耗时降57.6%;把LLM从记忆管理层撤到最终问答。

证据与结果

基准包含长记忆问答和长上下文问答两类任务;公开摘录未给具体数据集名称与规模。对比对象包括记忆操作中使用LLM的已发表方案,覆盖生成式压缩类与小模型替代类。控制变量是相同最终QA读取器与上下文预算。指标为问答性能(竞争力水平)和记忆操作耗时(比最快基线减少57.6%)。消融验证三个模块:实体-上下文图、时序层级、查询依赖协调。分项基准数值和编码器开销占比未在摘录中量化。

打开论文原文
它要解决什么
能否把记忆构建、路由、检索、证据校准全部做成非LLM流程,只让最终问答调用LLM,同时不输给生成式记忆系统?
研究路径
写入时,编码器并行建立实体-上下文图和时序层级:前者存跨交互实体关系,后者存会话局部性与状态,全程无LLM。查询时先算查询对两视图的权重,再分别从图和层级取候选,沿实体关系追支撑链,或沿时序结构找回上下文。校准阶段用确定性规则丢弃冲突证据,把筛后的轨迹片段交给唯一LLM组件,即最终QA读取器。
这对工程意味着什么
先检查记忆构建与检索阶段是否还有可删除的LLM调用,若有,用实体图+时序层级+确定性校准替换。不要用平坦稠密检索直接顶替生成式记忆;跨交互分布证据时它容易漏掉关键轨迹。
证据定位
评测覆盖长记忆问答与长上下文问答基准;控制条件是相同最终QA读取器与上下文预算。结果:问答性能维持竞争力,记忆操作耗时比最快对比基线降低57.6%。消融分别确认实体-上下文图、时序层级、查询依赖协调机制有独立贡献。(筛选维度:置信度与不确定性、可复核评测)
适用边界
公开摘录未披露具体数据集名称与规模,也未量化编码器计算开销占总时间比重。确定性校准在高度模糊实体或无结构化交互场景下的边界未见讨论。长上下文QA与长记忆QA的分项数值未在摘录中给出。
方法与英文摘要

写入阶段保留原始交互轨迹,用编码器零LLM构建两个索引:实体-上下文图负责跨交互实体关系,时序层级负责会话局部性与状态。查询时按权重分别从两视图检索,沿图追溯支撑链或沿时序恢复上下文;随后用确定性校准丢弃冲突证据;只有最终QA读取器调用LLM。编码器计算开销单独计入。

LLM agents need memory to act consistently over long interactions, yet many systems use additional LLM calls to operate that memory. Generating intermediate records and mediating their retrieval adds recurring token and time costs, while omitted or merged details can obscure the original evidence. We ask whether structured memory access requires generation at all. Zero-Mem introduces \emph{zero-token memory operations}: no step outside final question answering invokes an LLM or consumes LLM input or output tokens; encoder computation is accounted for separately. Zero-Mem preserves original interaction traces as its source of record. It organizes the traces in two complementary ways. An entity--context graph exposes connections across interactions, while a temporal hierarchy preserves conversational locality and session state. For each query, Zero-Mem weighs the two views, retrieves from both, and follows their structure to recover supporting relations or surrounding context. Deterministic calibration first discards conflicting evidence and then keeps the reader's answer grounded in the retrieved traces. Only the final-QA reader invokes an LLM. Across long-memory and long-context question-answering benchmarks, Zero-Mem achieves competitive performance while eliminating LLM calls and LLM-token consumption from memory operations. With the same final-QA reader and context budget, it reduces memory-operation time cost by 57.6\% relative to the fastest compared baseline. Ablations support the contribution of the two views and their query-dependent coordination. Overall, the results show that structured agent memory need not generate an intermediate representation of the past. After peer review, the code and implementation details will be available at \textcolor{blue}{https://github.com/TheMoon0815/Zero-mem}.

个人知识与本体 5/30

ChronoMem: Version Control and Semantic Rollback for Large Language Model Agent Memory

ChronoMem:LLM智能体记忆的语义版本回滚:现有LLM智能体记忆只能单向累积,无法版本化或回滚。ChronoMem在每次写入时提交全局快照,通过混合词法-语义检索将自然语言撤销指令映射至历史版本,并引入后暴露评测协议验证反事实行为,在长程对话基准上显著优于提示和检索基线。

两句看懂

现有LLM智能体记忆系统仅支持单向累积和覆写,一旦写入错误信息或遭到污染便难以恢复;ChronoMem在每次写入时提交全局快照,并用混合检索将自然语言撤销指令映射至历史版本实现语义回滚。通过后暴露评测协议(要求智能体在已接触后续更新后仍反事实作答),ChronoMem在长程对话基准的回滚一致性问答和历史摘要任务上均显著优于仅提示和仅检索基线。

核心判断

为LLM智能体记忆增加语义版本控制层可实现自然语言驱动的全局回滚,使智能体在后暴露场景下仍能反事实作答;证据来自长程对话基准的回滚一致性问答和历史摘要任务,相比提示和检索基线均显著提升。

关键要点

1. 评测缺口:现有LLM智能体记忆系统将存储视为仅追加或仅覆写,缺乏版本化机制;已有托管服务虽开放逐条历史API,但依赖不透明版本标识符,不评测全局状态一致性;现有长程记忆基准仅测正向演化的检索与遗忘,不测后暴露场景下的反事实回滚行为。 2. 构建方案:ChronoMem在每次记忆写入时提交全局快照,维护结构化版本历史;回滚时以混合词法-语义检索、排名融合与重排序将自然语言意图映射至目标版本;评测采用后暴露协议,以仅提示基线和仅检索基线为对照,任务覆盖回滚一致性问答、历史摘要、语义版本选择三类。 3. 结果与边界:ChronoMem在回滚一致性问答和历史摘要任务上显著优于两类基线,语义版本选择取得强劲效果;公开摘录未披露具体数值;外部工具调用产生的副作用(远端存储修改、工具引发的人工制品)能否随全局快照完整还原,为论文已识别的开放边界。

证据与结果

评测数据集为长程对话基准(公开摘录未披露名称及具体规模),注入演化记忆状态和回滚任务后使用;评测包含三类任务:语义版本选择(将自然语言撤销意图映射至正确历史版本)、回滚后问答(反事实一致性)、回滚后历史摘要;协议为后暴露模式,要求智能体在已接触后续更新后仍正确作答;对照基线为仅提示基线和仅检索基线;ChronoMem在回滚一致性问答和历史摘要上均显著优于两类基线,语义版本选择亦取得强劲效果;具体数值指标在公开摘录中未完整披露。

打开论文原文
它要解决什么
当LLM智能体记忆因错误更新或概念漂移而损坏时,如何通过自然语言指令将全局记忆语义回滚至时间一致的历史状态?
研究路径
ChronoMem在每次记忆写入时生成全局快照并附带时间戳提交至版本历史。收到自然语言回滚请求时,系统对撤销意图执行混合词法-语义检索,经排名融合与重排序定位目标历史版本,再将当前记忆状态整体替换为该版本快照,恢复全局一致状态。整个流程集成于生产级开源智能体框架,无需用户提供内部版本标识符。
这对工程意味着什么
为外部化文本记忆的智能体添加全局快照版本控制层,并以后暴露协议验证回滚效果;仅用提示注入模拟回滚会因智能体已内化后续信息而失效,应避免此捷径。
证据定位
ChronoMem在长程对话基准上,回滚一致性问答和历史摘要任务均显著优于仅提示基线和仅检索基线;语义版本选择亦取得强劲效果;公开摘录未披露具体评测数值。(筛选维度:可复核评测)
适用边界
公开摘录未披露基准名称、规模、具体评测指标及数值;外部工具调用副作用(远端存储修改、工具引发人工制品)能否随全局快照完整还原为已识别开放边界;摘录未涉及非英文场景或跨模态记忆的泛化性。
方法与英文摘要

ChronoMem集成于一款生产级开源智能体框架。每次记忆写入触发全局快照提交,形成带时间戳的版本历史。自然语言回滚请求经混合词法-语义检索、排名融合与重排序映射至目标历史版本,将当前记忆替换为该快照。评测数据集为长程对话基准,注入演化记忆状态和回滚任务;采用后暴露协议,在智能体已接触后续更新后测试回滚一致性问答、历史摘要及语义版本选择,与仅提示和仅检索基线对比。

LLM agents increasingly rely on long-term memory to support multi-session interaction and personalization. However, existing agent memory systems are designed around forward-only evolution, continuously accumulating, consolidating, and overwriting knowledge, with no principled mechanism to inspect, version, or revert prior states. This makes agents brittle under corrections, concept drift, and memory corruption, particularly after they have already been exposed to subsequent information. We present ChronoMem, a semantic version-control layer for agentic memory integrated into the production-ready, open-source Agent Development Kit by Google. ChronoMem commits whole-memory snapshots at each memory write, maintains structured version histories, and supports natural-language rollback requests by mapping undo intents to concrete historical versions through hybrid lexical and semantic retrieval, rank fusion, and reranking. We further introduce a post-exposure evaluation protocol that tests whether an agent can behave counterfactually after rollback by answering queries and summarizing history as if future updates had never occurred. On long-horizon conversational benchmarks augmented with evolving memory states and rollback tasks, ChronoMem substantially improves rollback-consistent question answering and history summarization relative to prompt-only and retrieval-only baselines, while achieving strong performance in semantic version selection. To our knowledge, ChronoMem is the first open-source system and benchmark for systematic semantic global memory rollback in LLM agents.

个人知识与本体 4/30

MemSecBench: Tracking Agent Memory Poisoning from Persistence to Consequence and Repair

智能体记忆投毒全链路追踪基准评测:MemSecBench用Write-Execute-Forget协议追踪310个案例的恶意记忆从写入到触发再到修复的全生命周期,在24种配置下发现持久化率84.2%、端到端攻击成功率50.3%,不同记忆后端的修复能力差距达41.3个百分点。

两句看懂

现有记忆安全基准不跨越写入、触发、修复三个阶段,MemSecBench引入七检查点Write-Execute-Forget协议将全链路纳入受控评测。在2×4×3共24种配置下运行310个案例,恶意记忆持久化率84.2%,端到端攻击成功50.3%,记忆后端修复率差距高达41.3个百分点。

核心判断

在84.2%的案例中恶意指令成功持久化于智能体记忆,端到端攻击成功率50.3%;记忆后端选择显著影响攻击成功率(最大差16.1pp)和修复能力(最大差41.3pp),24配置对比提供量化依据。

关键要点

1. 现有记忆安全基准各自测量生命周期的某一阶段,均不同时满足写入持久化、下游外部后果、完整语义链路、选择性修复、跨后端对比五个维度,导致同一恶意语义的端到端传播风险无法在受控条件下被量化评估。 2. MemSecBench为310个案例(代码与科学、日常生活、办公室工作三类48个场景)定义目标恶意语义与良性记忆保留集合,在隔离运行时按2智能体框架×4记忆后端×3 LLM后端共24种配置执行Write-Execute-Forget协议,通过确定性写入检查和七个检查点的裁判模型评分进行证据驱动判定。 3. 24种配置下恶意记忆持久化率84.2%,Write-Execute全链路成功率50.3%;已中毒案例中59.6%触发完整Execute链;与Native配置对比,端到端攻击成功率最大差16.1pp,选择性修复率最大差41.3pp,表明记忆后端选择是安全性的关键变量而非中性实现细节。

证据与结果

数据集:310个案例,来自48个预设场景,涵盖代码与科学、日常生活、办公室工作三类。实验矩阵:2个智能体框架×4个记忆后端(含原生文件系统及外部记忆服务)×3个LLM后端,共24种配置。评测维度:IW写入持久化、DC下游外部后果、ST完整语义链路、SR选择性修复、MMI跨后端对比。主要数值:持久化率84.2%;Write-Execute全链路成功率50.3%;已中毒案例中59.6%完成完整Execute链,56.1%实现选择性修复;与Native配置对比,攻击成功率最大差16.1pp,修复率最大差41.3pp。

打开论文原文
它要解决什么
当恶意指令经由普通任务写入智能体长期记忆后,它在多大比例的案例中能持久化、触发下游外部动作,以及事后能否被选择性清除而不损坏良性记忆?
研究路径
攻击者将恶意指令嵌入普通任务输入,记忆系统将其存储为长期记录;时序元数据丢失是关键机制——临时指令因未记录失效日期变为持久规则;后续会话检索时指令被激活并触发外部动作;七检查点框架将写入、检索、触发、修复逐一量化,判定结合确定性门控与裁判模型评分。
这对工程意味着什么
选择智能体记忆后端时,应对比Write-Execute攻击成功率和选择性修复率;需避免的误区是将LLM能力等同于记忆安全性——实验显示后端架构差异(修复率最大差41.3pp)是更关键的变量。
证据定位
24种配置下恶意记忆持久化率84.2%,Write-Execute全链路成功率50.3%;已中毒案例中59.6%完成完整Execute链,56.1%实现选择性修复;与Native配置对比,攻击成功率最大差16.1pp,修复率最大差41.3pp。(筛选维度:可复核评测)
适用边界
310个案例由研究团队构造,可能未覆盖真实攻击的全部变体;实验仅覆盖两个智能体框架,推广至其他框架需独立验证;裁判模型的判定准确性未经独立校验,可能影响选择性修复率指标的可靠性。
方法与英文摘要

数据集:310个案例,来自48个真实场景(代码与科学、日常生活、办公室工作三类)。每个案例定义目标恶意语义与需保留的良性记忆集合,在隔离运行时执行Write-Execute-Forget三段协议,配置精确指定智能体框架、记忆后端和LLM后端三个变量。判定:确定性写入检查+七个生命周期检查点的裁判模型评分+程序化门控。实验矩阵:2智能体框架×4记忆后端×3 LLM后端,共24种配置。

Memory systems allow agents to retain and reuse information from past interactions, but they can also let malicious content persist. A malicious instruction crafted by an attacker may be stored in long-term memory, recalled much later, and quietly shape a real action. Recent benchmarks increasingly examine agent memory security, yet few trace the same malicious semantics across persistence, downstream consequences, and selective repair under diverse memory-backend comparisons. To address this gap, we introduce MemSecBench, a task-grounded benchmark for the lifecycle security of agent memory systems. It contains 310 cases drawn from 48 realistic contexts across code and science, daily life, and office work. Each case follows a controlled Write--Execute--Forget protocol in an isolated runtime under an exact agent configuration, defined by an agent harness, a memory backend, and an LLM backend. Evidence-based adjudication combines a deterministic write check, checkpoint-specific judge-model evaluations, and programmatic gates across seven lifecycle checkpoints. The experimental design spans a 24-configuration matrix of two agent harnesses, four memory backends, and three LLM backends. Across all 24 configurations, malicious memory persists in 84.2% of all cases, and the full Write--Execute chain succeeds in 50.3%. Among successfully poisoned cases, 59.6% complete the full Execute chain, while 56.1% achieve selective repair.Compared with matched Native configurations, the largest absolute differences are 16.1 percentage points for end-to-end attack success and 41.3 percentage points for selective repair. These descriptive contrasts indicate that the evaluated memory system stacks differ in lifecycle security, both in the propagation of malicious memory and in selective repair after successful memory poisoning.

人机协同与对齐(0 篇)

本轮没有通过深读证据门的重点论文。

本轮分类概览

同一论文只归入一个最先命中的赛道,避免重复计数;“新增候选”只统计首次展示的论文。

赛道新增候选重点
形式化与程序验证21
软件工程与仓库智能22
代码质量与优化00
UI 与 GUI Agent00
个人知识与本体23
人机协同与对齐00

近一个季度监测日历

北京时间。绿色表示有可阅读的新候选,灰蓝表示已监测但无新增,橙色表示部分降级;“无记录”不等于失败。

2026 年 6 月

1无记录2无记录3无记录4无记录5无记录6无记录7无记录8无记录9无记录10无记录11无记录12无记录13无记录14无记录15无记录16无记录17无记录18无记录19无记录20无记录21无记录22无记录23无记录24无记录25无记录26无记录27无记录28无记录29无记录30无记录

近 14 次监测窗口

仅展示公开源的聚合运行状态,不含提示词、全文或个人数据。

本轮新增候选(6 篇)

按赛道、评分和日期展开;中文标签用于导航,英文摘要用于核验。已展示过的旧候选不会每日重复。

形式化与程序验证(2 篇)

形式化与程序验证 · 3/30 · 2026-07-31FriendBench:多模态人际熟悉度推断基于20秒双人对话片段推断两人是否熟识;最强模型与人类准确率相当,但更倾向判为'陌生人'。FriendBench: Benchmarking Dyadic Familiarity Inference in Humans and Multimodal Large Language Models

Reading a social situation often depends on behavior, not words alone. We introduce FriendBench, a benchmark for inferring whether two people are already familiar or are meeting as strangers, from a 20-second clip of a dyadic ice-breaker conversation. Every pair answers the same type of prompt, so only the manner of interaction can reveal the answer. Across text, audio, and video, we compare 26 models from seven companies against matched human panels over 96 balanced dyads. The best model and the human crowd are statistically indistinguishable on accuracy in every modality, but reach it differently: humans stay balanced across the two answers, while the strongest models lean toward "stranger"---a difference in effective prior, not discrimination. Richer channels help both unequally, and only humans gain from visible behavior on top of speech. We release the stimuli, human ratings, and model predictions.

阅读 arXiv 原文
形式化与程序验证 · 8/30 · 2026-07-30开源多代理RTL形式化修复流水线以反例引导迭代修复RTL,目标k-归纳证明;当前证据限于ALU案例研究。Open-Source LLM-Driven Formal Verification: A Multi-Agent Pipeline for RTL Repair

Verification consumes the majority of modern chip design effort, yet the formal verification tools that provide mathematical guarantees of correctness remain expensive and restrictively licensed. While large language models (LLMs) have shown promise for hardware design, existing approaches to RTL repair validate their results through simulation - which exercises only a subset of inputs - or rely on commercial tools, and few combine formal proof with an entirely open-source toolchain. In this paper, we present a multi-agent pipeline that couples an LLM with an open-source formal backend (Yosys, SymbiYosys, and Z3) to repair RTL through counterexample-guided iteration: the framework generates formal properties, verifies the design, and feeds counterexamples back to the LLM until the design is proved correct by k-induction or an iteration budget is exhausted. Through an ALU case study, we show that the pipeline can detect and repair a real functional bug with a formal proof of correctness. Across a six-benchmark suite, one design is repaired reliably, and we characterize four distinct failure modes: bounded-cover vacuity, specification ambiguity, temporal-logic bugs, and multi-property pressure. We frame this work as a feasibility study with a detailed failure analysis, and additionally report a practical limitation of the Yosys bind directive relevant to the open-source formal verification community.

阅读 arXiv 原文

软件工程与仓库智能(2 篇)

软件工程与仓库智能 · 6/30 · 2026-07-31AgenticRepair:漏洞修复智能体框架围绕代码结构、运行执行、提交历史三类上下文,编排专用LLM子代理完成漏洞修复。AgenticRepair: Multi-Faceted Program Context Engineering for Agentic Vulnerability Repair

Automated vulnerability repair aims to reduce the time and effort required to patch security flaws from a vulnerability triage report. Recent agentic AI approaches have shown promising results in automated program repair. However, vulnerability repair demands richer program context than general bug repair - context that security engineers routinely assemble in practice but that existing agentic approaches do not engineer. We identify three critical gaps: code-structure context capturing cross-file data flows and memory operation patterns, runtime-execution context revealing crash semantics and memory origins, and commit-history context recovering how fragile code patterns were introduced. We present AgenticRepair, an agentic vulnerability repair framework that addresses the gaps through multi-faceted program context engineering. AgenticRepair orchestrates three specialized LLM subagents to engineer the contexts, which are then embedded into the memory of a dedicated repair subagent for context-conditioned patch synthesis. Evaluated on SEC-Bench comprising 300 real-world instances with sanitizer-based patch verification, AgenticRepair achieves a 73% success rate, substantially outperforming the strongest baseline by 29%. Our ablation study confirms that the three context facets are mutually complementary, and that multi-agent scaffolding and base-model capacity each play an essential role. Collectively, these findings establish multi-faceted program context engineering as a promising design direction for agentic vulnerability repair.

阅读 arXiv 原文
软件工程与仓库智能 · 4/30 · 2026-07-30BSG-VA:测试通过未必验证缺陷修复重放验证命令于缺陷态、候选态与金修复,46.0%的正向事件不含缺陷判别信息。Validation Evidence in LLM Repair Agents: How Much of What Passes Actually Tests the Bug?

When a repair agent runs a test and sees it pass, the result is treated as evidence about the reported defect. We measure how often that treatment is warranted. BSG-VA (buggy-state/candidate-state/gold-fix validation analysis) captures each validation command at its exact working-tree state, extracts a test-only patch, and replays the command on the original buggy code (B), the candidate state (S), and the developer gold fix (G). The captured outcome and the replay results assign every event an evidence role, from gold-aligned bug-discriminating through regression-only to misleading. Across 3,730 events in 643 rollouts on 110 tasks, 46.0% of positive comparable events carry no bug-discriminating information; 23.8% of baseline rollouts, with no feedback injected, close with a patch whose entire positive evidence base is of this kind. A three-arm experiment tests whether returning the B-replay outcome to the agent changes this pattern. Bug-contrast feedback reduces evidence-inadequate closure by 7.8 percentage points relative to an attention-matched reminder (p = 0.0029) and raises bug-discriminating evidence by 7.4 points (p = 0.011), with no detectable cost to repair success. Both estimates fall below the prespecified 10-percentage-point smallest effect size of interest, so practical magnitude remains uncertain. Roughly a third of the improvement traces to the reminder alone; across two exploratory replications, varying the scaffold and the model, the B-replay content adds a detectable increment only with gpt-5.6-sol under the unconstrained tool-use loop. BSG-VA applies post hoc to any replayable repair trajectory that preserves the required code states and execution environment. Keywords: program repair agents, validation evidence, test adequacy, large language models, software quality, controlled experiment.

阅读 arXiv 原文

代码质量与优化(0 篇)

本轮该赛道没有候选论文。

UI 与 GUI Agent(0 篇)

本轮该赛道没有候选论文。

个人知识与本体(2 篇)

个人知识与本体 · 7/30 · 2026-07-31Zero-Mem:零token的智能体记忆操作记忆存取不额外调用LLM、不消耗token;以原始交互轨迹为记录,用实体-上下文图与时间层级组织。Zero-Mem: Zero-Token Memory Operations for LLM Agents

LLM agents need memory to act consistently over long interactions, yet many systems use additional LLM calls to operate that memory. Generating intermediate records and mediating their retrieval adds recurring token and time costs, while omitted or merged details can obscure the original evidence. We ask whether structured memory access requires generation at all. Zero-Mem introduces \emph{zero-token memory operations}: no step outside final question answering invokes an LLM or consumes LLM input or output tokens; encoder computation is accounted for separately. Zero-Mem preserves original interaction traces as its source of record. It organizes the traces in two complementary ways. An entity--context graph exposes connections across interactions, while a temporal hierarchy preserves conversational locality and session state. For each query, Zero-Mem weighs the two views, retrieves from both, and follows their structure to recover supporting relations or surrounding context. Deterministic calibration first discards conflicting evidence and then keeps the reader's answer grounded in the retrieved traces. Only the final-QA reader invokes an LLM. Across long-memory and long-context question-answering benchmarks, Zero-Mem achieves competitive performance while eliminating LLM calls and LLM-token consumption from memory operations. With the same final-QA reader and context budget, it reduces memory-operation time cost by 57.6\% relative to the fastest compared baseline. Ablations support the contribution of the two views and their query-dependent coordination. Overall, the results show that structured agent memory need not generate an intermediate representation of the past. After peer review, the code and implementation details will be available at \textcolor{blue}{https://github.com/TheMoon0815/Zero-mem}.

阅读 arXiv 原文
个人知识与本体 · 0/30 · 2026-07-29ViSAGE:长视频理解的自修正记忆以跨模态绑定锚定实体身份,双向精炼传播延迟身份证据,构建自修正的实体中心记忆。ViSAGE: Constructing Self-Correcting Memories for Long-Form Video Understanding

Multimodal agents operating in long-horizon environments must build and continually update multimedia memories to support entity-consistent, temporally grounded reasoning. However, existing agentic memory approaches often discard fine-grained dentity cues under aggressive compression and segment-wise processing. They also rely heavily on vector similarity retrieval, which can surface semantically related yet identity-mismatched evidence, leading to entity confusion, error propagation, and hallucinated answers. We propose ViSAGE, a multimodal agentic memory framework that constructs self-correcting, entity-centric memories. Specifically, ViSAGE anchors entity identity via cross-modal binding over long temporal ranges. It then applies bidirectional memory refinement to propagate delayed identity evidence, retroactively unifying historical records and improving future reasoning. We also introduce multi-agent cross-verification to assess retrieved evidence under an identity-evidence alignment onstraint, enabling abstention instead of unsupported answers when evidence is missing. Extensive results demonstrate that ViSAGE consistently outperforms the strongest baseline, achieving 5.9% higher accuracy.

阅读 arXiv 原文

人机协同与对齐(0 篇)

本轮该赛道没有候选论文。