高级检索

    基于抗测绘表征扰动的检索增强生成敏感信息保护

    Anti-Mapping Representation Perturbation for RAG Sensitive Information Protection

    • 摘要: 检索增强生成(retrieval-augmented generation,RAG)系统通过集成外部数据库扩展了语言模型的能力。然而,这种增强方式引入了一种新型隐私漏洞:测绘攻击(mapping attacks,MA),该类攻击旨在推断某一特定的私有数据片段是否被收录于检索数据库中,并进一步揭示其在检索过程中的行为特征。这类攻击同时利用嵌入层面的信号和检索过程中的动态信息,对RAG流程中的敏感数据保护构成了严重威胁。尽管人们对RAG系统中的隐私风险关注不断提升,但目前尚不存在专门针对测绘攻击设计的防御机制。AMRP-SIP 通过双重随机化机制同时保护文档嵌入表示与检索轨迹,并在隐私保护与检索效用之间实现有效平衡。AMRP-SIP包含3个轻量级阶段:首先,随机正交投影将查询和文档映射至低维潜在空间,以混淆原始嵌入表示,并降低后续噪声注入对检索效用的影响;其次,自适应差分隐私机制根据局部语义簇敏感度注入高斯噪声,确保实现(ε, δ)级别的文档片段隐私保护;最后,扰动丢弃阶段对相似度分数施加噪声扰动,并以概率p随机丢弃部分检索文档,从而模糊检索轨迹。在Wiki-40B,PubMed,IP-Database上的实验表明,AMRP-SIP将成员推断攻击(membership inference attacks,MIA)的AUC值从0.75降至0.27。该框架在保护敏感信息的同时,维持了与现有方法相当的检索性能,为 RAG 系统中的测绘攻击防御提供了一种有效方案。

       

      Abstract: Retrieval-augmented generation (RAG) systems extend the capability of large language models by incorporating external knowledge databases, enabling more accurate and up-to-date responses. However, this integration also introduces a novel privacy vulnerability: mapping attacks (MA), which aim to infer whether a specific private fragment is indexed in the retrieval database and to uncover its retrieval behavior. Such attacks exploit both embedding-level signals and retrieval dynamics, posing a serious threat to sensitive data protection in RAG pipelines. Despite the growing awareness of privacy risks in RAG systems, there is currently no dedicated defense mechanism specifically designed to mitigate mapping attacks. We introduce AMRP-SIP, a dual-randomization framework that concurrently protects both embeddings of the documents and retrieval traces, while preserving state-of-the-art utility. AMRP-SIP comprises three lightweight stages. First, a Random Orthogonal Projection compresses each query and document into a low-dimensional latent space, hiding raw embeddings and reducing downstream noise. Second, Adaptive Differential Privacy injects cluster-adaptive Gaussian noise, ensuring (ε, δ) fragment-level privacy. Third, a score-dropout layer introduces randomness by perturbing similarity scores with noise and probabilistically dropping a portion of the retrieved documents with probability p, thereby obfuscating the retrieval trajectory. Experiments on Wiki-40B, PubMed, and IP-Database demonstrate that AMRP-SIP reduces the AUC of membership inference attacks (MIA) from 0.75 to 0.27, while maintaining competitive performance in downstream RAG tasks.

       

    /

    返回文章
    返回