高级检索

    语义逻辑与拓扑协同推演的多模态目标重识别

    Synergistic Deduction of Semantic Logic and Topology for Multimodal Object Re-identification

    • 摘要: 现有多模态目标重识别方法局限于异构视觉特征的浅层融合,忽略了文本中蕴含的语义逻辑对视觉模糊的纠错能力。尽管近期工作引入了多模态大语言模型,但生成的非结构化文本仍含有噪声,难以主动引导视觉表征的精准对齐。因此,提出了一种语义逻辑与拓扑协同推演的多模态目标重识别方法。首先,设计了一套标准化的多模态描述生成流程,利用DeepSeek-VL结合属性约束,提炼出语义精确的文本标注;其次,为了弥合文本语义与视觉表征之间的模态鸿沟,提出了语义逻辑推演模块,驱动模型在特征空间中主动进行跨模态语义纠错与动态推演;最后,设计了语义拓扑推演模块,利用样本间的关联拓扑精细优化检索空间。在公开数据集RGBNT201,MSVR310,RGBNT100上与当前主流方法进行了对比实验,结果表明,所提方法在3个数据集上均取得了具有竞争力的综合性能。

       

      Abstract: Existing multimodal object re-identification (Re-ID) methods are largely limited to the shallow fusion of heterogeneous visual features, while largely overlooking the semantic logic embedded in textual descriptions and its potential to resolve ambiguities in visual representations. Although recent multimodal large language models have enabled automatic caption generation, the generated unstructured text still contains noise, making it difficult to provide reliable guidance for accurate cross-modal visual alignment. To address these issues, a multimodal object Re-ID method based on the synergistic deduction of semantic logic and topology is proposed. First, a standardized multimodal caption generation process is designed, in which DeepSeek-VL is combined with attribute constraints to extract semantically precise textual annotations from multimodal images. Second, a semantic logic deduction module is introduced to bridge the gap between textual semantics and visual representations. It transforms structured semantic attributes into visual guidance and exploits cross-modal responses to achieve semantic correction and adaptive alignment of identity-related regions in the feature space. Third, a semantic topology deduction module is developed to further refine the retrieval space by exploiting inter-sample relational topology. Extensive experiments on RGBNT201, MSVR310, and RGBNT100 demonstrate that the proposed method achieves competitive overall performance compared with representative state-of-the-art approaches.

       

    /

    返回文章
    返回