西安电子科技大学学报 ›› 2023, Vol. 50 ›› Issue (6): 207-218.doi: 10.19665/j.issn1001-2400.20230105

• 网络空间安全 • 上一篇    下一篇

应用注意力机制的文档图像篡改与脱敏定位

郑铿涛1(),李斌1,2(),曾锦华3()   

  1. 1.深圳大学 广东省智能信息处理重点实验室,深圳市媒体信息内容安全重点实验室,广东 深圳 518060
    2.深圳市人工智能与机器人研究院,广东 深圳 518129
    3.司法鉴定科学研究院,上海 200063
  • 收稿日期:2022-10-30 出版日期:2023-12-20 发布日期:2024-01-22
  • 通讯作者: 李斌(1982—),男,教授,E-mail:libin@szu.edu.cn
  • 作者简介:郑铿涛(1997—),男,深圳大学硕士研究生,E-mail:2070436065@email.szu.edu.cn;|曾锦华(1985—),男,高级工程师,E-mail:zengjh@ssfjd.cn
  • 基金资助:
    国家自然科学基金(U22B2047);国家自然科学基金(61872244);国家自然科学基金(62272314);广东省基础与应用基础研究基金杰出青年基金项目(2019B151502001);深圳市研究与发展计划项目(JCYJ2020010905008228);上海市科委技术标准项目(21DZ2200100)

Document image forgery localization and desensitization localization using the attention mechanism

ZHENG Kengtao1(),LI Bin1,2(),ZENG Jinhua3()   

  1. 1. Guangdong Key Lab of Intelligent Information Processing,Shenzhen Key Laboratory of Media Security, Shenzhen University,Shenzhen 518060,China
    2. Shenzhen Institute of Artificial Intelligence and Robotics for Society,Shenzhen 518129,China
    3. Academy of Forensic Science,Shanghai 200063,China
  • Received:2022-10-30 Online:2023-12-20 Published:2024-01-22

摘要:

诸如合同、证明文件和通知书等一些重要的文档材料,常常以电子图像格式被存储和传播。然而,由于包含关键的文字信息,此类图像往往容易被非法篡改利用,造成严重的社会影响和危害;与此同时,考虑到个人的隐私安全问题,人们往往也会对这类图像做脱除敏感信息处理。恶意篡改与脱敏均会给原始图像引入额外痕迹,但在动机上存在区别,且在操作方式上也存在一定差异。因此,有必要对二者进行区分,从而更准确地定位出篡改区域。针对这个问题,提出了一个卷积编解码网络,通过U形连接获取编码器多级特征,有效学习篡改和脱敏处理痕迹;同时,在解码网络引入多个挤压激励注意力机制模块,抑制图像内容,关注更微弱的处理痕迹,提高网络的检测能力。为了有效地辅助网络训练,构建了一个包含常见篡改操作和脱敏操作的文档图像取证数据集。实验结果表明,算法模型在此数据集上表现良好,在公开的篡改数据集上也有不错的性能,并优于对比算法。同时,所提的算法对几种常见的后处理操作具有较好的鲁棒性。

关键词: 文档图像, 篡改定位, 脱敏定位, U-Net, 挤压激励注意力机制

Abstract:

Some important documents such as contracts,certificates and notifications are often stored and disseminated in a digital format.However,due to the inclusion of key text information,such images are often easily illegally tampered with and used,causing serious social impact and harm.Meanwhile,taking personal privacy and security into account,people also tend to remove sensitive information from these digital documents.Malicious tampering and desensitization can both introduce extra traces to the original images,but there are differences in motivation and operations.Therefore,it is necessary to differentiate them to locate the tamper areas more accurately.To address this issue,we propose a convolutional encoder-decoder network,which has multi-level features of the encoder through U-Net connection,effectively learning tampering and desensitization traces.At the same time,several Squeeze-and-Excitation attention mechanism modules are introduced in the decoder to suppress image content and focus on weaker operation traces,to improve the detection ability of the network.To effectively assist network training,we build a document image forensics dataset containing common tampering and desensitization operations.Experimental results show that our model performs effectively both on this dataset and on the public tamper datasets,and outperforms comparison algorithms.At the same time,the proposed method is robust to several common post-processing operations.

Key words: document image, forgery localization, desensitization localization, U-Net, squeeze-and-excitation attention mechanism

中图分类号: 

  • TP391