Multimedia Forensics

The group focuses on three main topics: passive image forensics, proactive image forensics, and fake news detection. Passive image forensics include image manipulation detection, DeepFake detection, model fingerprinting, etc. For proactive image forensics, we utilize data hiding, our lab’s key strength, to assist forgery detection.

learning resource

Fake News Detection

publication

1. ICCV

   DRAW: Defending Camera-shooted RAW against Image Manipulation

   Xiaoxiao Hu, Qichao Ying, Zhenxing Qian, Sheng Li, Xinpeng Zhang

   International Conference on Computer Vision (ICCV), 2023                        

   PDF Website
2. Learning to Immunize Images for Tamper Localization and Self-Recovery

   Q. Ying, H. Zhou, Z. Qian, S. Li, and X. Zhang

   IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023, accepted.
3. ACM MM

   RetouchingFFHQ: A Large-scale Dataset for Fine-grained Face Retouching Detection

   Q. Ying, J. Liu, S. Li, H. Xu, Z. Qian, and X. Zhang

   MM '23: Proceedings of the 30th ACM International Conference on Multimedia, 2023.

   PDF Website Application Form
4. On Physically Occluded Fake Identity Document Detection

   H. Wang, S. Li, S. Cao, R. Yang, J. Zeng, Z. Qian, and X. Zhang

   MM '23: Proceedings of the 30th ACM International Conference on Multimedia, 2023.
5. 面向虚假新闻检测的社交媒体多模态数据集构建

   高国鹏, 房耀东, 韩彦芳, 钱振兴, 秦川

   网络与信息安全学报, 2023
6. 抗深度取证的多粒度融合图像修复网络

   窦立云, 冯国瑞, 钱振兴, 张新鹏

   上海大学学报(自然科学版), 2023
7. ACM MM

   Multi-modal Fake News Detection on Social Media via Multi-grained Information Fusion

   Y. Zhou, Y. Yang, Q. Ying, Z. Qian, and X. Zhang

   ACM International Conference on Multimedia Retrieval (ICMR 2023), Thessaloniki, Greece, June 12-15, 2023.

   PDF Website
8. Image Protection for Robust Cropping Localization and Recovery

   Q. Ying, H. Zhou, X. Hu, Z. Qian, S. Li, and X. Zhang

   IEEE International Conference on Multimedia and Expo (ICME), 2023
9. ACM MM

   Multimodal Fake News Detection via CLIP-Guided Learning

   Y. Zhou, Q. Ying, Y. Yang, Z. Qian, and X. Zhang

   IEEE International Conference on Multimedia and Expo (ICME), 2023

   PDF Website
10. Bootstrapping Multi-view Representations for Fake News Detection

    Q. Ying, X. Hu, Y. Zhou, Z. Qian, D. Zeng, and S. Ge

    Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI-23), 2023
11. From Image to Imuge: Immunized Image Generation

    Q. Ying, Z. Qian, H. Zhou, X. Zhang, H. Xu, and S. Li

    MM '21: Proceedings of the 29th ACM International Conference on Multimedia, October 2021, pp 3565-3573
12. On Generating Identifiable Virtual Faces

    Z. Yuan, Z. You, S. Li, Z. Qian, X. Zhang, and A. Kot

    MM '22: Proceedings of the 29th ACM International Conference on Multimedia, 2022, accepted.
13. SNIS: A Signal Noise Separation-based Network for Post-processed Image Forgery Detection

    J. Chen, X. Liao, W. Wang, Z. Qian, Z. Qin, and Y. Wang

    IEEE Transactions on Circuits and Systems for Video Technology, doi: 10.1109/TCSVT.2022.3204753
14. Patch Diffusion: A General Module for Face Manipulation Detection

    B. Zhang, S. Li, G. Feng, Z. Qian, and X. Zhang

    the Thirty-Sixth AAAI Conference on Artificial Intelligence (AAAI-22), Vancouver, Canada, Feb. 22, 2022
15. Diffusing the liveness cues for face anti-spoofing

    S. Li, X. Zhu, G. Feng, X. Zhang, and Z. Qian

    MM '21: Proceedings of the 29th ACM International Conference on Multimedia, October 2021, pp 1636-1644
16. Artificial Intelligence Oriented Information Hiding and Multimedia Forensics

    C. Qin, Z. Qian, X. Li, and J. Wang

    IETE Technical Review, 38(1): 1-4, 2021.
17. Reversible Privacy Protection with the Capability of Anti-forensics

    L. Dou, Z. Qian, Z. Wang, and G. Feng

    Security and Communication Networks, 2021, 1-12
18. Anti-Forensics of Diffusion-Based Image Inpainting

    L. Dou, Z. Qian, C. Qin, G. Feng, and X. Zhang

    Journal of Electronic Imaging, 29(4), 043026 (1-15), 2020.
19. New Paradigm for Self-embedding Image Watermarking with Poisson Equation

    F. Cao, T. Wu, C. Qin, Z. Qian, and X. Zhang

    H. Wang et al. (Eds.): IWDW 2019, LNCS 12022, pp. 184-191, 2020.
20. Improved anti-forensics of JPEG compression

    Z. Qian, and X. Zhang

    Journal of Systems & Software, 91: 100-108, 2014.
21. Image self-embedding with high-quality restoration capability

    Z. Qian, G. Feng, X. Zhang, and S. Wang

    Digital Signal Processing, 21(2): 278-286, 2011.
22. Watermarking with flexible self-recovery quality based on compressive sensing and compositive reconstruction

    X. Zhang, Z. Qian, Y. Ren, and G. Feng

    IEEE Transactions on Information Forensics & Security, 6(4): 1223-1232, 2011.
23. Reference sharing mechanism for watermark self-embedding

    X. Zhang, S. Wang, Z. Qian, and G. Feng

    IEEE Transactions on Image Processing, 20(2): 485-495, 2011.
24. Inpainting assisted self recovery with decreased embedding data

    Z. Qian, and G. Feng

    IEEE Signal Processing Letters, 17(11): 929-932, 2010.
25. Reversible fragile watermarking for locating tampered blocks in JPEG images

    X. Zhang, S. Wang, Z. Qian, and G. Feng

    Signal Processing, 90(12): 3026-3036, 2010.