Detecting false captioning using common-sense reasoning

Sangwon Lee, David A. Shamma, Bruce Gooch

Research output: Contribution to conferencePaperpeer-review

3 Citations (Scopus)


Detecting manipulated images has become an important problem in many domains (including medical imaging, forensics, journalism and scientific publication) largely due to the recent success of image synthesis techniques and the accessibility of image editing software. Many previous signal-processing techniques are concerned about finding forgery through simple transformation (e.g. resizing, rotating, or scaling), yet little attention is given to examining the semantic content of an image, which is the main issue in recent image forgeries. Here, we present a complete workflow for finding the anomalies within images by combining the methods known in computer graphics and artificial intelligence. We first find perceptually meaningful regions using an image segmentation technique and classify these regions based on image statistics. We then use AI common-sense reasoning techniques to find ambiguities and anomalies within an image as well as perform reasoning across a corpus of images to identify a semantically based candidate list of potential fraudulent images. Our method introduces a novel framework for forensic reasoning, which allows detection of image tampering, even with nearly flawless mathematical techniques.

Original languageEnglish
Publication statusPublished - 2006
Event6th Annual Digital Forensic Research Workshop, DFRWS 2006 - Lafayette, IN, United States
Duration: 2006 Aug 142006 Aug 16


Other6th Annual Digital Forensic Research Workshop, DFRWS 2006
Country/TerritoryUnited States
CityLafayette, IN

All Science Journal Classification (ASJC) codes

  • Information Systems


Dive into the research topics of 'Detecting false captioning using common-sense reasoning'. Together they form a unique fingerprint.

Cite this