Search Menu
Photonics Media Photonics Marketplace Photonics Spectra BioPhotonics Vision Spectra Photonics Showcase Photonics ProdSpec Photonics Handbook

AI-Driven Imaging System Protects Photo and Video Authenticity End-to-End

Facebook Twitter LinkedIn Email
To thwart sophisticated methods of altering photos and video, researchers at the New York University Tandon School of Engineering (NYU Tandon) have developed an experimental technique to authenticate images throughout the entire pipeline, from acquisition to delivery, using artificial intelligence (AI). The researchers demonstrated that neural imaging pipelines can be trained to replace the internals of digital cameras and optimized for high-fidelity photo development and reliable provenance analysis. In experiments, their prototype imaging pipeline increased the chances of detecting manipulation from approximately 45% to over 90% without sacrificing image quality.

The new approach replaces the traditional photo development pipeline with a neural network that introduces artifacts directly into the image at the moment of image acquisition. These artifacts are like digital watermarks. They are extremely sensitive to manipulation and can uncover not only the existence of photo manipulations, but also their character. The process is optimized for in-camera embedding and can survive image distortion by online photo-sharing services.

AI-driven system protects photo, video authenticity. NYU Tandon.

To prevent sophisticated, deep-fake methods of altering photos and video, researchers at the NYU Tandon School of Engineering devised a technique to authenticate images throughout the entire pipeline, from acquisition to delivery, using artificial intelligence (AI). In tests, a prototype pipeline increased the ability to detect manipulation from approximately 45% to over 90% without downgrading image quality. Courtesy of NYU Tandon.

“If the camera itself produces an image that is more sensitive to tampering, any adjustments will be detected with high probability,” said professor Nasir Memon. “These watermarks can survive post-processing; however, they’re quite fragile when it comes to modification. If you alter the image, the watermark breaks.”

The NYU Tandon team reasoned that modern digital imaging already relies on machine learning and that in the coming years, AI-driven processes are likely to fully replace the traditional digital imaging pipelines. As this transition takes place, Memon said, “We have the opportunity to dramatically change the capabilities of next-generation devices when it comes to image integrity and authentication. Imaging pipelines that are optimized for forensics could help restore an element of trust in areas where the line between real and fake can be difficult to draw with confidence.”

While the approach shows promise in testing, the researchers said that additional work is needed to refine the system. The solution is open-source and can be accessed at

The research will be presented at the Conference on Computer Vision and Pattern Recognition, June 16-20, 2019, Long Beach, Calif. (
May 2019
artificial intelligence
The ability of a machine to perform certain complex functions normally associated with human intelligence, such as judgment, pattern recognition, understanding, learning, planning and problem solving.
machine vision
Interpretation of an image of an object or scene through the use of optical noncontact sensing mechanisms for the purpose of obtaining information and/or controlling machines or processes.
Research & TechnologyeducationAmericasimagingcamerasneural networksartificial intelligencesecurityConsumerdefensemachine visionNew York Universityfake photosfake videosphoto authenticityAI

Submit a Feature Article Submit a Press Release
Terms & Conditions Privacy Policy About Us Contact Us
Facebook Twitter Instagram LinkedIn YouTube RSS
©2023 Photonics Media, 100 West St., Pittsfield, MA, 01201 USA, [email protected]

Photonics Media, Laurin Publishing
x We deliver – right to your inbox. Subscribe FREE to our newsletters.
We use cookies to improve user experience and analyze our website traffic as stated in our Privacy Policy. By using this website, you agree to the use of cookies unless you have disabled them.