Apple deploys AI to scan user iPhones for illegal content

Apple developed a tool for local scanning of photos on iPhone for child abuse. The system began testing in the United States.

The tool continuously checks photos on iPhone, iPad and macOS devices without transmitting data to cloud storage. If illegal content is detected, the system will alert a group of reviewers, who will manually re-check the information. If necessary, they may contact law enforcement.

According to company representatives, the system matches users’ photos on the device with a database of known image hashes provided by NCMEC and other organizations dedicated to child safety.

The company stressed that using the tool to detect illegal content does not violate users’ privacy.

“Apple converts photos into an unreadable set of hashes, which are securely stored on users’ devices,” the company said in a statement.

The company also said it will roll out content scanning in Messages to shield children from obscene images sent by strangers.

“The app uses on-device machine learning to analyse attached photos and determine whether they are sexually explicit. … Apple does not have access to messages,” the blog says.

New features will appear with updates to iOS 15, iPadOS 15, watchOS 8 and macOS Monterey at the end of 2021.

Security expert Matthew Green expressed concerns about the rollout of on-device scanning of messages and photos. He said the company had sent “a very clear signal.”

Regardless of what Apple’s long term plans are, they’ve sent a very clear signal. In their (very influential) opinion, it is safe to build systems that scan users’ phones for prohibited content.

That’s the message they’re sending to governments, competing services, China, you.

— Matthew Green (@matthew_d_green) August 5, 2021

“In their (very influential) view, it is safe to build systems that scan users’ phones for prohibited content,” he said.

Green also believes that such a step by Apple will push governments to require similar tools from other tech companies.

In June Apple introduced passwordless sign-in with Face ID and Touch ID.

In March Apple acquired the most AI startups in the last four years.

In December 2020 Apple released an update for iOS that allows users to disable data collection within apps. The new rules sparked a wave of backlash from app developers, led by Facebook and Google.

Subscribe to ForkLog news on Telegram: ForkLog AI — all the news from the world of AI!