The famous apple brand, which has built part of its reputation on the protection of personal data, unveiled a new device on Thursday, August 5, which shook the backs of leading online privacy experts .

Called "NeuralMatch", this tool pursues a goal impossible to criticize: to fight against child pornography.

Apple, in an update first deployed in the United States next month, plans to use artificial intelligence and cryptography to scan photos stored locally on iPhones and iPads to identify if any fall under child pornography.

Big Brother respectful of privacy?

The American group can already control all the images that are on iCloud, the backup service on Apple's remote servers.

This is also what its main competitors, such as Google, Dropbox or Microsoft's OneDrive, are doing.

But the creator of the iPhone goes much further since he is preparing to analyze the snapshots that users have not yet decided to put on iCloud servers. "Apple's initiative can be a game-changer," said John Clark, president of the National Center for Missing and Exploited Children (NCEM), the leading US organization against the exploitation of minors, interviewed by the Wall. Street Journal. 

This tool allows Apple to make users of its devices understand that they cannot have any secret garden, even in the darkest recesses of their smartphones. However, this new Big Brother would be as respectful of privacy as possible. The algorithm does not look at the images. It reduces each file to a digital identifier - the equivalent of a fingerprint - and looks for a possible match in the NCEM file of more than 200,000 images of child sexual abuse.

If the AI ​​discovers multiple snapshots on an iPhone hard drive that are also on the NCEM's list, the photos are sent to an Apple employee, who can then view them in "clear" to ensure that 'it is indeed child pornography. For Apple, these safeguards make NeuralMatch a device that is not too intrusive. "If you store a collection of child abuse photos, you will have problems, but for others it will not make a difference at all," said Erik Neuenschwander, head of privacy matters for Apple, interviewed by the New York Times.

This new device "is clearly made to reassure the authorities and give pledges of goodwill to the police," said Riana Pfefferkorn, specialist in cybersurveillance issues at the Internet Observatory of Stanford University. , during a roundtable between several cybersecurity experts devoted to the announcement of Apple.

for sure, but I think I'm OK with this tradeoff?

FB reported 15.8M cases of CSAM to NCMEC in 2019;

Apple reported 205. Seems likely that there is massive under-reporting of very bad stuff on iOS

- Casey Newton (@CaseyNewton) August 5, 2021

A 2019 New York Times investigation had, in fact, shown that the fight against child pornography was one of the weak points on all major Internet platforms.

And Apple is, so far, far behind other services in terms of detecting illegal content.

"In 2019, Facebook reported 15.8 million child pornographic content, against 205 for Apple. There is clearly a problem of underestimation of the number of illegal images circulating thanks to Apple's services," said Casey Newton on Twitter. , one of the most renowned American journalists in the field of new technologies.

The start of trouble

?

Apple is also reportedly preparing to strengthen data protection on iCloud by introducing end-to-end encryption (meaning all files saved in the cloud will become unreadable for Apple) in the coming months. "This is a long-awaited decision, and the announcement that has just been made may be a way for Apple to reassure the authorities by making them understand that it will still be possible to spot illegal content despite the encryption," explains Riana Pfefferkorn.

But to multiply the pledges to the police who have criticized it so much in the past, Apple would have gone a long way, according to several cybersurveillance specialists.

"It's a terrible device that will inevitably turn our computers [macbook, NLDR], iPhone and iPad into massive surveillance tools," said Ross Anderson, computer security specialist at Cambridge University, interviewed by the Financial Times . 

"This is how electronic surveillance sets in. First for the noblest of motives, then to hunt down gun footage, then find protest photos, then chat screenshots. about demonstrations, etc. ", fears John Hamasaki, an American lawyer specializing in criminal law, on Twitter. 

Apple would have, in fact, opened a Pandora's box by developing an AI that scans photos directly on smartphones or tablets. "From now on, it suffices to change a few parameters in the algorithm to allow it to find other types of photos", assures the Electronic Frontier Foundation, one of the main American NGOs fighting for the protection of privacy in online, in a statement released Thursday.

"Governments, including that of the United States, will inevitably ask Apple to adapt this device to the fight against terrorism. And we know how this notion can have different meanings from one country to another" , warns David Thiel, technical director of the Internet Observatory of Stanford, during a round table devoted to the initiative of Apple.

The fight against terrorism has, for example, been the pretext used by China for its policy of persecuting the Muslim minority of the Uighurs.

And after terrorism?

"I can very well imagine that the music and film lobby is demanding that Apple adapt this technology to find files that violate copyright," said Riana Pfefferkorn.

"You had better have confidence in the management of Apple never to give in to all these demands. From now on, confidence is all we have left to avoid the slippages of this technology", regrets Matthew Green, cryptography researcher at Johns Hopkins University in Baltimore. 

While waiting to see if the forecasts of these technological Cassandras come true, this device continues to fuel the vast debate on where to place the cursor of individual freedoms in the name of the fight for the noblest causes possible.

The summary of the week

France 24 invites you to come back to the news that marked the week

I subscribe

Take international news everywhere with you!

Download the France 24 application

google-play-badge_FR