SoylentNews is people
SoylentNews
from the did-you-really-just-call-her-that? dept.
Google Photo tries to categorize your pictures automatically. Until very recently, it had a failure mode in which its classification for some pictures of humans was "Gorillas".
Google reacted [and apologised] very quickly when they got a complaint from a black woman who had been misclassified.
When Brooklyn-based computer programmer Jacky Alcine looked over a set of images that he had uploaded to Google Photos on Sunday, he found that the service had attempted to classify them according to their contents. Google offers this capability as a selling point of its service, boasting that it lets you, “Search by what you remember about a photo, no description needed.” In Alcine’s case, many of those labels were basically accurate: A photograph of an airplane wing had been filed under “Airplanes,” one of two tall buildings under “Skyscrapers,” and so on.
Then there was a picture of Alcine and a friend. They’re both black. And Google had labeled the photo “Gorillas.” On investigation, Alcine found that many more photographs of the pair—and nothing else—had been placed under this literally dehumanizing rubric.
Speculating, it's possible that their software is heavy on statistical matching and it's really hard to debug, which is why they wound up simply deleting "Gorilla" from the list of possible categories.
Original Submission
(Score: 4, Informative) by linuxrocks123 on Wednesday July 01 2015, @07:44AM
A face detector wouldn't be enough, because gorillas have faces. Looking at the photos, it's a selfie with a black girl's face taking up most of the picture; the guy is way in the background.
The girl has long black hair on both sides of her face, and her body (which would have been helpful for disambiguation) isn't in the photo. I don't have much experience with image recognition software, but I think it's likely her hair combined with the photo being a closeup of just her face is probably what did it.
Probably the ultimate fix will be changing the heuristics to err way, way on the side of labeling gorillas people, rather than the other way around. If a real gorilla photo ends up in the "people" category, the gorilla won't be offended.
(Score: 2) by linuxrocks123 on Wednesday July 01 2015, @07:47AM
Oh, also, I would guess it's highly likely Google already has a face detector. That's one of the easiest ways to find people in a photo.
(Score: 0) by Anonymous Coward on Wednesday July 01 2015, @09:09AM
If you had read my comment instead of just skimming through it, you would have noticed that I didn't claim it would be. All the face detector would do it to identify the areas needing special attention. The real work would have to be in the specialized routines that are to be run on the areas of special attention.
(Score: 2) by linuxrocks123 on Wednesday July 01 2015, @09:21AM
Apologies. That's a good idea: detect faces, and then spend extra effort trying to classify the species of the face if it's not obvious from other parts of the photo.
Many photos wouldn't need the extra effort, even if there's a face, because you know from the wearing of clothing and/or shape of the body that it is or isn't a human.
It would be nice if Google would post some information about their algorithms in general, how they went wrong in this case, and what they're doing to fix it.
(Score: 1) by esperto123 on Wednesday July 01 2015, @12:19PM
I think having gorillas been classified as people would also make people lose their shit (no pun intended), although probably not as much.
But it got me thinking, we can differentiate between gorillas and humans quite easily, even though we are VERY similar, what do we use to differentiate? face proportions? wrinkles? bone structure?
(Score: 2) by Freeman on Wednesday July 01 2015, @07:12PM
Intelligence.
Joshua 1:9 "Be strong and of a good courage; be not afraid, neither be thou dismayed: for the Lord thy God is with thee"
(Score: 2) by tangomargarine on Wednesday July 01 2015, @08:23PM
I think having gorillas been classified as people would also make people lose their shit (no pun intended),
What pun?
"Is that really true?" "I just spent the last hour telling you to think for yourself! Didn't you hear anything I said?"