Facial Recognition Fails in Boston, Too 318
bryan writes "Only a few weeks after cameras were found to be ineffective in catching criminals in Tampa, FL, a test of a facial-recognition system in Boston's Logan airport also came up disappointing. The cameras which were given photos of employees to detect, were only successful in 153 out of 249 random tests over the past year (about 61%). The article did not say how many false positives the tests generated. The companies involved were Indentix and Visage."
The system would work better... (Score:4, Funny)
wetware comparison (Score:5, Interesting)
Give the parallel processing capability people have to do this trick, it's probably not too surprising that computer tech hasn't gotten there yet.
Anyone know more about face-recognition processing in the human brain? I find this topic quite interesting...
Re:wetware comparison (Score:2)
John.
Re:wetware comparison (Score:3, Funny)
Re:wetware comparison (Score:3, Informative)
Re:wetware comparison (Score:3, Interesting)
You may not find it so amusing if you saw the video. The moment of the collision, a cloud of smoke formed which momentarily looked like the face of a rather amused devil.
There are those that believe we're due for armageddon, and given that 2001 was the new millineum and that an attack like this could have sparked World War III, it was rather spooky.
Re:wetware comparison (Score:2)
Ya know, it occurs to me that the man in the moon, face on mars and devil's face in WTC smoke constitute false positives on the part of our own brains, so we're not *quite* as superior to computers as we think we are. Or maybe it's a *really* tough problem.
Also, here's another interesting point, possibly only tangentially related: I understand that, in trials, eyewitnesses are not considered particularly reliable (including but not limited to facial recogniti
Re:wetware comparison (Score:2)
Yes, but a human's memory is fallable in general, and can be further distorted by emotion, prejudice, and any number of other factors. That is why eye witness accounts aren't reliable. A computer, however, has a perfect memory and is not susceptible to any sort of bias.
Re:wetware comparison (Score:5, Funny)
May I direct you to the following quote, from a highly notable artificial intelligence program: Proof!
Computers hate us to their very bones. My computer has only crashed when I've been doing something important, like writing a term paper or surfing for porn. They're out to get us, all right.
Re:wetware comparison (Score:2)
Remember, just case your paranoid doesn't mean they aren't out to get you.
Re:wetware comparison (Score:2)
My recognition system discounted them immediately.
Re:wetware comparison (Score:3, Interesting)
The facial recognition part of the brain is also very responsible for driving emotions. You show a picture of Hitler to s
Re:wetware comparison (Score:5, Informative)
I wouldn't call our system "overkill". Also, there are really multiple systems involved.
First, there is the subsystem that recognizes a face as being a face. There are certain clusters of neurons that fire in response to any face-like pattern, regardless of whether or not it is actually attached to a head. This is how we recognize animal faces as being faces, the man in the moon, smiley faces and emoticons, Jesus in a water stain, etc. This capacity is innate, and infants can discern face-like patterns very soon after being born.
After a face has been perceived, it must be narrowed down to an individual person. This ability is partly learned over time, and is responsible for the difficulty people have in recognizing faces outside of their own cultural group. Certain types of brain damage (from a stroke, for instance) can allow people to recognize the fact that they're looking at a face, but still be unable to determine whose face they're looking at.
Keep in mind that even before a face is perceived, you have systems that find the basic shape outlines, determine their orientations (separately and with respect to each other), and at the same time attach color information, shuttle it off to "face subprocessing", then call up any related emotional context (have you ever seen a stranger you didn't like because they resemble someone you already dislike?) -- all before you can become consciously aware of the face.
Re:wetware comparison (Score:2)
Really?!? I thought it was just because all of those people just looked the same
*ducks*
Actually, in all serious, I have heard people make that argument, as if it were the truth. Never mind that people from outside of their cultural group have an equally difficult time telling them apart.
Re:wetware comparison (Score:3, Interesting)
It turns out that members of ethnic groups with less variety in those areas have other features used for telling each other apart, like overall face or head shape, height of foreheard, and
Re:wetware comparison (Score:4, Interesting)
Human face recognition is also built-in. Psych experiments on newborns (straight out of the maternity ward), as well as older infants, indicate that they can detect faces early on. This is not the case with all visual abilities that people have! There are many types of spacial recognition and object-parsing tasks that infants, and even toddlers, simply can't do.
Newborns pay more attention to shapes that look like a face > over those that are schematically similar > over those those with eyes, noses etc but in different arrangements > over ovals with random junk > over blank ovals...
Also at an early age (don't remember when; I don't think they tested it on newborns, but I wouldn't be surprised if they can do this too), babies can tell familiar faces from unfamiliar ones, and show an inverted habituation effect; that is, they prefer to look at familiar faces than unfamiliar ones (unlike most shapes, where they get bored with the familiar ones).
Also at an early age (again, I don't remember how early, but less than a year), infants map others' faces onto their own and imitate. That is, if you stand in front of them for a few minutes with your tongue sticking out, they often stick theirs out too. If you have one eye open and one closed, they'll copy that too (I don't remember which eye tho).
From an early age, babies can also follow gazes to tell what someone is looking at; this is important in the development of language as well as vision, because babies use it to figure out what an adult is talking about. It is, IIRC, used more than what the adult is *pointing* at.
In addition to recognizing faces, babies can recognise other body parts, and treat an action differently based on whether it is done by a hand or a stick (when they don't see the hand holding the stick). If it is done by a hand or other object perceived to be animate, it is treated as goal-oriented and categorized partly by the perceived goal; if done by an "inanimate" object, the baby does not look for a goal. This is studied through habituation experiments; different actions with the same goal were seen as more similar (and hence less interesting) than those with the same basic appearance, if and only if they were performed by an animate-looking object such as a hand.
Re:wetware comparison (Score:2)
Re:wetware comparison -- Sound Logic? (Score:3, Insightful)
Rather than show all these problems in formal logic, let me just point out one problem:
A humans ability to do facial recognition has nothing to do with a computer's inability to do it.
Also let me throw in the technical point that any parallel solution to the problem, can be emulated serially; it just will take more time and probably more hardware to do it.
Re:wetware comparison (Score:2)
"Success" being quite subjective (see below.)
I believe the neural network was trained with something like 12 faces and could distinguish between all except 2, who actually looked similar.
Biggest question is scale: First off, how long did it take to process each face? Second, if you went from 12 faces to 1200 faces, would the time required scale linearly, or would it perhaps double (for example) for e
Same stuff (Score:2)
Improbable to start with (Score:5, Insightful)
Re:Improbable to start with (Score:4, Insightful)
As for it not being there yet, a lot of people said it was a far fetched idea for the US to send people to the moon, and in fact, a few people still believe that it didn't happen and it couldn't have. I'm willing to accept that it did happen, because the US Government wanted to show up the Russians and beat them to it. They were willing to spend the money, the technology emerges. Same thing here. If the government wants the tech, all they have to do is throw money at it, and wait. It'll eventualy be here before you know it.
Re:Improbable to start with (Score:2)
What are you talking about? A computer just did exactly that!
Putting aside the practical value of this technology (this guy [slashdot.org] said exactly what I was thinking) and treating it purely as a technical accomplishment, I'd say this is a pretty impressive accomplishme
Face-Recognition System & Visa Application to (Score:4, Interesting)
The system can be used to recognize a particular face when it is standing alone. Consider, for example, a photo of a face sent along with an visa application to the American embassy. Please read "World: Asia-Pacific China backs embassy protests [bbc.co.uk]". In 1999, Serbians committed gross human-rights violations against the Kosovars in Kosovo; the Chinese fully supported the Serbians in their campaign of terror. The North Atlantic Treaty Organization (NATO) under American command attempted to stop the slaughter by knocking out Serbian military units. NATO deliberately attempted to avoid hitting civilian targets in Serbia, but some bombs accidentally hit the Chinese embassy.
Shortly thereafter, the Chinese in both China and outside China erupted into ugly, violent protests. The Chinese throw stones and other projectiles at the American embassy in China. The Chinese also attacked some Americans. " The residence of the US Consul General in the south-western city of Chengdu was stormed and partially burned ."
How could the Americans in China have responded to this nonsensical violence? The Americans should have done the following.
Re:Face-Recognition System & Visa Application (Score:3, Interesting)
Point of view (Score:5, Funny)
Don't let the results stop you! (Score:5, Insightful)
"Kelly Shannon, spokeswoman for the State Department's consular affairs office, said the Logan Airport results would not affect plans to use face recognition to enhance passport security"
So it doesn't work, won't help, and might even end up hurting more that a few people, but it's going to enhance passport security?
And Apparently [abc.net.au] OZ thinks it's a good idea too? "We now have an international standard established, which is the adoption of facial recognition as the international biometric, and that has left us well placed to move to implementation."
Re:Don't let the results stop you! (Score:5, Interesting)
The article pointed out that the software was very effective at validating things like passport photos. One would imagine that a traveller would step up to the desk at customs/immigration and had over his passport. The immigration agent would insert the passport into a scanner. A camera would shoot a similar shot of the person standing at the counter. The software would then compare the two images and determine with a fairly high degree of reliability that the person at the counter is or is not the person in the passport photo. This determination could occur regardless of whether the person had gained or lost weight, lost hair, dyed hair, grew facial hair or shaved, or simply aged.
People make mistakes in this situation all the time. there is nothing wrong with having a computer try it.
Re:Don't let the results stop you! (Score:5, Interesting)
Second, some TSA lackey is going to get in the habit of passing IDs and passports under a scanner and looking for a result. They will think even less about comparing the face with the image for themselves. They will simply trust the computer. There's a great TSA article at Wired (Confessions of a Baggage Screener - Wired 11.09 [wired.com]) that lays a lot of their habits bare.
Lastly, as someone already mentioned, the 9/11 attackers used their real names and real passports. Just because we are looking for terrorists, it doesn't mean we actually know who they are or what they look like.
I don't think that face recognition will help much but some department's budget and some politician's "knee-jerk" contribution efforts. Ok, this may prevent Osama from flying, but I don't think he'd assign himself to a suicide mission. It will always be some "volunteer" that we have very little record of.
Re:Don't let the results stop you! (Score:2)
And yes, you could just store the photo, but biometrics, one-on-one, are fairly reliable and difficult to fool (in theory), unlike a passport agent who may not be good at telling apart, say, Southeast Asian men.
Re:Don't let the results stop you! (Score:2)
Wouldn't the false positive rate be more important (Score:5, Insightful)
Obviously it couldn't replace ANY other security measure, but if it worked 61% of the time with NO false positives, I would call that pretty damn successful, especially in such an early implementation.
They said 10 of the 19 hijackers went through Logan - so this system theorhetically would have caught 6 of them? Better than none. And it seems like the technology would improve with time.
Personally I'd rather have my face scanned then have them strip searching me because my credit sucks and I paid cash for my plane ticket.
Re:Wouldn't the false positive rate be more import (Score:5, Insightful)
The 9/11 hijackers used their real names and real ID. If they'd been placed on a simple watch list of names then strcmp would have found them, not some highfalutin' face recognition system. It's not the technology here, but coordination between the three letter agencies that's needed.
John.
Re:Wouldn't the false positive rate be more import (Score:5, Insightful)
Re:Wouldn't the false positive rate be more import (Score:3, Informative)
Not quite. It would only have caught those of the hijackers who were on the do-not-fly list, which we all know is a resounding success. Since the hijackers did nothing to arouse suspicion in their initial period in the US, it's unlikely they'd have been flagged.
Re:Wouldn't the false positive rate be more import (Score:5, Informative)
It quotes the Logan report [aclu.org] saying, "the number of system-generated false positives was excessive."
Re:Wouldn't the false positive rate be more import (Score:3, Insightful)
Re:Wouldn't the false positive rate be more import (Score:2)
Of course it doesn't work. (Score:5, Interesting)
They aren't at the stage yet where machines can recognize people based on gait and mannerism. Facial recognition is a best guess and still requires a human to be sure of the fact just like fingerprint systems.
Re:Of course it doesn't work. (Score:5, Funny)
So the Minister of Funny Walks is still safe.
Re:Of course it doesn't work. (Score:2)
As for needing human verification, these types of systems aren't intended to be fully automated. I
It's coming along...slowly... (Score:2, Interesting)
Re: (Score:2, Funny)
It doesn't say (Score:2, Insightful)
Either way I don't I like it.
What is failure? (Score:2)
Sure, there may be other systems which have a greater success rate, but, at least from what I know (sometimes, admittedly very little), there don't seem to be a whole lot of other alternatives which don't require that the security queues at airports extend out in the airport parki
Re:What is failure? (Score:3, Funny)
Re:What is failure? (Score:2)
That'd probably make recognition work better, but I'm not sure people will wait in endless lines on top of the metal detectors and other security procedures to be asked to remove any offending headgear, jewelry, etc. to stare into a camera.
Now for certain questions, suspicio
Failure depends on false positives (Score:4, Insightful)
The most important characteristic of such a system is the false positive rate. A system that flags everyone who passes through will flag 100 percent of terrorists but would be no better than having no system at all. They do not give the false positive rate but it is highly unlikely to be less than 10 percent and may be much larger. Since the ratio of terrorists to non-terrorists is probably on the order of a billion to one a system with an unrealistically low 1 percent false positive rate will flag 10 million non-terrorists for every 0.5 terrorists if it has a 50 percent correct ID rate. Even if you do extra searches on those 10 million people, with a 50 percent correct ID rate the terrorist is just a likely to be in the 990 million people who do not get flagged as in the flagged group.
You need a close to 100 percent correct ID rate and a false positive rate below one in a million, which is probably impossible, before the system would be of any use. However all this assumes that you have pictures of all terrorists. This is just plain impossible, especially in the case of suicide attacks. This is not like bank robbers where there are multiple incidents allowing evidense from witnesses etc. to be used to catch them when they try again. With suicide attack the attackers will likely be model citizens (who will not be on any list) right up until the attack and afterwards any info on them that is gathered is close to useless.
I think the concept is being distorted (Score:5, Interesting)
Finally someone gets it! (Score:2)
Funny how the tinfoil-hat crowd automatically assumes the worst when something like this pops up.
Re:Finally someone gets it! (Score:3, Insightful)
1) They aren't any more effective than human personal, and unless they have an unrealistically low false-postive rate, they actually generate more work than they're worth
2) As anyone who's been to (or worked in) a DMV knows, there's basically 2 human reponses to computerized systems like this: a) you ignore the computer whenever it disagrees with you or b) you always obey the computer, no matter what. Unless you've got fantastically high sucess rates, b is exactly what the t
Same old song and dance.... Snake oil sir? (Score:5, Insightful)
As with most biometric systems, this is only ever works reliably in a lab.
Remeber the fingerprint system that got fooled by gelatine-gummi's ?
I wonder when these dot-bomb ideas will stop popping back up, and more credible research will get the much needed funds.
There is only one thing that has ever been able to recognize the human face; other humans. (And we do a rather poor job of it too after 10 million years of evolution!!!)
Proof: Take your average ignorant North American, (like myself) and ask him to tell the difference between 3 different Asian individuals. There is a good chance that we would fail that test because we are not used to (or mentally trained to) spot the difference.
{I love using myself for proof, it's so scientific}
Once again... (Score:5, Insightful)
Once again, the false positives are not given. That is the number that really matters in a society where you can be held in prison indefinitely without a trial or access to a lawyer.
Typical results when a product is misused (Score:5, Interesting)
Re:Typical results when a product is misused (Score:5, Insightful)
There are 2 problems with this, though:
The first is the false-positive rate. Visage is saying that, nine times out of ten, they can tell if the person being presented for inspection matches the photo. But what if they incorrectly flag one out of every fifteen users as *not* matching the picture? More work for Border control, that's what. The Mark One Eyeball is still the fastest, cheapest, best tool for comparing photos to people.
Second, it pays no mind to *false* papers with *correct* photographs. Sure, their fancy system will say "Yup, the person pictured is standing in front of you!" but if the underlying documentation is fake, so what?
Visage is a private company chasing lucrative federal dollars. All they need to do is create a product good enough to persuade Federal agencies to buy it - they don't actually need to make sure it does anything useful.
"Fails"? (Score:2, Interesting)
Also, what's the worry about false positives? If and when they happen, it's a simple matter to clear up a person's real identity. It's not like they shoot first and ask questions later.
Re:"Fails"? (Score:2, Insightful)
Not quite, but they can hold you indefinitely, without access to a lawyer, without notifying your family, without even charging you. Better, but not by much. Thats OK, because terrorists are ++ungood and we'll trample any rights needed to preserve freedom.
Re:Paranoid loser (Score:2)
Re:Luh-luh-looser (Score:2)
Re:Luh-luh-looser (Score:2)
Truth? The link you provided doesn't include any more truth than the Wired story, just that he plead guilty, instead of continuing to be held indefinitely against his will.
You're aware that a confession [ccadp.org] doesn't necessarily mean that the person is guilty, right? (And don't think [nwsource.com] that this [post-gazette.com] doesn't happen [msn.com] in the US [northwestern.edu].
"limited" access is not the same as "no access,"
So, it's OK to violate someone's constitutional rights, as long as it's only a little bit, ri
Re:I'd imagine (Score:2)
On a side note, I'd be interested to know what you think would be neccesary for someone who consistently trips a false positive to prove his innoncence, and how hard it would be for someone who SHOULD be
Where's the false positive data? (Score:3, Insightful)
What you don't want is harassing innocent people. If we can aviod that, I don't see where the problem is.
Have you kicked your kitten lately? [smalltownradioshow.com]
Biometric sagaLong string of failures (Score:3, Interesting)
First, a poster of someone else's face (facial recognition evasion).
Second, the goey fingerprint duplicator,
now this walk-by signature hacker on a PDA?
What would be next?
Hijacking IRIS pattern (simply stareing at the bathroom mirror)?
Stolen DNA pattern?
There is no solid defense against unrevokable but stolen biometric parameters.
Re:Biometric sagaLong string of failures (Score:2)
In high trust systems it would probably use atleast 2 biometric parameters + some type of password scheme.
Your email and website URL's are childishly easy to parse.
Not too shabby (Score:2)
Think about it in terms of spam. No one solution will stop 100% of the spam destined for your e-mail address. It takes a combination of methods (and even then, you can only approach 100%, never achieve it).
The same attitude should be taken in airports. A system should not be dropped because it's not 100% effective. It should be used to strenghten existing and future security.
Re:Not too shabby (Score:2, Insightful)
Re:Not too shabby (Score:2)
For picking faces out of a crowd, the 61% success figure is totally meaningless without the false positive rate, so we
Why was it even deployed? (Score:3, Insightful)
Re:Why was it even deployed? (Score:2)
Can't see how it will work (Score:2)
You need very high quality images for recognition to work well. Try OCR-ing a badly skewed very low resolution scan and that's just text.
With facial recognition you have to worry about shadows, different angles, glasses, changing hairstyles, facial hair and so on....
My disguise (Score:5, Funny)
Engineers == naturally stoned (Score:5, Funny)
It sounds like something a couple of potheads thought up.
Engr1: Dude, you know what'd be awesome? We could make a widget that recognizes faces, then we could put it at the door so we'd know if it was the pizza guy knocking.
Engr1: Whoaaa dude, that'd be awesome. Pass the caffeine.
Re:Engineers == naturally stoned (Score:2)
He's talking to himself. (Engineer 1, meet engineer 1).
Re:Engineers == naturally stoned (Score:3, Funny)
Engr1 : Dude, pass me the caffeine.
Engr1 : Dude, you *already have* the caffeine.
Engr1 : Whoa. Hey, I do have it. I thought you had it, dude.
Engr1 : Dude, you've had it all along.
Engr1 : Whoa.
Engr1 : Whoa.
Facial recognition should not be the only system (Score:2)
If facial recognition technology is used alone to try to catch criminals, of course it will fail. However, when used in conjunction with other systems, even a low success rate can be helpful.
I have no idea how the system works, but my guess is that it was spitting out "definitely yes" or "definitely no" when it should instead be offering an estimate. "73% chance that this guy is the same person as this felon who is on the lam".
It's not the kind of thing that stands up in court, but it is the kind of thi
Two things we also need to know (Score:2)
That being said, the test itself doesn't sound very good. It's quite easy to fake tests of software, especially if you have a limited pool of data, or know what you're looking for ahead of time. It's possible the result would be even worse in actual usage.
Twins? (Score:5, Interesting)
I'm an identical twin, I've had my lights punched out by someone who thought I was him (Thanks bro..grumble)...
Anyone able to tell me how this would differentiate between siblings that look very very much alike?
Re:Twins? (Score:2)
Grow facial hair (or, if you both have facial hair, shave).
We looked identical when we were both sporting goatees. Now that I'm clean shaven, I rarely get mistaken for my brother, just as someone who looks a whole lot like him.
Of course, if you're an identical female twin reading this comment, well...if you grow facial hair, people will *definitely* be able to tell you apart!
Re:Twins? (Score:3, Funny)
Re:Twins? (Score:4, Funny)
Two words (Score:2)
I'll be happy not to have the computers tracking my face thank you very much. Too much of a pkdick idea I think.
But what about the system installed in London, England?
simon
London (Score:2, Flamebait)
That one doesn't track faces per se. It indexes along bad teeth.
Don't worry, be happy! (Score:2)
However, it may be useful while using it with a passport picture. In fact, last week, canadian government advise passeport requesters they will be refused if the picture doesn't conform to a new requirement. It is strictly forbidden to smile on your passeport picture. I don't know the name of the faces recognition software they use, but it is likely it may be completely by pass by too mu
technology is neutral (Score:3, Insightful)
Yes, these technologies are failing alot. But, just a couple of years ago, people would have scoffed at the idea that computers could even begin to accomplish some kind of face-recognition. This technology is in it's infant stages. I don't think you can blame a technology that's just gotten off the ground for not being perfect.
Lets criticize improper uses of this technology, not the technology itself.
Re:technology is neutral (Score:2)
Yes, but it would suck if 40% of the time, I wasn't able to withdraw funds because it didn't correctly identify me.
I think the whole point of this article is that the technology doesn't work. It can't do a good job with face recognition. A 60% success rate works well for some things -- It's a really great batting average, for example -- but for crime detection/prevention, I'm guessing that's pretty lousy and not cost effectiv
the program didn't fail... (Score:2)
Can't we focus on something besides their accuracy (Score:4, Insightful)
Proposals for facial recognition systems continue to be shot down because of their inaccuracy, but why does it have to be their inaccuracy that is the sticky point. Shouldn't the fact that they constitute a massive invasion of privacy be all the argument we need?
If we continue to use the "accuracy" argument over and over, then what happens when a system that is proven to be fully accurate comes out?
Facial Recognition Systems aren't a bad idea becuase they're inaccurate, they're simply a bad idea -- and that is what we should focus on.
Too Many False Positives (Score:4, Informative)
According to the Logan report, which was written by an independent security contractor, "the number of system-generated false positives was excessive, and as a result, the operator's workload is taxing and strenuous, requiring constant undivided attention and periodic relief, which amounts to a staffing minimum of two persons for one workstation."
we need quantum computers! (Score:4, Funny)
A Contrarian Take On This (Score:3, Interesting)
The government saw once of its "law enforcement" / "war on terrorism" programs was ineffective and (gasp!) dropped it.
Isn't this exactly what we're *not* supposed to see from this bloated, non-responsive, heavy-handed bureaucracy/police-state that the libertarians/progressives bash all the time?
They had a trial run of a new, controversial idea and it didn't work. Isn't that exactly the sort of innovation and creativity people claim "big government" sorely lacks?
61%? I know why it didn't work... (Score:3, Funny)
I've taken the libery of fixing it. Now we can finally replace those hard-working security screeners: No thanks needed; I'm just glad I could help my country.
Canadian no smile rule just the start (Score:3, Interesting)
Geez, you people could at least read the headline! (Score:4, Informative)
Re:Geez, you people could at least read the headli (Score:3, Informative)
Re:Geez, you people could at least read the headli (Score:3, Informative)
Re:Face recognition (Score:4, Informative)
Re:Face recognition (Score:2)
If you mean by "misinformed" something other than "having read much of the technical literature available", you're wrong. I have.
As to the "making up statistics", it was admittedly hasty to post from memory rather than looking it up. Actual tests show 0.3% false positive in "controlled" (i.e. setup) situations, and 10% false positive in real situations. So, twice as bad as in the post you responded
Re:Face recognition (Score:4, Interesting)
The current tech certainly is imperfect. However, it does offer the potential to allow increased scrutiny of a subset of passengers. This alone has value. We just have to decide how many false positives we can manage.
Just contemplate if 5 of the 10 hijackers at Logan had been detected. Every little bit can help.
Re:Face recognition (Score:3, Insightful)
Re:Site slowing - here's the text (Score:2)
ass-recognition, eh.
I wonder if how my (male) co-workers would compare. It seems like they can sense an ass before it's even in the room. Unfortunately for our national security, their sensors only work on female "terrorists" which are significantly less prevalent as compared to their male terrorist