NO2ID

NO2ID

NO2ID's ID Card & Database State Online Discussion Forum
 
It is currently Sun, 19 May 2013 00:38:14 +0000

All times are UTC




Post new topic Reply to topic  [ 24 posts ] 
Author Message
 Post subject: Biometrics trials
PostPosted: Wed, 24 Sep 2008 11:18:03 +0000 
Offline
A-List
A-List

Joined: Sat, 07 Apr 2007 10:29:05 +0000
Posts: 2842
BBC: Passengers test new face scanners
Flight Int'l: Airport IT trends 2008

As noted, not least by Guy, these trials are known to be a waste of time.
The Home Office know the technology doesn't work.
There is no good reason to pursue the trials.
Pursuing them can only lead to embarrassment and unrest.
Embarrassment and unrest which could be staved off if the Home Office's own biometrics expert would speak to the public.
I sent an email to that effect.
A response was received, informing me that the email was being treated as an FOI request.
An FOI response was subsequently received.
That has now been replied to.
And a press release has been issued.

_________________
http://DematerialisedID.com
http://DMossEsq.com


Report this post
Top
 Profile  
Reply with quote  
 Post subject:
PostPosted: Mon, 06 Oct 2008 12:39:47 +0000 
Offline
A-List
A-List

Joined: Sat, 07 Apr 2007 10:29:05 +0000
Posts: 2842
Telegraph: Security fear over airport face scanners
(as spotted by an alert guest):
Quote:
"Up until the point of the official launch, [the facial recognition equipment] was rejecting 30 per cent of those who tried to get through it," the UKBA worker said.

"We believe they had to recalibrate it – essentially make it easier to get through the system."


My 24 September reply to Home Office Scientific Development Branch (HOSDB) includes the following:
Quote:
The current trials of biometrics based on facial recognition at Manchester airport and other places need, therefore, to be conducted to the highest standards, if they need to be conducted at all. Confidence needs to be restored. Could you or Mr Rejman-Greene please tell me or the public how the trials are being controlled. Are there independent observers monitoring the process? How long are the trials due to go on? How many people do you intend to go through the trials before declaring them a failure (or a success)? When will the results be published and who by? What acceptance tests have been set in advance?


HOSDB's 25 September reply says:
Quote:
Thank you for your e-mail of 25/09/2008 in which you ask for information regarding introduction of facial recognition in airports. Your request is being handled again in accordance with the Freedom of Information Act 2000 as a request for information.

We aim to send you a full response within 20 working days or receiving your request. You should receive this response by Thursday 16 October


We may discover from the 16 October reply whether there are any controls on the facial recognition trials.

_________________
http://DematerialisedID.com
http://DMossEsq.com


Report this post
Top
 Profile  
Reply with quote  
 Post subject:
PostPosted: Thu, 08 Jan 2009 14:17:33 +0000 
Offline
A-List
A-List

Joined: Sat, 07 Apr 2007 10:29:05 +0000
Posts: 2842
A reply was received from Marek Rejman-Greene dated 14 October 2008.

An initial response was sent on 2 January 2009 asking HOSDB to explain to the public why money is being spent on the biometrics trial at Manchester airport when facial recognition has such a poor record.

A fuller response was sent today, broadening the issue to cover fingerprints as well as facial recognition, and irisprints.

The Home Office have always claimed that the 2004 UKPS biometrics enrolment trial was a usability trial and not a reliability trial. That allows them to assert that the pitiful performance of the biometrics revealed by the trial is irrelevant. Today's letter argues that the distinction is nonsensical. Usability is assessed throughout Atos Origin's report on the UKPS trial in terms of reliability. The two cannot be separated.

The use by Australia and Portugal of so-called "SmartGates" to check airport passengers through immigration is used by HOSDB to give credence to the Manchester airport trial. No evidence of the reliability of the Australian and Portuguese systems is adduced and the Australian Customs have explicitly refused to provide it. I have asked HOSDB to be more open than the Australians about the Manchester airport trial.

Biometrics experts make a distinction between verification and identification. Identification is much harder than verification. Proving that the bearer of an ID card is the person to whom it was issued is one thing, verification. Proving that they are unique and have one and only one record on the NIR is another, identification, and considerably harder. The suggestion is made in today's letter that upright biometrics experts have given up on identification. They still cleave to verification, more or less precariously, but only confidence tricksters still claim that today's mass consumer biometrics can deliver identification.

Let's give it a few weeks. Then we shall see ...

The point is made explicitly in today's letter that it is an open letter.

_________________
http://DematerialisedID.com
http://DMossEsq.com


Report this post
Top
 Profile  
Reply with quote  
 Post subject:
PostPosted: Wed, 11 Mar 2009 16:58:56 +0000 
Offline
A-List
A-List

Joined: Sat, 07 Apr 2007 10:29:05 +0000
Posts: 2842
No response has been received to the letters dated 2 and 8 January 2009. A letter has been sent asking for a response.

The Manchester airport trial should have finished some time in February. The same letter asks when the results will be published.

Please see.

_________________
http://DematerialisedID.com
http://DMossEsq.com


Report this post
Top
 Profile  
Reply with quote  
 Post subject:
PostPosted: Wed, 11 Mar 2009 18:05:42 +0000 
Offline

Joined: Tue, 18 Sep 2007 07:12:34 +0000
Posts: 56
Keep it up David. I am sure that at times it must feel like you are tilting at windmills. But there are folks behind you, never forget.


Report this post
Top
 Profile  
Reply with quote  
 Post subject:
PostPosted: Thu, 12 Mar 2009 00:54:42 +0000 
yes, and this website is a godsend


Report this post
Top
  
Reply with quote  
 Post subject:
PostPosted: Fri, 27 Mar 2009 17:38:00 +0000 
Offline
A-List
A-List

Joined: Sat, 07 Apr 2007 10:29:05 +0000
Posts: 2842
No replies have been received to my letters dated 2 January 2009, 8 January 2009 and 11 March 2009. These letters are posted and emailed to the Direct Communications Unit of the Home Office. Not only are there no replies. They have not been acknowledged.

So I tried some indirect communications. Someone with some genuine authority intervened and asked for a reply from the Director of Research, Development & Statistics at the Home Office. No response from the Director so far but today's post brought this from IPS:
Quote:
Home Office
Identity &
Passport Service

Mr David Moss
xxxxxxxxxx
xxxxxxxxxx
xxxxxxxxxx

Our reference NBIS DJWOI0/09

Date: 20 March 2009

Dear Mr Moss

CORRSPONDENCE WITH xxxxxxxxxx

Thank you for your letter to xxxxxxxxxx, which has been passed to me.

I can agree that biometric determinations of identity are probabilistic, in the sense that any determination of identity has a finite error rate associated with it. I can however assure you that the Government and the Civil Service is well aware of this fact. As an example, you may be aware of the following submission to the House of Commons Select Committee on Science and Technology made in 2006:

“The matching of newly enrolled biometrics against all those already enrolled may not be 100% reliable, raising the risk that a very small number of people may be able to enrol more than once without authorisation.”

The issue however is not one of whether biometrics is probabilistic or not, as you will be aware many business processes will have some error level. The issue is whether the error level is sufficiently low to enable appropriate use of the technology. You will be aware that there are a number of large scale biometric systems already in use, US-VISIT being one example. Furthermore the UKBA’s biometric visa system has fingerprinted over 2.8 million people and so far has detected 3500 instances of attempted identity fraud.

Therefore I am afraid I cannot agree with your statements that biometrics will not work, when we have clear and current evidence that it does.

In your correspondence you appear to be concerned about the issuance of multiple identities. I would like to take this opportunity to clarify that the purpose of the biometric system is not to guarantee that this cannot happen but to provide an additional mechanism over and above the ones that are in use today for detecting and deterring fraud. Viewed in this way, biometrics makes a very substantial contribution to fraud detection.

Thank you for your interest and I trust that the above has provided you the assurance you require.

Yours faithfully,
xxxxxxxxxx
On behalf of the Identity and Passport Service

This letter ignores most of the points raised. What with that and the failure even to acknowledge three earlier letters, it seems legitimate to infer that the Home Office can't and/or don't want to answer these questions about biometrics. They have something to hide. They are not telling the public the whole truth and nothing but the truth about the technology on which so many of their plans depend.

Even when they try to say nothing, though, they fail. This 20 March 2009 letter of theirs undermines the repeated claim that biometrics can be used to "lock" people "securely" to a "single identity". Now, it seems, that cannot be guaranteed after all, the magic has gone out of biometrics, now they merely "provide an additional mechanism over and above the ones that are in use today".

_________________
http://DematerialisedID.com
http://DMossEsq.com


Report this post
Top
 Profile  
Reply with quote  
 Post subject:
PostPosted: Fri, 27 Mar 2009 18:17:11 +0000 
Offline
A-List
A-List

Joined: Fri, 04 Aug 2006 12:05:45 +0000
Posts: 1654
Location: Shrewsbury
Home Office, Identity & Passport Service wrote:
Furthermore the UKBA’s biometric visa system has fingerprinted over 2.8 million people and so far has detected 3500 instances of attempted identity fraud.

... or would that be 3500 matches, most of which are false positives that obscure the attempted identity frauds and scare the innocent people who fall randomly under suspicion?

Keep hammering away David, you'll get there in the end!

_________________
Rob Findlay
And you all know, security / Is mortals' chiefest enemy. (Macbeth)


Report this post
Top
 Profile  
Reply with quote  
 Post subject:
PostPosted: Mon, 30 Mar 2009 11:06:24 +0000 
Offline
D-List
D-List

Joined: Thu, 10 Jan 2008 14:27:42 +0000
Posts: 389
David Moss wrote:
Even when they try to say nothing, though, they fail. This 20 March 2009 letter of theirs undermines the repeated claim that biometrics can be used to "lock" people "securely" to a "single identity". Now, it seems, that cannot be guaranteed after all, the magic has gone out of biometrics, now they merely "provide an additional mechanism over and above the ones that are in use today".


Great work David.


Report this post
Top
 Profile  
Reply with quote  
 Post subject:
PostPosted: Sun, 31 May 2009 09:43:44 +0000 
Offline
A-List
A-List

Joined: Sat, 07 Apr 2007 10:29:05 +0000
Posts: 2842
First draft, subject to minor changes, links will be added later, notes on a 43-minute telephone conversation with Marek Rejman-Greene (MRG), head of the Biometrics Centre of Expertise at the Home Office Scientific Development Branch (HOSDB), Friday 29 May 2009.
----------

MRG kindly started by apologising for the failure to reply before to the January letters.

He advised that it is best to approach the Identity & Passport Service (IPS) and the UK Border Agency (UKBA) for information. I made the point that it is because of the difficulty of getting any sensible response out of IPS that I approached HOSDB. MRG believes that there is a new director of communications at IPS and that may improve the situation.

MRG advised that the IPS and UKBA systems such as the National Identity Scheme (NIS) and eBorders need to be looked at in the round. It is not biometrics alone but the total system, including biographical information, that fixes a person's identity in the NIS. He advised that I should look again at the strategic action/business plans published by each organisation.

I made the point that politicians and civil service press releases have consistently claimed for years that it is specifically biometrics that distinguish the NIS and eBorders from all the other unreliable identification systems we already have. MRG could not comment on that. HOSDB make their recommendations, after that it is up to IPS and UKBA what they do with them, and he referred me back to their strategic action/business plans.

UKBA are conducting their trial of facial recognition at Manchester airport. Trials can demonstrate that the technology doesn't work. And yet UKBA have already promised to roll out the technology to 10 UK airports this year. That's not logical. They're prejudging the trial, I said. I should take that point up with UKBA, MRG said. (I have already taken it up with Sir David Normington, with the usual response. None.)

There have been newspaper reports that the technology being used at Manchester airport can't tell the difference between Osama bin Laden and Winona Ryder. MRG couldn't comment on that.

We discussed the reliability of facial recognition and flat print fingerprints. MRG thinks that they are not as unreliable as I suggest in the January letters. My figures are old/out of date/behind the times – he mentioned the advent of a "cascading" algorithm introduced into US-VISIT. And he adheres to the claim that the UKPS biometrics enrolment trial was not a trial of reliability, i.e. I am drawing my figures from the wrong source.

Those two points and others raise the question whether there is a large-scale trial of today's biometrics whose independently reviewed results demonstrate that they have become more reliable. A question which I pressed, and MRG duly came up with the NIST report on FRVT2006, which I defy anyone to be convinced by. Of course NIST have a good name, as MRG said, the problem is that they seem to diluting their good name, I said, when it comes to their reports on biometrics.

Pressed further, he said that there is reliable trial data available all over the web, particularly the data provided by biometrics system suppliers. That data is the problem, I pointed out, it is the claims made by suppliers and subsequently refuted by actual trials which got me and other people looking into the reliability of biometrics.

Pressed again, MRG came up with the example of UKBA collecting people's flat print fingerprints from all over the world for the purpose of visa applications. Those prints are being collected at the rate of two million a year, that is a large-scale trial, and they work – hundreds of people have been discovered, thanks to the use of biometrics, to have made previous applications under different identities.

That evidence is not admissible in court, I said. MRG said he is not a lawyer and can't comment on that.

That evidence demonstrates that perhaps when flat prints match, they are reliable, I said, the problem is when they don't match. If the false non-match rate is around 20% (a figure MRG does not "recognise"), then 20% of ID cardholders will have trouble proving their right to work in the UK, if that depends on biometrics, as IPS suggest it will. Straight bat, MRG referred me back to UKBA, and then added something like "we hold the false non-match rate evidence internally but it can't be released because it would make it easier for people to evade detection".

I do not understand this point of his, he would not elaborate, he said nothing when I pointed out that that is not like the normal open way in which scientific data is treated and he referred me back to UKBA and IPS.

_________________
http://DematerialisedID.com
http://DMossEsq.com


Report this post
Top
 Profile  
Reply with quote  
 Post subject:
PostPosted: Sun, 31 May 2009 13:07:45 +0000 
Offline
A-List
A-List

Joined: Fri, 04 Aug 2006 12:05:45 +0000
Posts: 1654
Location: Shrewsbury
Good terrier-work, David!

_________________
Rob Findlay
And you all know, security / Is mortals' chiefest enemy. (Macbeth)


Report this post
Top
 Profile  
Reply with quote  
 Post subject:
PostPosted: Sun, 31 May 2009 14:12:17 +0000 
Offline
A-List
A-List

Joined: Sat, 07 Apr 2007 10:29:05 +0000
Posts: 2842
Thank you, Cap'n.

_________________
http://DematerialisedID.com
http://DMossEsq.com


Report this post
Top
 Profile  
Reply with quote  
 Post subject:
PostPosted: Sun, 31 May 2009 14:13:20 +0000 
Offline
A-List
A-List

Joined: Sat, 07 Apr 2007 10:29:05 +0000
Posts: 2842
Quote:
From: David Moss
Sent: 31 May 2009 14:36
To: Marek Rejman-Greene
Subject: Notes on telephone call, 29 May 2009


Dear Marek

Thank you for giving me so much of your time on Friday. It is greatly appreciated and I shall continue, as you suggest, to address myself to IPS and UKBA. I have written up some notes on our discussion, http://forum.no2id.net/viewtopic.php?t=24197, Sun, 31 May 2009 09:43:44. If there are errors/omissions you would like corrected, I am sure you will tell me.

Best wishes
dm

_________________
http://DematerialisedID.com
http://DMossEsq.com


Report this post
Top
 Profile  
Reply with quote  
 Post subject:
PostPosted: Sun, 31 May 2009 17:43:54 +0000 
Offline
Site Admin
Site Admin

Joined: Sun, 09 Jan 2005 18:23:13 +0000
Posts: 9900
Location: Cambridge
Thanks for the summary, David - very useful.

David Moss wrote:
Straight bat, MRG referred me back to UKBA, and then added something like "we hold the false non-match rate evidence internally but it can't be released because it would make it easier for people to evade detection".

This is not a tenable position for an agency that is using public money to create what it claims will be the "gold standard of identity".

If we are all supposed to trust the National Identity System to infallibly "link each person to one identity", we must have independently-verifiable evidence of its accuracy. If the NIS is to be used to assert identity in legally-binding transactions, its reliability will eventually be challenged in court, and if the engineers who created it refuse to produce data on its accuracy then the courts will throw out NIS-based evidence of identity.

For legal analogies, see the "Phantom withdrawal" cases:

http://catless.ncl.ac.uk/risks/18.25.html#subj5

http://www.lightbluetouchpaper.org/2008 ... -at-least/

http://www.cl.cam.ac.uk/~rja14/Papers/liability.pdf

In one of these documents, Prof. Ross Anderson summarises:

Ross Anderson wrote:
For the computer security community, the moral is obvious: if you are designing a system whose functions include providing evidence, it had better be able to withstand hostile review. This is understood by designers of forensic systems, and the value of hostile review is also well known to the military and the utilities. But with one or two exceptions - such as SET - the banks are just not on the same planet, and the risk to them should be clear!

Foreign visa applicants refused entry to this county because the UKBA says they're someone else have limited legal redress. On the other hand, when (not if) identity evidence from the proposed NIS is challenged in court, the Home Office will have to present the technical basis for their evidence, or the case will be thrown out of court.

"We have the evidence, but it's secret" is simply NOT acceptable.

_________________
Andrew Watson


Report this post
Top
 Profile  
Reply with quote  
 Post subject:
PostPosted: Sun, 31 May 2009 18:42:52 +0000 
Offline
A-List
A-List

Joined: Fri, 04 Aug 2006 12:05:45 +0000
Posts: 1654
Location: Shrewsbury
Andrew Watson wrote:
National Identity System

Like it!
An accident? One of yours? One of Guy's?

_________________
Rob Findlay
And you all know, security / Is mortals' chiefest enemy. (Macbeth)


Report this post
Top
 Profile  
Reply with quote  
 Post subject:
PostPosted: Mon, 01 Jun 2009 09:05:42 +0000 
Offline
Site Admin
Site Admin

Joined: Sun, 09 Jan 2005 18:23:13 +0000
Posts: 9900
Location: Cambridge
capnbob wrote:
Andrew Watson wrote:
National Identity System

Like it!
An accident? One of yours? One of Guy's?


Ooops - a slip on my part. This is the new name that the Home Office is using for the NIS, instead of "National Identity Scheme", which they no-doubt want to stop using because someone has told them it sounds vaguely sinister. Needless to say, I'm trying to carry on calling it a "Scheme" not a "System".

However, I think it's even better just to call it the "ID cards Database". I was amused to hear a junior minister tying herself in knots on "Woman's Hour" a few months ago, trying to avoid calling ContactPoint a "database". I suspect a briefing has gone out within government that "Database" has negative connotations in the public's mind, and the word must not be used in official statements. It therefore follows that we should refer to these databases by that name whenever we get the chance.

_________________
Andrew Watson


Report this post
Top
 Profile  
Reply with quote  
 Post subject:
PostPosted: Mon, 01 Jun 2009 09:32:49 +0000 
Offline
C-List
C-List

Joined: Fri, 07 Oct 2005 08:30:46 +0000
Posts: 799
Location: Edinburgh
Andrew Watson wrote:
Ooops - a slip on my part. This is the new name that the Home Office is using for the NIS, instead of "National Identity Scheme", which they no-doubt want to stop using because someone has told them it sounds vaguely sinister. Needless to say, I'm trying to carry on calling it a "Scheme" not a "System".

But, of course, the NIS we really must stop them getting away with is the "National Identity Service". A more appropriate acronym would quite clearly be NID: "National Identity Disservice"...

_________________
John
http://www.jwelford.demon.co.uk/


Report this post
Top
 Profile  
Reply with quote  
 Post subject:
PostPosted: Mon, 01 Jun 2009 13:57:15 +0000 
Offline
A-List
A-List

Joined: Fri, 04 Aug 2006 12:05:45 +0000
Posts: 1654
Location: Shrewsbury
As John says, the new moniker is "Service", isn't it? I thought "System" sounded quite sinister...

_________________
Rob Findlay
And you all know, security / Is mortals' chiefest enemy. (Macbeth)


Report this post
Top
 Profile  
Reply with quote  
 Post subject:
PostPosted: Mon, 01 Jun 2009 15:23:26 +0000 
Offline
Site Admin
Site Admin

Joined: Sun, 09 Jan 2005 18:23:13 +0000
Posts: 9900
Location: Cambridge
capnbob wrote:
As John says, the new moniker is "Service", isn't it? I thought "System" sounded quite sinister...

Hmmm ... I think you may be right. Perhaps I really should just stick to calling it "The Database"!

_________________
Andrew Watson


Report this post
Top
 Profile  
Reply with quote  
 Post subject:
PostPosted: Wed, 03 Jun 2009 15:20:46 +0000 
How about "Shysters"?


Report this post
Top
  
Reply with quote  
 Post subject:
PostPosted: Thu, 04 Jun 2009 00:34:35 +0000 
David, thanks so much for keeping on keeping on with this. It's extremely useful stuff.


Report this post
Top
  
Reply with quote  
 Post subject:
PostPosted: Thu, 20 Aug 2009 00:00:40 +0000 
Offline
A-List
A-List

Joined: Sat, 07 Apr 2007 10:29:05 +0000
Posts: 2842
Response to IPS letter dated 20 March 2009. http://dematerialisedid.com/BCSL/Fantasy.html.

_________________
http://DematerialisedID.com
http://DMossEsq.com


Report this post
Top
 Profile  
Reply with quote  
 Post subject:
PostPosted: Tue, 25 Aug 2009 23:45:12 +0000 
Offline
A-List
A-List

Joined: Sat, 07 Apr 2007 10:29:05 +0000
Posts: 2842
Response from IPS, 25 August 2009, http://dematerialisedid.com/BCSL/IPS20090825.html

_________________
http://DematerialisedID.com
http://DMossEsq.com


Report this post
Top
 Profile  
Reply with quote  
 Post subject:
PostPosted: Wed, 26 Aug 2009 18:52:41 +0000 
Offline
A-List
A-List

Joined: Mon, 10 Jan 2005 22:33:24 +0000
Posts: 1823
Location: Tipperary
From the reply sent on behalf of Mr James Hall-

Quote:
The Government's proposals are designed to safeguard, not erode, civil liberties by protecting people's true identity


The fact that otherwise intelligent people can make such claims with hardly a blush is a disturbing indictment of the group think that has set in at the Home Office. Do they really believe this, has their idea of what is actually meant by civil liberties been so corrupted by their own propaganda that they no longer see how contemptuous of the individual such an attitude is? Or maybe it is a desperate bid to justify, to themselves as much to anyone else, what they are doing and so preserve their position and safeguard their jobs.

Faced with such wilful stupidity it may be that a halt to it all will be called and the head of the IPS will then be encouraged to pursue a lucrative career in the private sector as an IT consultant, just like his colleague from the NHS, a certain Mr Richard Granger of their ill fated national IT Programme. Let us hope also that he meets with better luck for as Private Eye reports of Granger-

The demand for his computer expertise now seems to be sadly limited, as a report from the Governments advisory committee on business appointments reveals that he has become a "geological consultant", apparently trading on a 22 year old 2:2 geology degree.

It would be interesting to see just how high Mr Hall's services are valued outside of the civil service where he would be expected to actually do something useful instead.

Justin.

_________________
I am his highness' dog at Kew;
Pray tell me, sir, whose dog are you? Pope.


Report this post
Top
 Profile  
Reply with quote  
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 24 posts ] 

All times are UTC


Who is online

Users browsing this forum: No registered users and 0 guests


You can post new topics in this forum
You can reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group
Template made by DEVPPL/ThatBigForum