Paraphrasing the crux of the issue: "It's regular practice in Colorado to list license plates with both versions, the one with 'O's and the other with Zeros in the warrant list."
Insane. Practice.
As always, this story has have nothing to do with the cameras or AI, but "law enforcement has an insane lazy practice" doesn't make for a very good headline anymore.
Using a third-party to bypass legal restrictions should in and of itself be considered willful and knowledgeable intent to violate the Constitution under color of law, regardless of the specific actions taken
I'm not convinced they can always get around it... I think they could challenge their arrest in court on Fourth Amendment grounds and have a chance at winning:
>In the 2018 case Carpenter v. United States, the Supreme Court affirmed that individuals have a reasonable expectation of privacy in their long term movements (even in public spaces) and, because of that expectation, queries into long term location tracking data constitute a Fourth Amendment search that requires a warrant.
I suppose they would also have to argue that they are not the actual target of the warrant.
My problem with this is that Flock explicitly does not manage their own equipment or store data obtained by cameras installed by their customers on any Flock-owned servers, so I'm not sure how they would be tipped off to anyone from outside the police department.
And if that did happen, I feel like one could have a strong case against it by claiming that there is no reasonable way to have had that information without obtaining it illegally.
How are they not an 'agent of the state' and how does the 4th not apply? If the government asked for the scan/info on the vehicle, they are acting on behalf of the government?
Flock claims that "Fourth Amendment case law overwhelmingly shows that LPRs do not constitute a warrantless search because they take point-in-time photos of cars"
And that may be true, however Carpenter v. US established that long-term tracking of a person's location without a warrant is still not allowed under the Fourth Amendment.
As we've seen with multiple incidents across the country, police largely don't want to be a human check. They want the computer to tell them who to arrest, regardless of facts in reality.
This story also wouldn't exist without license plates. License plates are IDs into a state registry of cars prominently placed on the car, in order to make it easy for anyone who sees it, including cops, to identify that car to the criminal justice bureaucracy later. The same issues with Flock cameras correctly identifying the letters and numbers on the plate and then informing law enforcement, which uses them as an index into a corrupted database, apply to any other system, including a human being looking at the car. Any argument for getting rid of Flock cameras for this reason also applies to getting rid of license plates themselves.
And maybe we should get rid of license plates. What breaks if we abolish them, and neither cops nor anyone else is capable of running a license plate number search on the non-existent license plates of the cars around them?
This wouldn't be a story if the cops did not put the wrong license plate in the system. How is it Flock's fault? Flock is just doing what it is being asked to do!
Let me put in simple terms: Flock flags license plates that are given to it. Someone, somewhere says, license plate "ABCD1234" has a warrant out.
And guess what, if Flock sees that plate, it _will_ flag it each. and. every. time!
Tomorrow, say an "Amber Alert" is issued for a pink Ford Taurus with plate "PINKLADY" (when in fact it was a red Taurus with the plate "MADLAD"). Don't you think anyone driving around in a pink Ford Taurus with that plate should be pulled over?
How are all these dead baby seals Flock's fault? They simply released the Auto Baby Seal Clubber 9000 on beaches that have baby seals. It's the people that keep submitting "club baby seals" to the system that are the problem.
What I want to know is who is manufacturing these police cars that let these cops travel to execute unlawful warrants. "Oh, but it's not our fault. We just built due-process-violation machines. It's the police who are driving them to citizen's locations and violating due process." Come on.
Pigeonholing responsibility onto one party is what allows these mutually-dependent systems to point fingers at one another to escape blame. Rather, the responsibility here is shared. If you want to focus your call for reform on the police (for both making an overly-broad list, and also for harming innocent motorists without compensating them for the damage), then I agree that's more appropriate for this particular problem. But don't absolve Flock.
If Flock flags license plates at the request of the government, it is acting as an agent of the state and is required to meet governement/constitutional requirements.
How does flock get around this? It can't be an agent of the state AND be private and exempts from 4th amendment/all constitutional requirements?
Solari: No sir, unless he was for some reason acting on behalf of the government or had been asked by a government agent to do that. Unless that were the case then if that person was acting in his own private capacity as a UPS or FedEx employee then he would not be a government agent for 4th Amendment purposes.
Miller: Can private parties ever trigger the 4th Amendment?
Solari: Yes, as we discussed, if a private party were to be acting at the behest of the government -- if a government agent were to ask that FedEx person to open up a package and look inside, or to ask someone’s girlfriend to go through their things looking for evidence to turn over to the police, then that would be government activity. That would be the actions of a government agent because government agents can’t ask private parties to do something they themselves couldn’t do under the 4th Amendment, so in that type of instance it would be extended to that private party.
Wouldn't it be the purview of the cops to update Flock that the plate is no longer of interest and to stop alerting on it? I'm no fan of Flock, but let's put the onus where it is deserved.
No licensed engineer can say "Well Claude made this bridge for me, it's not my fault". If you're licensed by the state to carry a gun around, your standard should be higher than that, not lower.
AI has nothing to do with this. Cops have been using facial recognition since the 2010's, computers and databases with glitchy connections even longer than that. AI is just the latest boogeyman hiding the actual issue.
Still, AI has no place in law enforcement. It's the hammer that is being used to put screws in. It enables injustice at a far larger scale than ever before. See: the TN woman who was extradited to NC, having never been there, for a crime that the AI "face recognition" flagged as her, and the cops did zero actual investigation, they just took the AI at its word and put her in jail for six months. I also remember a man who was jailed for violating someone else's casino trespass under similar reasons. Bodycams in that case showed the cops says "the software is saying it's him 100%"
Yup, exactly. Look that case up, it had nothing to do with Flock. It was facial recognition software and an old school database built in 2014, so likely not big-data ML (AlexNet hadn't even come out) but classic CV.
Productivity improvements will be needed in all industries. I'd rather have fewer well-paid and well-trained, accountable LEO's that have all the productivity tools they need vs. a mini-army of union-protected tom-dick-harry's grabbed of the street, handed a gun and a database. No thank you.
I'd rather we have cops who are required to actually investigate, versus just taking what a computer program tells them as if it is inerrant gospel
Maybe if the cops can prove they actually did investigation and were only prompted by the AI to do that investigation, I'd agree. But the whole problem is that the cops are blindly using AI to tell them who to arrest, which is such a blatant rights violation that I can't see how anyone could support it and sleep soundly at night
Also, a non-zero number of cops have been using AI to stalk ex-partners. That's just known cases, and it stands to reason there are also a non-zero number of cops who have done it and not been caught. Since a single such case is too many, it needs to stop.
Also, don't forget, "good" cops who aren't reporting bad cops and trying to get them off the force are also really bad cops
See: the TN woman who was extradited to NC, having never been there, for a crime that the AI "face recognition" flagged as her, and the cops did zero actual investigation, they just took the AI at its word and put her in jail for six months.
As has been explained numerous times, this was a problem with the police and the courts, not AI. Get rid of bad cops first, then worry about AI.
I'd rather bad cops not be able to use AI to be worse cops, thank you. I think that's the easier task, because of qualified immunity. AI hallucination is an issue well known to happen widely.
People do have limits, and doing both is inherently harder than doing one. Every ounce of effort spent working on something that isn't the problem takes away from the effort to actually address the problem.
They are going to get AI, regardless of what you or I or anyone else piling on thinks about it. It will happen. That's how this works. That's how this has always worked. For the cops, it's just a matter of waiting for the right crisis to come along to justify it.
So we need to make sure the people and processes are in place to prevent, recognize, and redress the inevitable abuses.
Maybe there were two cases because I thought I remembered hearing about that (or was it Maryland?) but I also remember a similar situation of someone being taken to NC
Edit: the one I was referencing was North Dakota, not NC. But there was a very similar case that I think involved Maryland. The fact that there are multiple cases to confuse in this scenario only emboldens my viewpoint that AI has no place being anywhere near LEO
I think both can be true. Ideally, we should do more to address the social issues that cause people to drink and drive, but revoking licenses is still a good short-term move. We could outlaw AI policing while we work on deeper issues with law enforcement.
> Paraphrasing the crux of the issue: "It's regular practice in Colorado to list license plates with both versions, the one with 'O's and the other with Zeros in the warrant list." Insane. Practice.
Agree.
> As always, this story has have nothing to do with the cameras or AI, but "law enforcement has an insane lazy practice" doesn't make for a very good headline anymore.
Flock allows them to execute their intent at scale. That's a regression, unless it leads to the realization their intent is harmful and stupid.
> "It's regular practice in Colorado to list license plates with both versions, the one with 'O's and the other with Zeros in the warrant list."
That is a suspicion of what might be the problem.
And he's facing a Kafkaesque problem that in order to get him removed from the list they need to know who the warrant is for, but he also can't find out who the warrant is for. Someone can clearly figure this out and help to get it fixed, but he's been unable to talk to a person that has the ability and authorization to query the system to figure it out for him.
We really need some anti-Kafka laws in this country so that if you wind up any sort of list like this, including bans from companies like Apple/Google/Meta/etc, that you have the right to know why and to appeal, and that they must not by default assume that you're a fraudster and refuse to speak with you.
The cameras that they have to read plates in a lot of different conditions and various states of cleanliness. Some states allow O and some states allow 0, and some states don't care. Combine the two issues and cops get lazy and want to check the plate with both the 0 and O just to "make sure".
The cameras also confuse D and Q with 0 and O. And 5 & S, and 2 & Z, and 6 & G, and 8 & B.
The cops have likely been doing this for decades, because the human eyeball can confuse an O for a 0 much worse than image recognition does these days.
Yeah Alaska plates are fairly rare so you could maybe get away with them not adopting the standard. Hawaii plates are EXTREMELY rare because of the cost of freighting a car over and there's no real reason to register a car in Hawaii that I'm aware of. [0]
[0] I'm thinking here of places like Montana which attracts a fair number of out of state registrations to avoid sales and registration taxes in some states. PS don't try this most states already consider this and you're often violating the sales tax laws if the car doesn't leave the state within a few days of purchase.
The insane practice was allowing "O" and "0" to be used in license plate numbers in the first place. Once you do that, you're stuck dealing with the fallout of trying to distinguish confusing glyphs at distance on a moving vehicle. Many places omit letters that can be confused like this for good reason - e.g. Ontario plates can't have the letters G, I, O, Q, and U.
Software that handles number plates needs to take account of this. Not all of it does but the glyphs being identical makes it quite clear where the responsibility lies.
I simply don't understand why our legal system needs a non-deterministic agent injected into it. What value are we trying to capture that isn't already delivered by our overbearing amount of surveillance.
the question does not really seem like a good faith question. if people on this forum can't see a reason why someone would want to use AI to make their life easier is kind of hypocritical. what, it's only good for techbros to use it, but other's can't? we know that pretty much every police agency is understaffed and those working are humans and would like to make their job easier/faster/more successful just like everyone else. unfortunately, they are running into the same thing techbros are in that AI is an oversold bill of goods that can actually cause more work than without it. and i'm saying this that has a very strong skepticism about the status of current policing.
ELIZA was a trivially simple hardcoded chatbot, that mainly reflected your statements back at you as questions, so it's not clear what you mean by that comparison.
If you were looking for an impressive example of early AI, SHRDLU would be it.
Law enforcement being lazy, dumb, and incompetent is not an unpredictable bug. Its predictable. The smartest human capital does not go into law enforcement in this country. They go to other industries. Flock needs to have procedures for whitelisting plates when errors are discovered because these kinds of issues are very common.
No it still relates to the cameras. When you hook up incompetence with automation bad things happen quickly an in far great numbers. Incompetence alone, if isolated or kept from spreading viraly is far less damaging.
The net is telling me that since 1975 the license plate format in Colorado is XXX-XNN where Xs are letters and Ns are digits. Having a plate entered into the watch list with multiple times with all variations of substituting Os for 0s and 0s for Os should not cause a problem.
That suggests that this involves a plate that does not come from the normal sequence you get when you let the state choose your plate. It looks like most of their collector and special use plates also should be safe [1].
That's probably why we haven't heard of a lot of people running into this. It seems you probably would have to have a vanity plate that includes 0 or O, and someone else would have to have a vanity plate that differs from yours only by changing 0s to Os or vice versa.
(It's a Dungeon Crawler Carl-themed license plate.) Look carefully at the sticker at the top right. The tag is actually MONGON0, but it is far from obvious that the last character is a zero at a quick glance unless you are very familiar with the typeface used in Tennessee license plates.
The logical solution is to forbid issuing plates that could be misinterpreted. If MONGONO exists, then you can't have M0NG0N0 or other permutation of O's and 0's.
> As always, this story has have nothing to do with the cameras or AI
Obviously not true, but with nuance.
This shows the problem with bad practices at infinite scale.
Maybe they always conflated 0 with O. Not great, but if it was done manually it came up as a problem almost never. Still not great if someone got caught up in it, but it was not a widespread problem.
Add a layer of ever-present spying on literally everyone and suddenly what was a footnote of a problem is a major issue.
It's not insane at all to return both in a lookup. The "reporting person" will often be wrong about slight variations when calling in a license plate and the downside of errors are asymmetric: it is much more dangerous for the officer to think a driver doesn't have a warrant when they do versus thinking they have a warrant when they don't.
The insane part is trying to solve the problems created by homoglyphs in post-assignment.
What's the need to allow both `O` and `0` on a plate if it's supposed to be hard to tell apart anyway? Say there was some reason to want to both characters, why allow assigning a new plate which would match with an existing assignment? It's just a loss of time, resources, and safety for both law enforcement and everyone else to allow duplicate matches to be a possibility.
The funny thing is that disambiguation of glyphs in a font is a solved problem. Slash the zeroes, wide serifs on the capital i, etc. They just...don't do so in these states where it is still a problem.
It's also a a problem because not all states are the same, some don't allow O, some do. Some allow 0, some don't! The cameras need to be able to read both.
Sorry, is it not also much more dangerous for the erroneously-flagged person to be put in this situation? I imagine anyone legally transporting a weapon, for example, would be put in material risk for their safety by this practice.
Let's just arrest everyone then - I'm sure they've committed a crime of some kind during their life.
We're approximately halfway down the slippery slope, and I don't see any way out other than hard revolution, which is very touchy talk on the internet.
Ultimately it's all modern capitalism's fault, else there would be much less incentive for these companies to fuel what is rapidly becoming the effective Fourth Reich
> As always, this story has have nothing to do with the cameras or AI, but "law enforcement has an insane lazy practice" doesn't make for a very good headline anymore.
That practice isn't insane. It's what you'd always want.
To the extent that it causes problems, you'd want to fix the practice that doesn't make sense, which is using an alphabet for license plates that contains both O and 0.
I've had two police stops in the past initiated by ALPR systems fraudulently claiming I didn't have a valid registration. Presumably because the state that issued the plates didn't share such data. I wasn't motivated to do anything about it but something more severe like this should be fought with a multimillion dollar libel suit against the C-suite and board.
We discuss Flock occasionally in my local subreddit since they granted our city of fewer than 100K like 40 of these within the last year. Plenty of Flock apologists appear as soon as the threads on the subject are posted. I'm convinced the majority of that is astroturfed.
It's the tech version of a temporarily-embarrassed millionaire trope. Any technology must be a good thing, and if only I could just get in early on the next big tech trend, I'll have fame and money and power and women and ...
In the video he said that the courts ask "who is the warrant for" and he replied "no one", but surely one could also look up the number plate and find it that way?
Go after Flock; they are not protected by extension as they are the ones who are alerting the police and have no system-wide removal option according to the Chief interviewed.
They're going to say it's the police's fault for not double checking the AI recommendation, or something like that. Privatization primarily serves to launder responsibility.
We need strong laws preventing any AI process from being used for law enforcement at all. The mere presence of AI at any step in the process should result in complete exoneration.
Flock is doing something I find unethical, even immoral, but maybe not illegal.
I want people who break the law to go to jail. I don’t care if they’re cops or c-suite execs.
But what I really want is laws (preferably federal) that make it illegal to build systems that can be used for mass surveillance, and I want law enforcement to HAVE to get a warrant to receive data from surveillance companies, even if they offer it without a warrant, because I want oversight.
> make it illegal to build systems that can be used for mass surveillance
Is such a law realistically enforceable? A lot of the surveillance systems used today are benign services like Push Notifications, SMS and online filesharing sites. A significantly motivated threat actor (like the NSA, Unit 8200, Salt Typhoon, etc.) would have no problem appropriating that data for themselves.
Something like an oversight committee might work better, but there would be a bipartisan effort to neuter them the moment they take action.
We live in a strange time politically where the consensus on ethics is incredibly detached from justice. There is a danger in giving in to mob rules when it comes to the legal system but at this point we've wandered too far in the other direction with clear corruption around Flynn, Ticketmaster and others.
I simply don't find the argument that something isn't illegal compelling anymore since our justice system is so deeply misaligned with society. We live in the era of grift.
What sorts of things are you personally doing that aren't illegal, but that someone would want to imprison you for because they think you are unsympathetic for some reason and no longer find the argument that what you're doing isn't illegal to be compelling?
"We need strong laws preventing any AI process from being used for law enforcement at all. The mere presence of AI at any step in the process should result in complete exoneration."
Why?
It seems to me that the biggest problem with policing is qualified immunity that prevents proper feedback (or what my dad would have called "consequences").
Without that, the tools the police use are largely irrelevant.
Colorado and New Mexico do not have qualified immunity for law-enforcement. It's not carved in stone and it's not inevitable. If your state has ballot questions, it's time to get that on the ballot at the next possible opportunity.
Why punish the employees of a business when the root cause is corrupt government employees abusing their power?
Edit to respond to smt88:
IBM knowingly selling services to the Nazis specifically to violate human rights is not the same as Flock selling services to cops to aid in identification. In addition, going after 1 business is simply an inefficient use of resources, when the government employees can simply use a different business to abuse their power.
I didn't say the employees should be imprisoned. I said the c-suite, the ones actually in charge. They're enabling these cops to be lazy and not do their job properly, and have directly contributed to numerous human rights violations.
C-Suite are the top level of the company. Above them is only the board of directors, whose power is limited to firing the C-Suite if they don't like what they're doing. In day to day operations, the C-Suite controls the entire company.
No they're not, they're executives who can only be fired by the board. Equating them with line-level employees is somewhere between naive and isingenuous.
A lot of police policy wonks explicitly argue for replacing the human judgement of cops with impersonal, tech-mediated surveillance, on the grounds that this reduces the possibility of human bias against groups of people (typically black people); or just reduces the possibility of physical contact between a cop and certain people (again, typically black people), which therefore reduces the chances of the police stop escalating into a shooting. This is an argument for e.g. automatic red light cameras in lieu of having police stake out and pull over cars who run red lights.
when you use typos to broaden the scope of a warrant to include individuals that have not commited crime or acts prerequisite to indictment, you are exceeding the authority granted by a justice.
i would like to be privy to such discourse, as "your honour we need to include spellings of name or other identifiers, contrary to those of the person in the warrant you have issued."
Turns out police are putting ambiguous plates in the system under all variants, and Flock is lapping it up. The cops who do so should also go to prison.
That's not true everywhere. Qualified immunity can be removed at the state level, and has been in some places. Nothing the cop union can do about that.
Insane. Practice.
As always, this story has have nothing to do with the cameras or AI, but "law enforcement has an insane lazy practice" doesn't make for a very good headline anymore.