Video Surveillance Tech Detects Abnormal Activity

Repton writes with news of a company, Behavioral Recognition Systems, that has received 16 patents on a new video surveillance application that can convert video images into machine-readable language, and then analyze them for anomalies that suggest suspicious behavior in the camera's field of view. The software can 'recognize' up to 300 objects and establish a baseline of activity. It should go on sale in September. "...the BRS Labs technology will likely create a fair number of false positives, [the CEO] concedes. 'We think a three-to-one ratio of alerts to actual events is what the market will accept,' he says. 'We could be wrong.'"

Cool

[clang_jangle (975789)]

Great! Now, all they have to do is combine that with this [youtube.com], and we can all sleep soundly.

Re:

[Goldberg's Pants (139800)]

Funny, my thought on reading your comment was "If that isn't a link to ED-209 or similar, then they've failed."

Well played.

Re:

[roguetrick (1147853)]

Abnormal activity for a machine like that would just be some guy wearing blue.

Need a sentry here!

oh yeah?

[ILuvRamen (1026668)]

If I walk past a security camera in a full sized squirrel outfit, humans couldn't even figure that one out let alone a computer. These systems are just dumb. Wait until computers are smart enough to talk with us to develop something like this otherwise it'll never be remotely accurate.

Re:oh yeah?

[Cassius Corodes (1084513)]

Computers are already smart enough to talk to us. They just don't have anything interesting to say.

Why don't you try starting a conversation?

Re:oh yeah?

[rugatero (1292060)]

Computers are already smart enough to talk to us.

Do computers worry you ?

They just don't have anything interesting to say.

I'm not sure I understand you fully.

Why don't you try starting a conversation?

Do you believe I don't try starting a conversation ?

Re:oh yeah?

[Hognoxious (631665)]

It looks like you're trying to start a converstion. Would you like to:

* Talk about sport.
* Talk about politics.
* Tell me how your day went.

Re:

[Spokehedz (599285)]

You forgot the last option:

* Shut up, and get me a beer.

Re:oh yeah?

[Dancindan84 (1056246)]

We wouldn't want you having an unsecured conversation:

You're trying to start a conversation with a computer.
Cancel or Allow?

Re:

[Mister Whirly (964219)]

At least you can have a semi-normal conversation with a Windows machine. I started talking to a Mac and all it did was smugly name a bunch of indie bands it likes that I have never heard of, and then chastised all of the bands I like as "being to mainstream".

Re:

[dintech (998802)]

Your computer is already confused about whether it's talking to a man or a woman. That's not going to help.

Doesn't need to be all that accurate

[Sycraft-fu (314770)]

I'm sure everyone on Slashdot is donning their tinfoil hats and screaming big brother (I've already seen a couple posts to that effect) but that really isn't the target market. You'll find that by far the most customers of CCTV equipment are private companies. Pretty much any large store will have an extensive CCTV system to watch for shoplifting.

Ok well the problem is that you have to have humans watching it for suspicious activity. It is completely infeasible to hire one human per camera, and the more cameras a given human has to watch, the less they catch. Well, something like this could help. If it sees something suspicious, it brings it up on a display to one of the security personnel. The person then decides if it is a problem, or a false alarm.

A moderate amount of false alarms is fine. This wouldn't be a case of "The system went off, arrest him!" It'd be a case of "The system went off, let's have a human watch and see what's going on." It would allow for better use of security personnel.

Heck, I'd be interested in a system like this at work. We have CCTV on our computer labs. However we don't have anyone monitoring it. It's more for liability reasons, and so that if someone steals or damages a computer, we can hopefully help the police catch them. However prevention is better than clean up. So it'd be cool if when the system thought something was wrong, it'd notify staff and we could look. If everything was fine, we carry on as normal. If something is indeed happening, we call the police.

You've got to stop with the idea that these sort of things are designed to figure out what you are thinking for some evil government plan. They aren't. They are designed to help make security systems more effective.

Re:Doesn't need to be all that accurate

[shawb (16347)]

The ratio of false positives really shouldn't be that much of an issue if the system is implemented properly.

A bigger issue with a system like this would be false negatives. Economics being what it is, this means that the organizations deploying these cameras would likely end up hiring less people to watch the monitors per camera (whether that means an increase in cameras or a decrease in staff.) Therefore, the people watching the monitors would end up relying on the system to look for suspicious behavior. Then false negatives start to come into play. "suspicious behavior" that a human would notice and investigate may be missed by the system, and therefore go uninvestigated. This could cause escalating problems when people decide to learn what behaviors would trigger a "suspicious" flag and then go about doing their nefarious deeds where a human could have spotted them.

Sure, it would be possible to institute an automated suspicious behavior system to augment existing systems, but in reality it would end up taking away from resources used for security. Even if the system would not reduce security levels, a system such as this would at least reduce the future investment in other proven security methods, such as an increase of competent staff to watch the monitors.

Re:Doesn't need to be all that accurate

[Hognoxious (631665)]

Unless you have enough guards that everybody is being watched at all times, you'd have false negatives anyway. The idea is not to remove/replace human surveillance but to target it more effectively by focusing on the more suspicious people.

Re:Doesn't need to be all that accurate

[TapeCutter (624760)]

"A bigger issue with a system like this would be false negatives. Economics being what it is, this means that the organizations deploying these cameras would likely end up hiring less people to watch the monitors per camera (whether that means an increase in cameras or a decrease in staff.)"

Stocktakes tell the store owner how much is being lost via theft. Economics being what it is, you can use this information to measure your security bang for buck and notice there is a point where diminishing returns makes eliminating the remaining false negatives a net loss. At this point your best option is to maintain the same level of risk aversion for less money. People who run large sets of cameras are the target market so IMHO the false negatives will be expected/ignored by the buyer, they (rational but non-technical bussiness buyers) will simply want to know what it all means for their bottom line.

Re:Doesn't need to be all that accurate

[houghi (78078)]

Ideally this would just be a help. In reality people will take the word of the machine each and every time, because people are lazy. Evener heard the expression "Well, I looked it up and the computer tells me it is like that"? That is how most people relate to computers.

So this will not only mean "search person X, because the computer tells us he is a thief". It will mean they keep searching till they find something. Can you think of places they might want to look?

It also means that people will not pay attention anymore and as long as the thing doesn't beep, you can walk out of the store with that huge 100" screen.

It will not only cause false positives, which are extremely annoying and bad for businness. It will also cause false negatives, earning people will still steal. Remember that these are not the people from CSI that are on the screens (Or even Las Vegas), these are real life, day to day people. These are the rent-a-cop that are unfit for walking around.

Re:

[Hognoxious (631665)]

So this will not only mean "search person X, because the computer tells us he is a thief". It will mean they keep searching till they find something.

I think your foil hat is too tight.

Re:Doesn't need to be all that accurate

[RMH101 (636144)]

The problem is that this tech leads to this: http://www.pcworld.com/businesscenter/article/148370/cctv_camera_identifies_people_by_race.html [pcworld.com] - a proof of concept art piece that identifies people's race via CCTV images. The creator's done this precisely to point out to people the logical end point of this tech.

Scope creep

[Anonymous Brave Guy (457657)]

Yes, this is why any such technology must be viewed with some concern. In parallel with requiring people to change their behaviour for the benefit of the machine, we also have the danger of trusting the machine. Sooner or later, some jobsworth will decide that a beep on the machine constitutes "reasonable grounds" for suspicion, which is all that is required to stop/search or arrest someone in some places. Ironically, a 1-in-4 failure rate is probably a good thing here, since at least then such a decision i

Re:And for epic fail...

[ya really (1257084)]

If I walk past a security camera in a full sized squirrel outfit, humans couldn't even figure that one out let alone a computer.

Imagine deploying this system at a furry convention.

I'd guess the cameras would most likely be programmed to identify the subject(s) as mentally disturbed, but most likely harmless.

America, what a country!

[frovingslosh (582462)]

As long as the cops don't beat too many people too extremely for false positive behavior I can't see where this could be a problem. And Homeland Security is already working on getting some Executive Orders written up that will make it a crime to act in ways that cause false positives, so there should be no false positives in the near future (by definition they will be real positives). Problem solved.

false positives

[zobier (585066)]

While it's a worry how 1984 society is becoming, I don't think false positives are a particularly bad issue with this technology. An operator who would normally be supposed to watch multiple streams of video for anomalous activity can use these more like bookmarks for subsequent human verification. The bigger issue as I see it is that 16 new patents were just granted on software/algorithms.

grenade in mouth

[globaljustin (574257)]

I swear you must be a troll from Homeland Security...

While it's a worry how 1984 society is becoming, I don't think false positives are a particularly bad issue with this technology

That's like saying "Oh sure, it is worrisome that I have a live hand grenade with the pin pulled jammed in my mouth, but I don't think it would be extremely bad if it just blew off one of my pinky toes"

This kind of technology makes me want riot...ahem...i mean...to exercise my 1st amendment right to protest in a law abiding way.

I'm sickened. The CEO says: "We think a three-to-one ratio of alerts to actual events is what the market will accept."

Re:grenade in mouth

[moteyalpha (1228680)]

I wonder if this software would detect a positive for suspicious activity if it observed a lobbyist for the firm entering the office of a congressman with a hooker and a briefcase. It would seem that it would select for people who fly into the radar and as a result the actual complex threats would be ignored.

Re:

[FlyingBishop (1293238)]

In order for that to be suspicious, it would have to be an irregular event.

Re:

[zobier (585066)]

I just don't think this is that big of a deal. I do think it will be extremely easy to game, e.g. flood it with FPs like the congestion charge cameras in the UK. It will be interesting to see what games people come up with.

Re:

[oodaloop (1229816)]

I'm not really sure what you're upset about. That a security guard at a camera has to look at an occasional false positive the computer recorded? What is your alternative? Someone staring at the camera 24 hours a day? No security?

There's an easy way to torpedo this...

[Channard (693317)]

... when it first gets deployed - if it gets deployed - spread the word across the internet and get people to regularly silly walk past it and do other wierd but non threatening stuff. Hey presto, so many false positives it's rendered useless.

There's an easy way to deal with you...

[frovingslosh (582462)]

And you don't think that will soon be made illegal? You sure sound like a terrorist to me, to Gitmo with you!

Re:

[by Anonymous Coward]

I think you may have hit on this company's real business plan.

HOWTO: guerilla PR for your startup

[by Anonymous Coward]

1. File a bunch of mumbo jumbo patents on video surveillance

2. Convince some trade rag to interview your CEO

3. Submit the story to /. as a clear and present danger to "Your Rights Online"

4. ?

5. Go public!

what a concidence

[ya really (1257084)]

I just was just viewing this [imdb.com] right before logging onto slashdot and seeing this topic.

How Good Is The AI?

[strelitsa (724743)]

As noted in TFA and if the false positive ratio can be reduced to even 10-to-1, this technology might rapidly become the best friend of the fellow who has to constantly scan 100 surveillance screens for unusual activity.

But this system's definition of "unusual activity" intrigues me. If one of these toys is set up for example in a bank to monitor a vault door and a bank guard passes by the door every hour on his rounds, the software would presumably record that as "normal" activity. What is the "unusua

Re:

[MichaelSmith (789609)]

But this system's definition of "unusual activity" intrigues me. If one of these toys is set up for example in a bank to monitor a vault door and a bank guard passes by the door every hour on his rounds, the software would presumably record that as "normal" activity. What is the "unusual" element that would prod the AI into sending an alert if a thief did exactly the same thing? What dynamic does the system employ to determine if a bank guard is a legitimate bank guard or Willie Sutton? The time it happened? Facial recognition? The fact that the "bank guard" pulled a cutting torch or dynamite out of his backpack and started going to town on the vault door?

Maybe it flags people who hide their face from the camera.

Re:100 surveillance screens

[JetScootr (319545)]

From TFA: $1,500 to $4,500 per camera.
100 screens, assume each one rotates thru, um, 5 cameras, that's 500 cameras, say $3000 per, 1.5 million bucks. You could actually HIRE HUMANS, say 20 of'em, at $75K each to watch 5 screens each, and have a 1:1 ratio of accuracy.

Re:

[John Hasler (414242)]

> You could actually HIRE HUMANS, say 20 of'em, at $75K each to watch 5 screens each, and
> have a 1:1 ratio of accuracy.

Never pulled guard duty, did you? you won't get a "1:1 ratio of accuracy" even if you hire someone for each individual camera.

Ghosts?

[denzacar (181829)]

Does it detect ghosts? [youtube.com]

Don't fret

[ilovegeorgebush (923173)]

UK citizens are safe in the knowledge that they're being watched [wired.com]. That's it citizen, keep moving. Nothing to see here.

Ignoring the Orwellian references, could this be used for some good?

Re:

[rugatero (1292060)]

UK citizens are safe in the knowledge that they're being watched [wired.com].

That poster is no one-off either. After it became fashionable to compare everything to 1984 the Government agencies realised they could play on people's paranoia. Hence the 'watchful eyes' poster, the targeting benefit fraud campaign and the warning to car tax evaders ("You can't escape the DVLA computer").

"Abnormal Activity"

[Tablizer (95088)]

Abnormal activity? You mean like a slashdotter outside, in the sun, with a date?
         

Re:

[lena_10326 (1100441)]

One must not let the slashdotter near bright light, especially sunlight, which can kill the slashdotter; one must not get water on the slashdotter; and, most importantly, one must never feed it after midnight.

Abnormally this:

[Fluffeh (1273756)]

Machine: Uh oh, Jeremy stoped sticking his finger into his nose. I better call this one in!
Operator: Ummm... Why has it shown me Jeremy just sitting there?
Machine: Nope, there he goes again, digging away at his nose, everything back to normal. Better stop transmitting.
...
Machine: Whoa, he stopping barking for boogers again! Better show the boss!!
Operator: Why does this dumbass machine keep showing me Jeremy just sitting there for goodness sake...
Machine: Boss! Boss! Come on, look! DIFFERENT! ABNORMAL!
Operator: *Hmmm what's for lunch...*

bad headline

[Triv (181010)]

Anyone else read that as "Video Surveillance TechNICIAN Detects Abnormal Activity"? I was confused for a bit.

A ratio of three-to-one false alarms?!

[misterhypno (978442)]

If that's what they're shooting for, then I have a name for the system:

Cry Wolf!

Because, that's all it's really going to do!

Heaven help any street performer that gets caught by this video frankenstein's monster, because the cops will, in some jurisdictions, come in blasting away and a mime is a terrible thing to waste!

Re:

[oodaloop (1229816)]

The ratio is 3-1 alerts to false alarms. That is, 4 events, three of which are real and one a false positive. Given the real events for which security personnel are going to be looking (mugging, rape, vandalism, etc), it would quite a while before 4 total events come to pass and only one of those was a false alarm. I would not call that crying wolf.

Technically impossible

[Potatomasher (798018)]

I call shenanigans on this.

There is no way they can recognize 300 objects in real world conditions. I work in machine learning (academics) and the current record for generic object recognition sits at around 54-57% for the Caltech 101 database (contains images of 101 different objects). So basically the algorithms of the best and brightest minds in academia (LeCun, Poggio, Lowe, etc) get it wrong half the time !!

If any government officials are listening... Please don't waste our tax money on this !

Unusual is abnormal

[jibjibjib (889679)]

To the fool who tagged this 'unusualisnotabnormal':

You're wrong. Unusual and abnormal mean essentially the same thing - something out of the ordinary, something not routine.

If the point you were trying to make is that authorities shouldn't be suspicious of every unusual occurrence, then perhaps something like 'unusualisnotwrong' would have better served your purpose.

Being the former architect of a...

[Assmasher (456699)]

...wide area surveillance system (which included video analytics for loitering, wrong way traffic in a crowd, crowd panic analysis, smoke/fire detection by video, et cetera) I can point out that there are MANY companies, corporate research groups, and universities that have been doing things like this for several years (in some cases almost 10 years.)

          This company is in for a rude awakening when they realize that (a)their price per camera is extraordinarily high (this one metric is the biggest decider in large installation proposals [along with whether or not you have to mount the cameras on poles or just hallways/buildings]) and (b)a false alert rate of 3 to 1 is TOTALLY unacceptable. The entire purpose of video analytics in a security environment is to reduce the workload on the monitoring staff (and hopefully put more of them out into the field) while being able to scale up your coverage. I assure you that a 3 to 1 false alert rate will result in zero customers in a year. Measuring the false alert rate is also highly subjective. Companies tend to use a given scenario repeatedly to measure their results when, of course, this has little to no bearing on reality. Things like the weather (moving shadows affect certain algorithms even when accounted for algorithmically, headlights, flashlights, camera flashes change things, wind, rain, snow, bugs, everything you can imagine, lol...) negate all of these measurements.

          It is nice to see new blood in this space, but I hope they were smart enough to make their software offerings totally distinct from their hardware (many companies do not) so that they can integrate with other systems without to much work. That's the best way to make money in the video analytics market right now. The big boys (like SIEMENS) got into the game about 3 years ago and they'll squeeze you out every time unless you can offer something that helps them land a big deal.

Re:

[Secret Rabbit (914973)]

What? You're not already practised? You got a lot of catching up to do!

Re:Acceptance

[oodaloop (1229816)]

Jebus, what imaginations you people have. Who the hell is talking about arresting the false positives? There's a HUMAN IN THE LOOP. Someone is watching the alerts, which means innocent behavior gets discarded before the police show up. Fucking relax.