NSF-Funded "Dark Web" to Battle Terrorists 258
BuzzSkyline writes "The National Science Foundation has announced a new University of Arizona project, which they call the Dark Web, intended to monitor all terrorist activity on the Internet. The project relies on 'advanced techniques such as Web spidering, link analysis, content analysis, authorship analysis, sentiment analysis and multimedia analysis [to] find, catalog and analyze extremist activities online.' The coolest part of the project is a tool called Writeprint, which 'automatically extracts thousands of multilingual, structural, and semantic features to determine who is creating "anonymous" content' with an accuracy of 95%, according to the release."
5% (Score:3, Insightful)
So when they get it wrong, and the police storm my front door instead of my neighbors, will it still be "cool"?
Re: (Score:2, Funny)
Re: (Score:2)
About 20% of "colonists" opposed our Independence. (Score:4, Interesting)
If you had polled England at the time, and those Loyalists, you'd understand that the "terrorists" had control of the "colonies".
If England had won, every one of those "terrorists" who had signed their little "Declaration" would have been hanged. And their would have been rejoicing in the streets of the colonies.
Re:About 20% of "colonists" opposed our Independen (Score:5, Funny)
Re: (Score:3, Insightful)
I'm pretty sure nothing of the sort happened, but i'm willing to hear evidence to the contrary.
Those were greatly less "evolved" times, and yet, my impression is that those at the forefront of political dissent were vastly more humane in spreading their message.
Re:About 20% of "colonists" opposed our Independen (Score:3, Insightful)
I would agree if the insurgents would act in a military manor. but as of yet, they are completely happy with killing
"terrorist" vs. "freedom fighter" (Score:2)
The oft-repeated phrase is rather stupid. "Terrorist" is about methods (means) — targeting civilians. "Freedom fighter" is about goals (aims) — achieving a "freedom" of some sort or another.
There is not contradiction — one can be both in the same person's opinion. See also False Dichotomy [wikipedia.org]...
Re: (Score:2, Insightful)
Re: (Score:3, Interesting)
The US wasn't attacked by terrorists. They were attacked by a tight knit military group that went after their critical infrastructure. The world trade center, the center of their economy. The pentagon, center of their military. And the commander in chief.
There have been no grocery stores blown up, no shopping malls, no attacks with Nuclear, C
Re:5% (Score:5, Insightful)
Re:5% (Score:4, Insightful)
And simple to defeat? (Score:3, Insightful)
Okay, they'll be able to group all of his posting as being posted by him
Re: (Score:3, Insightful)
Don't think for a second that they aren't trying to actively hack some of the more popular places these things are being posted. If they can get one honey pot and the correlate that guys p
It's not even that difficult. (Score:4, Interesting)
So all that the government would need would be the addresses of the web sites (no matter where they are located) and taps on the pipelines. You can either try to catch the stuff going OUT of your country or going INTO their country (if you can't just tap the line of that website).
That will tell you who, in your country, is going there.
As long as it isn't using encryption, you'll even get what is being read/posted.
If it is using encryption, you still should have the location of the guy reading/posting. Or you can try cracking the encryption.
Once you have the location of the guy, you get a warrant and put a keylogger on his box or whatever.
There's no need for all of this crap about "darkweb". Google can already tell you what is posted on what websites. If these guys are smart enough to beat the basics, they're smart enough to know NOT to use the Internet for point-to-point communications.
Re: (Score:2)
Also, if the source IP in question happens to be, say, a NAT address that serves 100 terminals in a public library, then you don't have much to go on.
Re: (Score:2)
Re: (Score:2, Informative)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
I for instance, post here under a randomly chosen pseudonym. But on another forum, based in my neighbourhood and discussing local issues, I post under my own name and link to a personal web page. You can find my name, address and phone number there. If this system works as advertised (big if) it could correlate them. Though my style is dif
Re:5% (Score:5, Funny)
Now, the biggest problem is to get terrorists to register to and use that DarkWeb thingy. But with such a kewl name and a good advertising campaign, it shouldn't be too hard.
Re: (Score:2)
In other words: they may not know the real names, but they can identify all the anonymous posts made by the same person with 95% accuracy. That seems much more doable compared to divining a person's real identity from nothing more than a pile of anonymous data.
=Smidge=
Re:5% (Score:5, Insightful)
Let's say in 1,000,000 posters there are 20 secret terrorists. This system (assuming the 95% figure isn't just made up, and since it's a reliability figure coming from a government contractor - it is) will label 19 of the real terrorists as terrorists and *50,000* innocent internet users as terrorists. Since we already live in a world where being under government suspicion (but no charges) gets your assets frozen, phones tapped, and puts you on the no-fly list this is a BIG problem.
I go to a fairly international university. I've seen this 1984 B.S. shit on innocent people's jobs and educations first hand. As long as our elected representatives keep granting themselves and their officers these kinds of powers, we do not have the right to call ourselves the "land of the free."
Right now the US has in place a set of laws that would allow for an authoritarian (not-quite totalitarian, though if the press keeps dismantling itself, who knows) government. All it would take is the decision to enforce them to the letter; no consent from the voters would be needed.
Re:5% +++++ (Score:2, Interesting)
http://www.visualanalytics.com/ [visualanalytics.com]
Hell, just see:
http://www.google.com/search?q=visual+analytics&ie=utf-8&oe=utf-8&aq=t&rls=org.mozilla:en-US:official&client=firefox-a [google.com]
The thing is, I wonder if that NY Times (I think it was NYT) reporter/columnist under bushwhack/assault for "divulging" sensitive collection techniques to the "ter'rists" knew of Visual Analytics and could have shiel
Re: (Score:2)
If you're searching for positives in a huge pool of negatives, even an extremely reliable test will return a majority of false positives.
In the scenario I described, out of a million internet users, the system turns up 50,000 only 19 of whom are terrorists, but all of whom are now under suspicion.
And don't paint suspicion about intelligence techniques in such black and white terms. I don't believe that the government whisks people away to gitmo because of a single computer test, however
Here's How (Score:2)
What's so awful about the whole idea is the unlikely event the evidence, or the method used to collect it is ever scrutinized.
For those of you still convinced hunti
Re: (Score:2)
Agent #2: "Wow! That bastard! Let's burn all his books!"
CIA agent: "And this other guy, he seems to be totally illiterate."
Agent #2: "Bob, you maroon, that's a George Bush speech they're quoting!"
CIA agent: "Ooop."
Re: (Score:2)
Re: (Score:2)
Which is impressive from an academic standpoint, but perhaps not very useful for mass surveillance. If you have 10,000 identified posts, and 10,000 unidentified posts, and you want to match them up with a one-to-one mapping, suddenly that 5% sounds much more troublesome. If each unidentified post scores a positive on 500 identified posts, and each identified post scores a
Re: (Score:2)
DNA matches aren't typically 100%, the condition of the specimen isn't guaranteed to be of quality, and at this point, even with a 100% match it won't do you any good if you don't have a suspect. The accuracy isn't 100% because typically they won't check the entirety of the strands, they'll look at a relatively small section. It is pretty reliable, but as I already said, it isn't much good i
Re: (Score:2)
I would hope that if your neighbors are terrorists, you would have already called them in. I wouldn't want a bomb maker living next door to me!
Re:5% (Score:5, Funny)
It's better to be safe than sorry; why, just the other day, I saw some guy walking suspiciously down the street. I'm not one to overreact, but this guy was just suspicious if you know what I mean. He looked like he came from the Middle East, had shifty eyes, the full shebang.
So I'm walking along and I see this guy. I almost kept going, minding my own business, but I thought about the danger this proud nation is in and I thought to myself, "If I don't do something, who will?"
And thank god I did.
I called 911 (blessed may that number always be in our hearts) and reported the likely perpetrator. I tailed him from a distance for a while, and my if he wasn't surprised when that officer pulled over next to him! You should have seen the look in his eyes, caught in the act!
So, long story short, turns out the police couldn't arrest him for anything (or he got off on some technicality, probably). I know one thing: he'll be more careful next time he decides to pull something. You've got me to thank for that.
Re:5% (Score:5, Funny)
Re:5% (Score:4, Funny)
"Hello?"
"My neighbor Ivan Asimov is an enemy of the State. He is hiding undeclared diamonds in his woodshed."
"This will be noted."
The next day, the KGB goons go over to Asimov's house. They search the shed where the firewood is
kept, break every piece of wood, find no diamonds, swear at Asimov, and leave.
The phone rings at Asimov's house.
"Hello, Ivan! Did the KGB come?"
"Yes."
"Did they chop your firewood?"
"Yes, they did."
"Okay, now it's your turn to call. I need my vegetable patch plowed."
Re:5% (Score:4, Funny)
Re: (Score:3, Interesting)
The coolest part of the project is a tool called Writeprint, which 'automatically extracts thousands of multilingual, structural, and semantic features to determine who is creating "anonymous" content' with an accuracy of 95%, according to the release."
So when they get it wrong, and the police storm my front door instead of my neighbors, will it still be "cool"?
5% error rate is too high to base any first-order data on. My assumption would be that they'll use this information to determine what online content to spend their time working on. For example, if the modern equivalent of Echelon tells us that a terrorist in Iraq makes frequent calls to someone who makes frequent, high-signal calls to someone in the U.S. and that person is identified as the potential author of several anonymous postings to various forums, then you spend a whole lot of time analyzing those
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
I wonder how they'd implement the witness protection program for code?
Re: (Score:2)
Re: (Score:2, Redundant)
Your lucky neighbor might think so!
Re: (Score:3, Insightful)
No and neither do you as that has never been the case. Checks and balances precludes true independence.
This could have been used... (Score:5, Insightful)
Other than that, I'm afraid this is the sort of technology that's only "cool" when it isn't being used on you.
Not to be confused with Darknet (Score:4, Informative)
Security is more important now than ever! (Score:2)
Attention NSF (Score:5, Funny)
Either the terra'rists give up after the spamming, or they kill the spammers. Either way, we win.
Re: (Score:2)
The quote you're looking for (Score:3, Interesting)
Quis custodiet, ipsos custodes
- Juvenal
Re: (Score:2)
F or A? (Score:4, Insightful)
Change NSF to NSA, and the summary would make just as much sense...except "terrorist" would be defined as whatever the current politicians in power decide it to mean.
Space race, nuclear power, this kind of technology. Just goes to show, if you have a good idea, find a way to use it to further the war machine and political agendas and prepare to get buried in money. Can someone please figure out a way to weaponize a cure for cancer?
Re:F or A? (Score:5, Interesting)
You mean kind of like how there are now lots more skilled laser eye surgeons in the private sector competing to give you better prices for your business because once the military decided to back providing that service to its pilots, there was a giant leap in people being trained to do the work during their rotations?
As far as cancer: the military provides all kinds of basic medical research from which we all benefit. You'll see considerable military spending in epidemialogical studies, trauma treatment, etc. To the extent that, say, The Marine Corp is a weapon, the huge studies that can be conducted on the systematically collected health stats, DNA, etc., on a huge number of generally healthy people over several generations IS a part of all sorts of cancer (and other) studies.
Re: (Score:2)
Re: (Score:2)
Actually, no. But then, you probably can't imagine that someone might actually respond to another post's comment by mentioning actual information that's relevent to the conversation, right? Or is someone less of a 'fag' if they cite the Coast Guard, instead? Which branch of the military does one get to mention that makes them less homosexual, from your perspective, exactly?
paint a bulls-eye on your forehead fag
And I don't have to guess. You're making it obvious
Re: (Score:2)
1) Find a cure for cancer
2) Indiscriminantly irradiate the globe, giving everyone cancer
3) Distribute the cure only to card carrying citizens
There you go. Where do I get my money?
Another good tactic is to create diseases which, based
There are no false positives. (Score:2)
except "terrorist" would be defined as whatever the current politicians in power decide it to mean.
The current terminology is "potential terrorist", a category that includes everyone. The implementers mean it too.
Welcome to the new Constantinople, a power without peers, knowledge without truth, laws without justice and wealth without dignity. With tools like this the current power controls the future and the past. Dissidence will be impossible and change overs will only occur by coup. Without priva
Who's the extremist on-line? (Score:2, Redundant)
These jerks are the "extremists on line".
Re: (Score:2)
Also, they should not be ashamed of creating the technology, but ashamed of how it is used if it is wrong. That is like saying inventing the plane was bad because it would be used to fight wars. Bad example perhaps, but you get the idea.
"Spying" (Score:3, Interesting)
Re: (Score:3, Insightful)
I don't think it's reasonable to call it spying.
You're right, it's not spying, it's surveillance.
That doesn't really make it any better, however.
remember... (Score:2, Funny)
Re: (Score:3, Insightful)
Re: (Score:2)
And everybody knows that smoking pot = supporting terrorism.
http://www.google.com/search?q=marijuana+terrorists [google.com]
Re: (Score:2)
"NSF-Funded" (Score:2, Interesting)
OMG! I am dead (Score:2)
Re: (Score:2)
I didn't know Hakim Bey was a mathematician too. Geez, that guy can do *everything*!
Anonymous Cowards? (Score:2)
This tech could destroy Slashdot as we know it!
RTFA People (Score:2, Interesting)
Re: (Score:2, Funny)
Re: (Score:2)
Not necessarily, no. Take my history here for example - there are comments I've made as an A.C.. If this can work out my structure, then it should be able to tie back with 95% accuracy that those A.C. comments are from the individual behind the mccalli account.
That's just here. I've always posted under my real name in most places (been using the net a lot longer than the spam probl
Re: (Score:2)
My Name (Score:2)
SPAM should be fun to sort out and/or any spammers on blog comment sections.
Aliens moment (Score:3, Funny)
Reminds me of something..."I'm ready, man, check it out. I am the ultimate badass! State of the badass art! You do NOT wanna fuck with me. Check it out!...Independently targeting particle beam phalanx, VWAP! Fry half a city with this puppy! We got tactical smart missiles, phase-plasma pulse rifles, RPGs! We got sonic, electronic ball-breakers! We got nukes, we got knives, sharp sticks..."
Computationally expensive beyond practicality (Score:5, Interesting)
You can only extrapolate data you've read properly. The simplest of encryption and/or obfuscation schemes applied to this content would effectively protect against extrapolation. Sure, Big Brother can have software scrub the Net looking for suspicious content. But can they have software scrub the Net while applying decryption measures to everything found? While analyzing every image file for obfuscated content (or even something as simple as writing your terrorist plans on a piece of paper and scanning it in as an image)? While applying rot13 to every block of text found?
I would say no. The problem becomes computationally impossible at that point. There are theoretically infinite ways to hide, encrypt, or obfuscate data. To have a system check first for unhidden, unencrypted, un-obfuscated data, then also for each of those, is simply not doable unless one makes radical limitations to the format of the data itself.
I would say instead that this "Dark Web" will be invaluable in identifying characteristics of perfectly law-abiding forum posters, slashdotters, and so forth, and that the data gleaned will fetch a good price from directed marketeers, pharmaceutical companies, spammers, government bureaucracies, and other servants of the Dark Lord.
Re: (Score:2)
Re: (Score:2)
Like we didn't know (Score:2)
On the face of it, this is not that different from Amazon's Statistically Improbably Phrases, which have been around for at least several years now. Every brain is unique, and it's not surprising that each brain creates writings with some sort of statistical
Web Pages? (Score:2, Interesting)
expend resources making a web page that spiders can crawl.
Here's a hint:
Terrorist #1 sets up a WIFI home network with
limited external access and **no connection** to the
internet.
Non of the terrorists really want to know each other
since that would make them easier to find if one got caught.
All the other terrorists require is a GPS location relatively
close to the hot-spot. Not even the street address.
They park, or slow down,the car at the GPS coordinates,
The super awesome do-it-all tool been waiting for (Score:3, Interesting)
Heck, their job should be simple! (Score:4, Interesting)
They just need to pull up their own employee roster to see who's largely responsible for world terrorism.
Of course, the young recruits are probably still too busy puffing their chests smartly while humming the "Alias" theme music while quietly wishing that the NSA was the one which received the big Hollywood PR/propaganda effort to notice such sticky details as who was responsible for what. But what are a few sticky details? M's and W's all look the same.
-FL
The big question .. (Score:2)
Uh-Huh (Score:2)
You don't need to (Score:2)
Why bother? Why not just make a press release claiming that you can do this when you can't. Then you can (1) get government funding and (2) you might even serve a useful purpose by disrupting communications between terrorists dumb enough to believe the (false) claim.
Idiotic replies about "identifying anonymous" (Score:2)
So if the same guy posts "kill all infidels" and includes instructions on jihadforpussies.com and writes about pink ladies underwear on getithere.com and reviews "movies" at grannysvideos.com they can go track his credit records for pink underwear instead of trying to figure out what internet cafe he posted his "big boy" stuff from.
This does not mean identifying every peace of content by name, just relating stuff by aut
Yay for our New "Dark Web" Overlords! (Score:2)
Extremist =! Terrorists (Score:3, Insightful)
This should scare anyone that likes their right to free speech. And yes, even terrorists should have the right to *speak*. If you restrict their right to speak, its not much of a stretch to restrict yours too.
Be afraid.
"Coolest" (Score:2)
Yeah, cool, 1 in 20 of the people identified as "terrorists" by this program will not even have created the content which led to their identification as terrorists.
Of course, the linking "creating particular content" to actually being a terrorist is a much har
A University? (Score:2)
Irreconcilable Differences (Score:2)
Re: (Score:2)
25% Kerry
18% Gore
7% Osama
5% Hillary
45% 3rd grader Stevie Able of 1209 Mayburn St, Dallas, Tx
If you could post a few more messages please.
Re: (Score:3, Funny)
However, I did find the following address:
1209 N Mayburn St
Dearborn, MI 48128
Okay, its official. I'm a dork.
Re: (Score:2, Funny)
Re: (Score:2)
Um..so what is it they're REALLY trying to do? (Score:2)
What for? Who cares? Sounds kind of weirdly paranoid. Or like someone has delusions of being way more important and influential than he is.
I mean, who seriously thinks that anything posted anonymously on random Internet message boards can possibly have any important political effect? As if J. Random Teenager posting from the school computer is going to suddenl
Re: (Score:2)
Considering the Bush Administration's security apparatus set up surveillance on a group of Quaker senior citizens just because they were against the War in Iraq, I wouldn't be a bit surprised.
Didn't you read the recent article about how the Bush Administration ran "roving bands" of anti-dissent thugs who would attend public appearances by the President, and if t
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)