Stories
Slash Boxes
Comments

News for nerds, stuff that matters

Slashdot Log In

Log In

Create Account  |  Retrieve Password

NSF-Funded "Dark Web" to Battle Terrorists

Posted by ScuttleMonkey on Wed Sep 12, 2007 02:07 PM
from the whos-watching-the-watchers dept.
BuzzSkyline writes "The National Science Foundation has announced a new University of Arizona project, which they call the Dark Web, intended to monitor all terrorist activity on the Internet. The project relies on 'advanced techniques such as Web spidering, link analysis, content analysis, authorship analysis, sentiment analysis and multimedia analysis [to] find, catalog and analyze extremist activities online.' The coolest part of the project is a tool called Writeprint, which 'automatically extracts thousands of multilingual, structural, and semantic features to determine who is creating "anonymous" content' with an accuracy of 95%, according to the release."
+ -
story

Related Stories

This discussion has been archived. No new comments can be posted.
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
 Full
 Abbreviated
 Hidden
More
Loading... please wait.
  • 5% (Score:3, Insightful)

    by king-manic (409855) on Wednesday September 12 2007, @02:10PM (#20577353)
    The coolest part of the project is a tool called Writeprint, which 'automatically extracts thousands of multilingual, structural, and semantic features to determine who is creating "anonymous" content' with an accuracy of 95%, according to the release."

    So when they get it wrong, and the police storm my front door instead of my neighbors, will it still be "cool"?
    • Man, I bet the British would have loved to have such a tool when they were occupying Ireland and Scotland. All those filthy Scottish and Irish terrorists would have been no trouble at all.
          • Back around 1776 there were a large number (about 20% of our population) of "Loyalists" who opposed our Independence.

            If you had polled England at the time, and those Loyalists, you'd understand that the "terrorists" had control of the "colonies".

            If England had won, every one of those "terrorists" who had signed their little "Declaration" would have been hanged. And their would have been rejoicing in the streets of the colonies.
            • by veganboyjosh (896761) on Wednesday September 12 2007, @03:20PM (#20578509)
              ...And the locals would have welcomed the British with open arms...
            • Re: (Score:3, Insightful)

              are you aware of any incidents involving colonists in 1776 blowing up markets full of children?

              I'm pretty sure nothing of the sort happened, but i'm willing to hear evidence to the contrary.

              Those were greatly less "evolved" times, and yet, my impression is that those at the forefront of political dissent were vastly more humane in spreading their message.

            • Back in 1776, the terrorist were organized military fighting organized military. Can you seriously see no difference in fighting a war and blowing up random stranger walking down the streets hoping it is a soldier? Do you seriously think that stocking arms, ammunition, and other supplies or hiding in a church because you know the other side won't go there is comparable to fighting in the open?

              I would agree if the insurgents would act in a military manor. but as of yet, they are completely happy with killing
          • Re: (Score:3, Interesting)

            Terrorism is about creating fear in a population by attacking targets that have no military significance. When the IRA blows up a grocery store, that's terrorism.

            The US wasn't attacked by terrorists. They were attacked by a tight knit military group that went after their critical infrastructure. The world trade center, the center of their economy. The pentagon, center of their military. And the commander in chief.

            There have been no grocery stores blown up, no shopping malls, no attacks with Nuclear, C
    • Re:5% (Score:5, Insightful)

      by Jarjarthejedi (996957) <bookreader13.cox@net> on Wednesday September 12 2007, @02:13PM (#20577397) Journal
      I'm more curious how they're going to get 95% accuracy on who the person is without a large number of samples of non-anonymous writings from them. It seems obvious that they're really claiming that, with a large number of writing samples from the writer, they can get 95% accuracy. If they're actually claiming to be able to determine who anonymous people are without any non-anonymous writing by them then that's a system I have to see...
      • Re:5% (Score:4, Insightful)

        by Anonymous Coward on Wednesday September 12 2007, @02:15PM (#20577449)
        More likely it'll be along the lines of "These anon posts seem to be from the same person, and we should make more attempt to trace several of them to their source, rather than wasting our efforts on those over there..."
      • Instead of posting anything anonymously yourself, just tell someone else to post it. There speling errors will not be the smae as your's and their sentence structure will be different.

        Okay, they'll be able to group all of his posting as being posted by him ... but they won't be able to tie it to him unless he also posts a lot of stuff non-anonymously.
        • Or they have YASWTP - Yet Anothe Secret Wiretap Program snatch one of the posts. And they're really only limited by what they can do in the States (or what they give lip service to as "not being able to do") - in other countries the gloves are pretty much off and only limited by how much the other country can figure out.

          Don't think for a second that they aren't trying to actively hack some of the more popular places these things are being posted. If they can get one honey pot and the correlate that guys p
          • by khasim (1285) <brandioch.conner@gmail.com> on Wednesday September 12 2007, @02:41PM (#20577879)
            Every TCP/IP packet has a source address and a destination address.

            So all that the government would need would be the addresses of the web sites (no matter where they are located) and taps on the pipelines. You can either try to catch the stuff going OUT of your country or going INTO their country (if you can't just tap the line of that website).

            That will tell you who, in your country, is going there.

            As long as it isn't using encryption, you'll even get what is being read/posted.

            If it is using encryption, you still should have the location of the guy reading/posting. Or you can try cracking the encryption.

            Once you have the location of the guy, you get a warrant and put a keylogger on his box or whatever.

            There's no need for all of this crap about "darkweb". Google can already tell you what is posted on what websites. If these guys are smart enough to beat the basics, they're smart enough to know NOT to use the Internet for point-to-point communications.
      • Re:5% (Score:5, Funny)

        by alexhs (877055) on Wednesday September 12 2007, @02:25PM (#20577619) Homepage Journal
        Of course, when you register to DarkWeb, you give your identity. Obviously, 5% of registered people didn't enter their real identity.
        Now, the biggest problem is to get terrorists to register to and use that DarkWeb thingy. But with such a kewl name and a good advertising campaign, it shouldn't be too hard.
      • Perhaps it's not so much identifying the real identity of the individual, but rather the ability to identify a particular anonymous writer apart from a whole group of anonymous writers.

        In other words: they may not know the real names, but they can identify all the anonymous posts made by the same person with 95% accuracy. That seems much more doable compared to divining a person's real identity from nothing more than a pile of anonymous data.
        =Smidge=
      • Re:5% (Score:5, Insightful)

        by colmore (56499) on Wednesday September 12 2007, @02:39PM (#20577861) Journal
        The worst thing is that for a search like this, 95% accuracy is TERRIBLE.

        Let's say in 1,000,000 posters there are 20 secret terrorists. This system (assuming the 95% figure isn't just made up, and since it's a reliability figure coming from a government contractor - it is) will label 19 of the real terrorists as terrorists and *50,000* innocent internet users as terrorists. Since we already live in a world where being under government suspicion (but no charges) gets your assets frozen, phones tapped, and puts you on the no-fly list this is a BIG problem.

        I go to a fairly international university. I've seen this 1984 B.S. shit on innocent people's jobs and educations first hand. As long as our elected representatives keep granting themselves and their officers these kinds of powers, we do not have the right to call ourselves the "land of the free."

        Right now the US has in place a set of laws that would allow for an authoritarian (not-quite totalitarian, though if the press keeps dismantling itself, who knows) government. All it would take is the decision to enforce them to the letter; no consent from the voters would be needed.

    • So when they get it wrong, and the police storm my front door instead of my neighbors, will it still be "cool"?

      I would hope that if your neighbors are terrorists, you would have already called them in. I wouldn't want a bomb maker living next door to me!

      • Re:5% (Score:5, Funny)

        by Anonymous Coward on Wednesday September 12 2007, @02:28PM (#20577675)
        I call the FBI about all of my neighbors, just in case. I recommend you do the same.

        It's better to be safe than sorry; why, just the other day, I saw some guy walking suspiciously down the street. I'm not one to overreact, but this guy was just suspicious if you know what I mean. He looked like he came from the Middle East, had shifty eyes, the full shebang.

        So I'm walking along and I see this guy. I almost kept going, minding my own business, but I thought about the danger this proud nation is in and I thought to myself, "If I don't do something, who will?"

        And thank god I did.

        I called 911 (blessed may that number always be in our hearts) and reported the likely perpetrator. I tailed him from a distance for a while, and my if he wasn't surprised when that officer pulled over next to him! You should have seen the look in his eyes, caught in the act!

        So, long story short, turns out the police couldn't arrest him for anything (or he got off on some technicality, probably). I know one thing: he'll be more careful next time he decides to pull something. You've got me to thank for that.
        • Re:5% (Score:5, Funny)

          by autocracy (192714) <slashdot2007 AT storyinmemo DOT com> on Wednesday September 12 2007, @02:42PM (#20577903) Homepage
          Oh, awesome... thanks for making sure he'll be more careful at his nefarious deeds. You've done us all proud there, Scooter.
        • Re:5% (Score:4, Funny)

          by Reziac (43301) * on Wednesday September 12 2007, @09:58PM (#20582785) Homepage Journal
          Place and time: somewhere in the Soviet Union in the 1930s. The phone rings at KGB headquarters.

                    "Hello?"

                    "My neighbor Ivan Asimov is an enemy of the State. He is hiding undeclared diamonds in his woodshed."

                    "This will be noted."

                    The next day, the KGB goons go over to Asimov's house. They search the shed where the firewood is
                    kept, break every piece of wood, find no diamonds, swear at Asimov, and leave.

                    The phone rings at Asimov's house.

                    "Hello, Ivan! Did the KGB come?"

                    "Yes."

                    "Did they chop your firewood?"

                    "Yes, they did."

                    "Okay, now it's your turn to call. I need my vegetable patch plowed."

    • Re:5% (Score:4, Funny)

      by mcpkaaos (449561) on Wednesday September 12 2007, @02:14PM (#20577429)
      I'm sure your neighbor will think so.
    • Re: (Score:3, Interesting)

      The coolest part of the project is a tool called Writeprint, which 'automatically extracts thousands of multilingual, structural, and semantic features to determine who is creating "anonymous" content' with an accuracy of 95%, according to the release."

      So when they get it wrong, and the police storm my front door instead of my neighbors, will it still be "cool"?

      5% error rate is too high to base any first-order data on. My assumption would be that they'll use this information to determine what online content to spend their time working on. For example, if the modern equivalent of Echelon tells us that a terrorist in Iraq makes frequent calls to someone who makes frequent, high-signal calls to someone in the U.S. and that person is identified as the potential author of several anonymous postings to various forums, then you spend a whole lot of time analyzing those

      • Basically the news is that they can cast a wider net. As far as we know the government's capabilities for monitoring high profile targets have not changed, it just scales much better now.
    • this would appear to be based on latent semantic analysis. see the wikipedia article [wikipedia.org] for some of the math. the group behind much of the work in this field are at U of Colorado. they have a site here [colorado.edu].

      • Re: (Score:3, Insightful)

        (remember when the branches of government were truely independent and this included the judiciary?)

        No and neither do you as that has never been the case. Checks and balances precludes true independence.
  • by halivar (535827) <bfelger@[ ]il.com ['gma' in gap]> on Wednesday September 12 2007, @02:10PM (#20577355) Homepage
    ...to out Dan Lyons as "Fake Steve."

    Other than that, I'm afraid this is the sort of technology that's only "cool" when it isn't being used on you.
  • by JamJam (785046) on Wednesday September 12 2007, @02:14PM (#20577419)
    Not to be confused with Darknet http://en.wikipedia.org/wiki/Darknet [wikipedia.org] which is what I immediately thought from this article title.
  • And yet another reason why you should lock down your wifi!

  • by Anonymous Coward on Wednesday September 12 2007, @02:16PM (#20577455)
    Attention, NSF: Here's a better, cheaper solution - point all those @#$@#$%ing existing VIAGRA and mortgage spambots out there at these forums you're monitoring.

    Either the terra'rists give up after the spamming, or they kill the spammers. Either way, we win.
  • by akad0nric0 (398141) on Wednesday September 12 2007, @02:16PM (#20577461)
    ...is:

    Quis custodiet, ipsos custodes
    - Juvenal
  • F or A? (Score:4, Insightful)

    by Slightly Askew (638918) on Wednesday September 12 2007, @02:17PM (#20577481) Journal

    Change NSF to NSA, and the summary would make just as much sense...except "terrorist" would be defined as whatever the current politicians in power decide it to mean.

    Space race, nuclear power, this kind of technology. Just goes to show, if you have a good idea, find a way to use it to further the war machine and political agendas and prepare to get buried in money. Can someone please figure out a way to weaponize a cure for cancer?

    • Re:F or A? (Score:5, Interesting)

      by ScentCone (795499) on Wednesday September 12 2007, @02:28PM (#20577667)
      Can someone please figure out a way to weaponize a cure for cancer?

      You mean kind of like how there are now lots more skilled laser eye surgeons in the private sector competing to give you better prices for your business because once the military decided to back providing that service to its pilots, there was a giant leap in people being trained to do the work during their rotations?

      As far as cancer: the military provides all kinds of basic medical research from which we all benefit. You'll see considerable military spending in epidemialogical studies, trauma treatment, etc. To the extent that, say, The Marine Corp is a weapon, the huge studies that can be conducted on the systematically collected health stats, DNA, etc., on a huge number of generally healthy people over several generations IS a part of all sorts of cancer (and other) studies.
    • Space race, nuclear power, this kind of technology. Just goes to show, if you have a good idea, find a way to use it to further the war machine and political agendas and prepare to get buried in money. Can someone please figure out a way to weaponize a cure for cancer?

      1) Find a cure for cancer
      2) Indiscriminantly irradiate the globe, giving everyone cancer
      3) Distribute the cure only to card carrying citizens

      There you go. Where do I get my money?

      Another good tactic is to create diseases which, based
  • This is something the National Science Foundation and University should be ashamed of. This will used to spy on Americans (and others) and will have little to do with terrorism. I'm sure it will be salable to many corporations as well.

    These jerks are the "extremists on line".

    • Ok I get the first part. Spying on our own citizen is bad, agreed, signed. Now can you explain why it is bad that it gets sold to corporations?

      Also, they should not be ashamed of creating the technology, but ashamed of how it is used if it is wrong. That is like saying inventing the plane was bad because it would be used to fight wars. Bad example perhaps, but you get the idea.
    • "Spying" (Score:3, Interesting)

      Since all this information is readily available to anyone one with internet access, I don't think it's reasonable to call it spying. Seriously, if you post information on a message board where anyone in the whole entire fucking wold can read it, maybe you should expect that government officials and corporations can look at it a well!!!
      • Re: (Score:3, Insightful)


        I don't think it's reasonable to call it spying.

        You're right, it's not spying, it's surveillance.

        That doesn't really make it any better, however.
  • ...that the Bush administration's definition of 'terrorist' includes Democrats, pot smokers, vegetarians, and people with two arms and two legs.
    • Re: (Score:3, Insightful)

      ...that the Bush administration's definition of 'terrorist' includes Democrats, pot smokers, vegetarians, and people with two arms and two legs.
      Then why was Vietnam veteran and triple amputee Max Cleland branded a traitor?
  • For those of us (like myself) that work closely with the banking industry, the phrase "NSF-Funded" produces quite a bit of cognitive dissonance.
  • I should have known better than to cut and paste whole postings from the jihadi discussion fora to rebut them point by point. Now if that software can't tell from semantic structure, what I said and what I quoted, I can expect some visitors, look like. May be I will post in Slashdot and display some esoteric knowledge like the plural for forum is fora and may be that will throw a monkey's wrench into their Beysian filters. Ha ha ha.
  • The coolest part of the project is a tool called Writeprint, which 'automatically extracts thousands of multilingual, structural, and semantic features to determine who is creating "anonymous" content' with an accuracy of 95%, according to the release.
    A way to track down the ACs who keep posting homoerotic rants and random trolls.

    This tech could destroy Slashdot as we know it!

  • by Lurker2288 (995635) on Wednesday September 12 2007, @02:57PM (#20578159)
    "The project relies on 'advanced techniques such as Web spidering, link analysis, content analysis, authorship analysis, sentiment analysis and multimedia analysis [to] find, catalog and analyze extremist activities online."

    Reminds me of something..."I'm ready, man, check it out. I am the ultimate badass! State of the badass art! You do NOT wanna fuck with me. Check it out!...Independently targeting particle beam phalanx, VWAP! Fry half a city with this puppy! We got tactical smart missiles, phase-plasma pulse rifles, RPGs! We got sonic, electronic ball-breakers! We got nukes, we got knives, sharp sticks..."
  • by sdaemon (25357) on Wednesday September 12 2007, @03:01PM (#20578217)
    Sure you can crawl any information source and extrapolate anything you want out of it. I'd even be willing to believe the 95% accurate analysis, whatever. That's besides the point.

    You can only extrapolate data you've read properly. The simplest of encryption and/or obfuscation schemes applied to this content would effectively protect against extrapolation. Sure, Big Brother can have software scrub the Net looking for suspicious content. But can they have software scrub the Net while applying decryption measures to everything found? While analyzing every image file for obfuscated content (or even something as simple as writing your terrorist plans on a piece of paper and scanning it in as an image)? While applying rot13 to every block of text found?

    I would say no. The problem becomes computationally impossible at that point. There are theoretically infinite ways to hide, encrypt, or obfuscate data. To have a system check first for unhidden, unencrypted, un-obfuscated data, then also for each of those, is simply not doable unless one makes radical limitations to the format of the data itself.

    I would say instead that this "Dark Web" will be invaluable in identifying characteristics of perfectly law-abiding forum posters, slashdotters, and so forth, and that the data gleaned will fetch a good price from directed marketeers, pharmaceutical companies, spammers, government bureaucracies, and other servants of the Dark Lord.

  • by icepick72 (834363) on Wednesday September 12 2007, @03:17PM (#20578453)
    This Dark Web description sounds good, it even uses "semantic" technology but stop and think how little progress Google has made into the semantic web compared to what they want to do, contrasted with the talent they have hired. Considder the description of this NSF tool again. I predict there will be another /. posting in just over a year talking about how the project didn't quite work out as expected.
  • by Fantastic Lad (198284) on Wednesday September 12 2007, @03:20PM (#20578503)
    They don't need expensive Dark Web nonsense.

    They just need to pull up their own employee roster to see who's largely responsible for world terrorism.

    Of course, the young recruits are probably still too busy puffing their chests smartly while humming the "Alias" theme music while quietly wishing that the NSA was the one which received the big Hollywood PR/propaganda effort to notice such sticky details as who was responsible for what. But what are a few sticky details? M's and W's all look the same.


    -FL

  • by nurb432 (527695) on Wednesday September 12 2007, @04:47PM (#20579715) Homepage Journal
    Another 'its for the children' type of maneuver.

    This should scare anyone that likes their right to free speech. And yes, even terrorists should have the right to *speak*. If you restrict their right to speak, its not much of a stretch to restrict yours too.

    Be afraid.
    • Not enough writing samples yet. It says:

      25% Kerry
      18% Gore
      7% Osama
      5% Hillary
      45% 3rd grader Stevie Able of 1209 Mayburn St, Dallas, Tx

      If you could post a few more messages please.
      • Am I the only person to google map this address? There is no 1209 Mayburn St in Dallas.

        However, I did find the following address:

        1209 N Mayburn St
        Dearborn, MI 48128

        Okay, its official. I'm a dork.