US Federal Government Launches Data.gov 109
Elastic Vapor writes "I'm happy to announce that the US Federal Government earlier today launched the new Data.Gov website. The primary goal of Data.Gov is to improve access to Federal data and expand creative use of those data beyond the walls of government by encouraging innovative ideas (e.g., web applications). Data.gov strives to make government more transparent and is committed to creating an unprecedented level of openness in Government. The openness derived from Data.gov will strengthen the Nation's democracy and promote efficiency and effectiveness in Government." I hope the data reported will be impartially selected, honestly gathered, clearly explained, and perfectly accurate. Perhaps they could start with inspiration from the Concord Coalition's National Debt Counter.
Uh-oh, here we go.... (Score:2, Funny)
Re: (Score:2)
www.data.gov gets slashdotted in 3...2...1...
But it isn't! Haven't looked at much of it but that's the first thing they got right. :)
Re:Uh-oh, here we go.... (Score:4, Insightful)
Openness or Control? I see it as a fail... You can probably get everything you need on google anyways... Unless it can tell me how to make millions and not pay taxes like the crooks in washington then its of no value
There's a couple problems with your 'thoughts.' First, you assume everything's already on the Web. That's totally false. Second, you neglect to realize what you can do with machine readable data. Instead of trying to build hackish page scrapers, you can now use various APIs and get bulk data dumps(depending on what the agency offers). Data.gov is freaking huge. Anyone that plays around with governmental data knows the power that this site will bring.
The only problem I see with it so far is that it's just a portal for the most part. It's a nice way to get at all the agencies' data in one spot but so far, as of this writing, it's nothing to rave about.
Re: (Score:2)
How I wish we could get something like this in Australia. You have more luck getting blood from a stone than getting data out of the federal and state agencies here. They protect their own interests and taxpayer funded data acquisition.
I generate a lot of visualisations on raw data and they all love it. But does that mean they give me the newer or full datasets? Fuck no. And you can see them making up excuses in meetings as the dodge it.
I hope that one day our government learns from what the US is doin
Re: (Score:2)
Re: (Score:2)
Says who?
Department of Homeland Security (Score:2, Funny)
Search for "millimeter"
0 results found
Also not found: CIA, NSA, NASA, Project Bluebook
Re: (Score:1)
Search for "millimeter"
0 results found
Also not found: CIA, NSA, NASA, Project Bluebook
I did the same search and my name came up in the National Genitalia Census ;)
Re:Department of Homeland Security (Score:4, Funny)
Try "0.039 inch".
Re: (Score:1)
Search for everything selected and... [data.gov]
A total of 27 results comes up. At least they got this database there for future use. Now all they need to do it create a part in the stimulus bill to hire all those newly graduated psychology degree holders to preform data entry.
Re: (Score:2)
I'll finally be able to know (Score:2, Interesting)
what you did last summer, free of charge.
Hope springs eternal (Score:5, Insightful)
Good luck with that, this is the government we're talking about...
Re:Hope springs eternal (Score:4, Insightful)
Yeah, I think sarcasm was his point. Personally I don't get it. Nobody's perfect, but I trust .gov data more than from private companies almost any day.
Re: (Score:2)
Yeah, because government agencies have no reason to manipulate data. We certainly have seen no evidence of costs being wildly underestimated when an agency is trying to get approval for a new program.
Do you know that states hire consultants to identify ways to change their operations so that they can manipulate certain metrics that result in more federal funding? This is a fake example, but if the feds give states more money if they have a welfare fraud rate less than 10%, then the state will a) increase ef
Re: (Score:1)
Re:Hope springs eternal (Score:5, Insightful)
He misses the point with his naivety, but you miss it with your cynicism. The data will still be incredibly useful, even if they're trying to game it, or sloppily collecting it, or if they're putting it up in an obscure, unorganized format.
A broad enough dataset can be used to determine things well beyond it's intended scope.
Re: (Score:2)
A broad enough dataset can be used to determine things well beyond it's intended scope.
Indeed, any regular reader of slashdot (or even better, any reader of RISKS Digest [wikipedia.org]) should be well aware of that.
Here's one example we all should remember:
http://consumerist.com/345219/researches-claim-to-reverse-netflixs-anonymization [consumerist.com]
Re: (Score:2)
Heh, that was exactly what I was thinking of.
The thing is, there is no way that they could really sanitize it without making it obviously worthless. You could try and seed it against certain types of analysis, but you can only do that for big obvious targets. Any target where you're coming at it obliquely...I don't see how they could do it.
That would be like trying to alter a dictionary to prevent someone from writing a certain novel.
Re: (Score:1)
Hey, I was being cynical, too (hence the link to the Concord Coalition ;)). But I agree with you -- no matter *how* bad it is (and I hope that much of it won't be bad at all), it will be useful for the very reason you name.
timothy
Re: (Score:1)
Re: (Score:2)
I hope the data reported will be impartially selected, honestly gathered, clearly explained, and perfectly accurate. Perhaps they could start with inspiration from the Concord Coalition's National Debt Counter.
Good luck with that, this is the government we're talking about...
What's funny about your cynicism is that the referenced website in the summary IS ALREADY depending on government data to function. The cited example is an example of an instance where the government is already living up to the promise you just scoffed at as impossible.
http://www.treasurydirect.gov/NP/BPDLogin?application=np [treasurydirect.gov]
Stick it in Wolfram Alpha (Score:5, Interesting)
Let's get some of this data into Wolfram Alpha. Then we query things and get simple charts and graphs that will scare the living hell out of the average tax payer. "Annual cost of tank treads"... "total corporate welfare"...
Re: (Score:2)
So take free information and stick it into something that will try to claim copyright on it and any presentation thereof. That is convoluted. At least you can look at the pie charts yourself, just don't show them to anyone else.
I was just inferring that Wolfram should crawl the data, not hold it.
So I would I have to attribute Wolfram if I published any charts garnered from Alpha? Holy crap that's so unbelievably unjust. You freetards are insane.
Re: (Score:2)
Would you please go back to 4chan, and troll there? Or brush up your character and behavior for a world a bit more real and non-anonymous?
Protip: Using a word that ends in "-tards", makes you look like an idiot. But it still pales in comparison to combining it with the word "free".
Re: (Score:2)
Would you please go back to 4chan, and troll there? Or brush up your character and behavior for a world a bit more real and non-anonymous?
Protip: Using a word that ends in "-tards", makes you look like an idiot. But it still pales in comparison to combining it with the word "free".
I think it's very good description for frothy-mouthed free software types. Would it be better if I called you guys louts or imbeciles or something? I am a very sensitive soul, so I just want to make sure that I am being as clear and accurate as possible and not stepping on anyones' toes.
Re: (Score:1)
I think it's very good description for frothy-mouthed free software types.
Who is a "frothy-mouthed free software type"? Someone who uses it? Someone who releases software under a free license? Someone who advocates the use of free software? Someone who advocates that all software should be free?
Re: (Score:2)
Who is a "frothy-mouthed free software type"? Someone who uses it? Someone who releases software under a free license? Someone who advocates the use of free software? Someone who advocates that all software should be free?
I would say it's the sort of person who attacks anyone who points out its countless shortcomings- not as a philosophy but as more implementation specific things. It's the sort of person who says that Ubuntu 9.04 is JUST AS GOOD as Mac OS X or Windows 7, completely ignoring any problems or usability pitfalls that might be present and attempting to silence anyone who says otherwise. They're the type of person who believe that anything that is "free" is always better than something proprietary, no matter how s
Re: (Score:1)
Re: (Score:2)
Hear hear!
Re: (Score:2, Informative)
Wolfram|Alpha mining sets like these would just take the whole process one step further by allowing non-exper
Mostly empty (Score:2)
There doesn't appear to be much data indexed yet, just data that has been publicly available for years.
Patent data? Check
Storm data? Check
Yawn. Call me when the FBI starts uploading data.
Re: (Score:1)
Now renamed (Score:1)
Hacked Data dot com. Coming to an Identity Theft near you!
Limited but good potential (Score:3, Interesting)
IIS, once again (Score:4, Informative)
Bah!
Re: (Score:3, Insightful)
Re: (Score:2)
Re: (Score:2)
What's so proprietary about dbf? It's so ancient, the specs themselves are old... f.i. here's some [clicketyclick.dk]. I'm sure there are many free/oss converters too.
Have you ever tried to work with DBFs with any open source tools out there? It makes me want to break my fingers so I can't type and have an excuse not to mess with it.
GoogleBot... (Score:2)
"More input, more input!"
They should hire the wallstats ``death and taxes'' (Score:2)
poster guy:
http://www.wallstats.com/deathandtaxes/ [wallstats.com]
Or at least learn from it and similar presentations.
William
Unbiased opinion? (Score:4, Insightful)
...committed to creating an unprecedented level of openness in Government. The openness derived from Data.gov will strengthen the Nation's democracy and promote efficiency and effectiveness in Government.
That sounds like it was written by the Ministry of Truth. No one should ever read something like that without huge warning bells going off.
Re:Unbiased opinion? BLAME CANADA (Score:2)
Hmm... that Elastic Vapor guy is from Toronto, Canada. It seems FOREIGNERS are very happy indeed about this new database.
So, how many days until the 10:00 news is crowing that Obama is spending our tax dollars to give American secrets to other countries?
Re: (Score:2)
p.s. Even worse, he's doing it ON THE INTERNET! Just like a CRAIGSLIST call girl!
Re: (Score:3, Funny)
Fox was reporting recently that higher fuel efficiency standards put your family's lives on the line. When really it's driving that does that.
So it shouldn't be too long.
Re: (Score:2)
While that statement is a bit extreme...it does have some possibilities that way.
To get a car with super low mileage, it will have to be quite small, and light...possibly affecting how it would end up on the wrong side of a crash with another car.
Remember...those old cars, trucks and SUV's aren't going to disappear immediately, they'll be around for decades. And in an accident with a little econo ligh
Re: (Score:1)
In both cases no one had more than bruises. In the first case, both vehicles were totaled (Equal damage). In the second case, we drove away and popped the dent in the plastic back out with a prybar leaving only creases in the paint while the truck was leaving coolant and the front frame was badly damaged.
Re: (Score:2)
Not necessarily....but, I don't think it should be the federal govt. dictating what cars companies can make. Let them come up with all types of cars for all types of tastes, and let the market decide. Thing is...we need to be willing to let a company fail if they can't get it right.....newer ones can start up to take their place. Hell, let them go into bankruptcy, and shed those anchors of labor contracts that are an outdated burden on the US
Re: (Score:1)
...what part of it sounds like it's from the Ministry of Truth?
I mean, really. I've worked with data from a myriad of sources and I can guarantee you that the US government supplied data is by far the cleanest, most unbiased stuff out there. (And, no, no one's going to have the resources to estimate national GDP going back a century and a half other than the US government.)
Re: (Score:2, Insightful)
The data itself could be heavily biased, but since the current data sets seem to be census data and similar sets(taxes, marriage/divorce rates), it doesn't seem to have the aim of a propaganda tool currently.
It could be turned to one to be sure, but if it does provide moderately raw data sets then I'd say it would promote democra
Will it change with each new administration? (Score:5, Insightful)
Re: (Score:2)
That's not the real issue. Data.gov and other measures of transparency are really a double edged sword.
On the one hand, they *try* to get government to seem more accountable and transparent. Supposedly, when the government wants to say... bailout a bank, you will have the ability to see that money is going.
On the other hand, it might actually lead to more centralized government in the false belief that we can keep checks on things via this 'transparency'.
Unfortunately, a lot of people... who have never ra
Re: (Score:2)
Not everyone shares your philosophy. Personally, I trust the federal government much more than I would trust state or more local levels of government. There are risks of misgovernance at *any* level, and tearing down the centre just makes civilisation run more bumpily.
finally! (Score:1)
A /. post I can USE!
PS: The data you get from the US government is infinitely more reliable than from any other country out there. Need I say: China?
"creative use" (Score:2)
if they really want "creative use" of government data, they'll release those interrogation photos so we can finally get to work photochoppin'.
Couldn't do it. (Score:2)
At which point I was glad that the article was essentially over, because I couldn't suspend my disbelieve any longer...that, and I was laughing hysterically.
Timothy (Score:2)
Sorry, but HA.
webservice? (Score:1)
is this just a list of data from other government sites? why no central proxy, web services, atom feeds, or other useful features besides just linking?
Re: (Score:2)
is this just a list of data from other government sites? why no central proxy, web services, atom feeds, or other useful features besides just linking?
So far, yes. But it sounds like they will eventually become a clearing house of the data. It's a start.
America is not a Democracy (Score:2)
As much as the Left would like for us to be, we are NOT a democracy. We're a constitutional Republic.
Your point is? (Score:2)
So, apparently, it's not important for the electorate in a republic to have information available, which might help them be better informed voters? Yes, the USA is not a *direct* democracy, but I've always been taught that a republic is a type of democracy.
Re: (Score:1)
As much as the Left would like for us to be, we are NOT a democracy.
A direct democracy? No. We use a form of representative democracy [wikipedia.org].
We're a constitutional Republic.
And in common American usage of the term Republic just means a form of representative democracy.
Mirror it quick (Score:5, Interesting)
I hope someone will mirror the data there the instant it appears, so when someone in power decides that an inconveniently revealed truth needs to be shoved down the memory hole, a web app will instantly highlight any redacted information.
Re: (Score:2)
http://wikiscanner.virgil.gr/ [virgil.gr]
So many uses (Score:2)
It would great if it includes data on legislation and if that data can then be tagged by industries (health care, telecom, etc) impacted by the legislation. The data can then be cross-referenced against campaign contributions, and we can extrapolate who voted on what based on how much money they received in contributions from the effected industries.
It would be great if the contents of political speeches were uploaded, and that data tagged by interest group. The speeches can then be cross-referenced again
Vague website name, or vaguest website name? (Score:2)
I just feel like it could be a little more vague. I suggest "thing.it" or possibly "yadayadaya.da".
Re: (Score:1)
I find it hard to believe that you can't connect the dots between 'government data' and 'data.gov'.
Well, never mind, this IS Slashdot... the 'data' stands for 'data' and the 'gov' stands for 'government'.
HTH
Re: (Score:2)
As opposed to all the non-data being posted under the .gov domain?
Re: (Score:2)
As opposed to all the non-data being posted under the .gov domain?
Ideally all of the other data on .gov would be available on Data.gov as well.
What would you suggest they call it?
DataThatIsAvailableElsewhereOn TheGovDomainButFormattedForEasyParseingAndDataMining.gov
It's a website that provides government data. Government Data. Data.Gov. I don't know how they could be more clear and accurate in their description.
Re: (Score:2)
What would you suggest they call it?
Isn't it obvious? This site is going to wind up pointing to a lot of other sites that ACTUALLY hold the data, like census.gov or irs.gov, because departmentalizing things like that always works better than trying to jam it all together into one hairball. So what do we call things that point you other places based on categories of interest?
index.gov
directory.gov
Hell, I'd even settle for home.gov or start.gov. But data.gov? That's just silly.
Change we can believe in? (Score:2)
Where's the new era of openness we were promised?
The contrarian view (Score:1)
While I consider openness to be an extremely desirable trait of government, I must question the goals of efficiency and effectiveness. The first examples I think of when I hear the phrase "efficient government" are Nazi Germany and Fascist Italy. Until they got obsessed with endless warfare, they were quite efficient governments. They got the trains to run on time! They kept met
Tomorrow's headlines today! (Score:2)
Slashdot, 5/22/2009: "1 TB disk stolen from data.gov"
laboratoryofthestates.com (Score:3, Interesting)
I did it on no money and it has more data than data.gov.
Re: (Score:1)
Re: (Score:2)
True enough but my money ran out in 2002 and I've been dumpster diving ever since.
bfrpsw continues: I set up my own access to US Economic data from US government sources: http://www.macrospect.com./ [www.macrospect.com]
Excellent!
One of the things I've been thinking of promoting is a compression prize, similar to the Hutter Prize, but where the corpus is economic data instead of textual knowledge.
Of course, this would separate the men from the boys in economics so it
Maybe my wiretaps will be on there? (Score:1)
Redundant? (Score:1)