Computers May Thwart 2010 Census 287
smooth wombat writes "With the Constitutionally mandated census of 2010 just around the corner, it appears the Commerce Department's attempt to use handheld computers to gather census information may not come to fruition. Originally, the contract was awarded at a cost of $596 million to Harris Corporation. However, the GAO has now estimated the revised contract, now costing $647 million, could grow to $2 billion and the equipment may still not work properly. There is consideration that the paper and pencil method might have to be employed to complete the census."
Any history buffs out there? (Score:5, Interesting)
Re:Any history buffs out there? (Score:4, Funny)
Re:Any history buffs out there? (Score:4, Funny)
Re: (Score:3, Interesting)
Re: (Score:3, Insightful)
Re: (Score:3, Interesting)
Re: (Score:3, Informative)
Anyone have any idea... (Score:4, Insightful)
Re: (Score:2)
Re: (Score:2, Insightful)
Re: (Score:2)
Re:Anyone have any idea... (Score:5, Insightful)
The problem is if they put them out for bidding as fixed price contracts they probablly wouldn't get any bids and if they did those bids would be very high. So the bids are only estimates. Of course this makes the bidding a farce as everyone tries to put in the lowest estimate they can and sponge more money later once the governement department is locked in.
Re:Anyone have any idea... (Score:4, Interesting)
Re: (Score:3, Insightful)
Unless there are only two bidders.
Re: (Score:2)
b) Sheer greed to milk the Gooberment contracts for all they are worth.
c) All of the above.
Re: (Score:2)
Re: (Score:3, Funny)
And, what, exactly, do you have against equal opportunity?
Re: (Score:3, Insightful)
The decennial census absolutely needs to be a turn-key operation for the tens of thousands of local recruiters and trainers. When you have an organization that exp
Re: (Score:3, Informative)
Re:Anyone have any idea... (Score:5, Interesting)
Yay for non-technical decision makers making technical decisions!
My favorite procurement/supply story is from a guy I worked with in the Navy; we needed a switch for some system that required replacement parts to be some super-special reliability grade, so he got the part number and called up the company from home. "Hi this is Billy Joe Ray Bob's electronics supply in Podunk, Lousiana; I need a BR-549 limit switch, how much are they?" The answer was something like $12.
He calls back a week later as Petty Officer so-and-so from the USS Neveryoumind, and then the BR-549 limit switch costs $349. Apparently the super-special reliability grade sticker they put on it after they take it out of the bin costs $337.
Re: (Score:3, Informative)
Re: (Score:3, Interesting)
Open source (Score:3, Funny)
Re: (Score:3, Informative)
The article says they only had a 1% failure rate in field tests. I bet the crew of 20 to 30 year old tech guys had no issues with it. They under esimated the end users. Yes, some systems are very simple but you still find people that can't figure them out. Not only were more computers "breaking", the support calls would have been greater then expected.
With electronic, you now have to pay for the support of that electronic component.
1% error (Score:4, Insightful)
Re:1% error (Score:5, Insightful)
You're on a jury for a murder case with the scenario that a tan/brown man seen running away from a murder scene on a college campus. There was not enough of the attacker's DNA at the scene, but they were able to extract a DNA derivative that has matched that of a tan man in custody. Given that this derivative has a 99.9% successful rate, do you feel comfortable convicting the man in custody.
I was the only one in my group of 12 to say "No, I will not convict based on this evidence." No one else understood that
Most people know what "fifty" is. Many know what "one hundred" is. Few understand what "one thousand" is. Too few understand the effects of millions, billions, and trillions.
There's no way I'd convict with a
How to get big numbers across (Score:5, Informative)
Comment removed (Score:4, Funny)
Re: (Score:2)
Re: (Score:3, Insightful)
As far as 99.9% certainty...It's almost impossible to get that good in the real world. What would be your standard for guilt? Eyewitnesses, fingerprints, photos; for the most part they're not 99.9% accurate for identification purposes.
It's an ugly inductive world. You're never going to be 100%
Re: (Score:3, Informative)
Re: (Score:2)
wow... ideal role for the XO (Score:3, Interesting)
Re: (Score:2)
Hey, kids:
The portable hardware probably isn't the difficult part, here. For fuck's sake: I've got more than enough horsepower in my 4-year-old Palm Zire 71 to organize, contain and transmit the output of one census worker.
Which is cool, I guess. But all of the overpowered portable hardware in the world will not change the fact that the software and back end required to make it useful DOES NOT EXIST.
Horrible... (Score:3)
Re: (Score:3, Informative)
See for yourself: http://www.census.gov/dmd/www/pdf/d02p.pdf [census.gov]
Are you serious? (Score:5, Insightful)
1.4 billion is one hell of an overrun...and after all that, the equipment may still not work properly?
Is the Harris Corporation currently hiring? I'd like to get me some of that boondoggle.
Re:Are you serious? (Score:4, Interesting)
Re:Are you serious? (Score:5, Interesting)
Re: (Score:3, Insightful)
Something this large and complex probably results in "gripe room" for both sides. The company can probably cite delays or problems with information, personal, staff testing, etc. that the gov't was supposed to supply but was either late with or bungled. And there's probably some vague contract wording that can be used as a weapon by both sides. It's an age-old dance with these kinds
Another waste of money (Score:3, Interesting)
But there is no reason that counting people should cost over half a billion dollars.
We should be able to contract this out. Offer maybe a mere 50 million dollars to the entrant that can produce the best results. Anyone can enter. They do their counting by whatever legal method they choose. THEN the census dept does their random counties, and whoever is closest on those counties gets paid, and their results for the whole country are used.
BTW, I'm assuming here that a census should be just counting heads; that all of the other questions that the census people ask, such as level of education, are none of their business. The constitution requires that people be counted. The goal was to ensure proportional representation. It does not require all of the intrusive questions that they ask now.
Re:Another waste of money (Score:5, Insightful)
You are not required to answer any other question on the census, either.
You can really just say "nine people live here, go away" and they will.
All that information IS necessary for the government to provide all the services they provide today in a reasonable and efficient manner.
Unfortunately, it would also require that those in charge be interested in reason or efficiency. All they want to do is separate you from money.
So, I agree, but only in that the government should get their nose out of places it doesn't belong in a more general sense. Unfortunately, we could probably argue about what those things are all day.
Re: (Score:2)
You are not required to answer any other question on the census, either.
Unfortunately not true, look at 13 USC 221 [cornell.edu], which is the current controlling law for the census.
Unfortunately, the way the original Constitutional requirement was written said
"[The Census] shall be made ... in such Manner as [Congress] shall by Law direct."
Which of course the Congress uses to basically do what ever they want, including requiring more information than just a head count.
Re: (Score:2)
Re: (Score:3, Interesting)
This is because of the fallacy of believing the pie is only so big, and has to be divided equitably. However, the pie is actually variable in size, and all one has to do is increase the size of the pie by working to increase one's proportion of the pie.
There are plenty of unemployed people unwilling to work at any wage under a certain amount, even though they aren't qualified to do any work that provides such a wage as the
Re: (Score:3, Informative)
Re: (Score:2)
Re:Another waste of money (Score:4, Insightful)
But the fact is that you can never know enough about a person's needs and circumstances as the person himself. Leave him alone, quit meddling in his life, lower his taxes ( by not wasting his money on cencus boondogles ) and he will probably get rich on his own.
Re: (Score:2)
unconstitutional (Score:2)
The Dems prefer a count while the Repubs would go with an estimate. An estimate is more accurate for people who own property.
Re: (Score:2)
It doesn't cost that much, Harris is simply trying to pull shenanigans and get some free money for a project they plan on failing already. This is the status quo for government projects.
You should check out the screw ups that dont get press. Hell look at the overruns on the mess that is the "big dig" you cant tell me there is not some shady things going on there.
Why not use home PCs? (Score:2, Interesting)
Re: (Score:2)
They already send census forms by postal mail. The door-knocking is for households that don't fill out the forms. Maybe they could increase the response rate with a website - it's probably worth trying - but there'd still need to be knocking on doors.
Re: (Score:2)
Re: (Score:2)
Wow, I never knew so many people lived at the public pool....
And no one lives downtown apparently...
*sarcasm off*
How exactly would you be able to trust any sort of information you received via a volunteer internet based collection?
Re: (Score:3, Informative)
2. Because participating in a census is voluntary and thus any numbers you garnered in a digital census would be skewed to unfairly ove
Perhaps ballot stuffing (Score:2)
Re: (Score:2)
Canada's been there, done that (Score:3, Interesting)
Sure you can. I submitted my census questions via secure website during the last census in 2006...but that was in Canada. It was easier, and certainly less expensive to process (didn't save paper though, because everyone still got the mailer; you could fill it in and mail it back or log in with the information provided in the mailer).
I'm not sure about how it goes in the US, but sending out canvassers only covers about two percent of data co
It's the people stupid (Score:2)
Re: (Score:2)
1) web based fill in for address
then
2) no spoken for addresses - mail out form
then
3) have postal workers get the info for the remaining addresses
all being spaced out by a few months..
i mean.. the post office basicly visits every location every day 6 days a week (i know not ALL but damn close percentage wise)
really i just don't undertand why the hell it is all that fucking hard.. sure people can poke holes in what i posted.. but others can fix them.. but 2
What the hell is a GAO? (Score:2)
What's Wrong With Paper? (Score:2)
It doesn't even have to be nice paper, just as long as it can be written on.
Re: (Score:2)
http://wiki.43folders.com/index.php/Hipster_PDA [43folders.com]
I'd be willing to provide say a million of them for a mere 20% of that projected overrun.
Sheldon
Re: (Score:2)
It's awfully useful to have data in computer storage if you want to query it for information.
Consider this question: What is the median income of urban black males ages 30-37?
Now consider answering that on a computer - if the data's in an SQL database, that's like two queries. In contrast, answering that that given a warehouse full of filing cabinets is basically impossible.
What? (Score:2)
Re: (Score:2)
Is Diebold making the computers? (Score:5, Funny)
This is simple... (Score:2)
Without the need to gather all that other illegal crap ("How many toilets in your household?"), a census take needs little more than a cheap handheld clicker.
Re: (Score:3, Informative)
Use the Post Office (Score:2, Insightful)
Re: (Score:2)
Re: (Score:2)
The census is conducted by mail. The census workers are there (among other reasons) to contact people don't return the mail-in form by the cutoff date...
Fron TFA: They would use the computers to collect and transmit information from residents who failed to return the census forms mailed out by the government.
How is it the computers' fault? (Score:2)
Foreign census experience (Score:5, Interesting)
The whole census survey took about 15 minutes. They collected a lot of data - I'd say there were between 60 and 80 questions. Since I'm a geeky sort of person, I asked the kid how it worked and he showed me - the PDA (a Compac Pocket PC) just ran a macro in MS Office which dumped each survey as a file into a folder. That folder synced via wireless/mobile-phone link to where the main data center was.
The country has a population of about 4 million, and he said there were 200 people doing the survey for several months. Seemed pretty straightforward, and I can't imagine it cost that much - certainly labor and not the PDAs was the primary expense.
Re: (Score:3, Interesting)
This stuff is trivial to implement if you do it right, and all it takes is commodity Palm hardware (or PocketPC hardware running an emulation layer, or Windows tablets). It's trivial to do, syncs automatically, and can export all the data
Paint me Blue... (Score:3, Insightful)
Major IT failures seem so common (Score:5, Interesting)
I mean, what is it with these large scale IT projects? They take a simple problem and turn it into a money pit. Here in the UK we've had several high profile massive budget IT failures in the last 10 years, air traffic control, national health patient record databases, in fact the more critical it is the more of a spectacular unqualified fuck-up it becomes.
Now, if you got a couple of average hacker nerds and gave then the same specs, but didn't tell them it was for a large scale project, or for whom, they would give you a faultless solution using commodity hardware, stock methods and free software in a few months at one *millionth* the cost we're looking at here. Every one of you here knows it to be true. So, my question is, what goes wrong? How can it possibly go so wrong? Are the people involved complete idiots? Or corrupt?
What are the factors that turn a simple software project into an impossible task? Is it the stress of high budgets? Too many crooks spoiling the broth? And more to the point, when is some bright person going to break from this pattern of failure and realise that to award a major government IT contract to *more than one* complete no-name outsiders bidding a fraction of the cost makes more sense than giving billions of dollars to one contractor and putting all your eggs in one basket?
Re: (Score:2)
Re:Major IT failures seem so common (Score:4, Insightful)
I can refute it without even breaking a sweat. The Manhattan Project. The Apollo Project. The creation of the Polaris, Atlas, and Titan missiles... The creation of nuclear powered ships... Etc... Etc... Big ticket projects all - unqualified successes all.
Mostly because we really don't have all that much experience building huge monolithic IT projects from scratch and to spec. The vast majority of the [truly tremendously] big IT projects to date (the telephone system, the networks big banks use, etc...) have been built piecemeal and grown from small beginnings.
I know it's a common conceit of IT workers to believe so. I don't believe for a single second that it's true. 'Average Hacker Nerds' have essentially zero experience in building large systems, triply so for distributed ones.
Or, just maybe, the projects are Really Hard in extremely specialized project domains.
The persistent belief that these projects are 'simply software' and thus easy to do. Especially among people with essentially zero knowledge of the problem domain(s) and the issues involved.
How can they possibly fuck this one up? (Score:2, Interesting)
Silence of the Lambs (Score:2)
--Dr. Hannibal Lecter
Who can you call? (Score:3, Funny)
Re: (Score:2)
No, that was his manned lunar mission. He made the consensus with a rolled up newspaper, an apple and an old rusty cookie jar.
Old tech keeps working... (Score:2)
Dear Commerce Department, See: Why OldTech Keeps Kicking [slashdot.org]
Paper and Pencil? How's that work? (Score:2)
Countee: [waves hand] "These are not the droids you are looking for...hee hee!"
Counter: [pulls out pencil and checks 'dork']
I am waiting for the day when (Score:2)
Ferchrisakes, this is WHAT GEEKS DO all day long.
Add a blind double check security login so that people can be counted at home on their computers. Then only check those with addresses and no data as well as addres
why not (Score:2)
Incompetent Buffoons (Score:2)
The fact of the matter is this job could be done with this setup:
-Each hand held machine would collect data as it's received and store locally.
-Once back at the office they would be connected to the LAN with an Internet connection to a main server at census offices with an SSL encryption
My Other Computer is a Pencil... (Score:3, Insightful)
Coincidentally, my first paying job was working as a US Census enumerator for the 1980 census. Paper worked fine. The real problems were with my fellow citizens who didn't want to be enumerated (which I can understand, though calling the police on me seemed like overkill).
Finally, apropos of this topic, I recently discovered that the best "organizer" in the world is an empty file folder (or perhaps several) and a supply of sticky notes. Portable, easy to reorganize, no problem if you run your car over it, easy to back up, etc.
pork (Score:2)
Tech issues aside, the mere fact that we are spending half a billions dollars on the equipment alone, should be enough to tell us it's a rip-off. Whoever gave out that porky contract should be tarred and feathered.
As for tech: Technology is all about giving more bang per buck. When it gives you less, then you shouldn't call it "high tech." It sounds like these computers are lower technology than paper and pen; i.e. an engineer would look at the problem, say, "aha! I have an idea!" and propose upgrading
Canada had census forms online in 2006 (Score:5, Informative)
http://www.cbc.ca/story/canada/national/2006/04/27/online-census060427.html [www.cbc.ca]
While searching for a reference article, i found that there were some issues with Linux users, although they attempted to correct it.
http://www.linux.com/articles/54366 [linux.com]
Republicans are "Computers"? (Score:3, Insightful)
Maybe this really is all just some kind of Y2K bug VR nightmare. Would someone please reboot Gore, so I can go back to watching _the Simpsons_ when it was still funny?
It is done elsewhere (Score:4, Insightful)
Why doesn't the government just outsource the whole census to a market research company and be done with it?
Break the Law (Score:3, Interesting)
http://www.usatoday.com/news/nation/2007-03-30-census-role_N.htm [usatoday.com]
With the current "war on the unexpected" who knows how current census data will be used to abuse citizens like yourself.
Good old government waste. (Score:4, Insightful)
Still, that doesn't excuse the government's stupidity. It's like that stimulus package. As if enough money hasn't already been dumped into that some halfwit decided they needed to send out letters informing recipients that they were going to be receiving these checks. In many cases these notices will be arriving barely a month before the check arrives. Sending these letters out has cost the government over $40 million.
It's time the government's budget were capped at the rate of inflation making allowances only for population growth. It's time they learned how to manage their expenses like the rest of us have to.
Re: (Score:2)
And that's good news!
Re: (Score:3, Interesting)
Re: (Score:2)
Re: (Score:2)
Furthermore, the Constitution of the United States REQUIRES that an ACTUAL ENUMERATION occur every decade. This effectively precludes the use of statistical sampling techniques.
All things considered, given the massive amounts of money that we spend on other pointless endeavors, the relatively low cost of conducting an accurate census does not bother me much.
Now... the cost overruns due to faulty contracting... t