Stories
Slash Boxes
Comments

News for nerds, stuff that matters

Slashdot Log In

Log In

Create Account  |  Retrieve Password

Amazon Patents Humans Assisting Computers

Posted by kdawson on Tue Apr 03, 2007 06:54 PM
from the mechanical-turk dept.
theodp writes "Amazon's latest patent, the Hybrid Machine/Human Computing Arrangement, reads like scary sci-fi, with claims covering the use of humans 'of college educated, at most high school educated, at most elementary school educated, and not formally educated' to perform subtasks dispatched by a computer. From the patent: 'For examples, the task on hand requires French speaking humans, and Task Server has requested that each subtask be performed by at least 10 humans with a past accuracy record of at least 90%.' Yikes."
+ -
story
This discussion has been archived. No new comments can be posted.
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
 Full
 Abbreviated
 Hidden
More
Loading... please wait.
  • by oskay (932940) on Tuesday April 03 2007, @06:56PM (#18597141) Homepage
    predict that the first post will have something to do with our new robotic overlords....
  • In other news (Score:5, Insightful)

    by neoform (551705) <djneoform@gmail.com> on Tuesday April 03 2007, @06:57PM (#18597157) Homepage
    Amazon patents "using a computer".
    • Pretty much. Oh look, the computer can schedule tasks and send them to people. How innovative!
      • Except for the computer, it sounds like most of the jobs that I had during college. Thinking back, a lot of the bosses I had could have been replaced with comuters and everyone would have been happier.
        • There's a very good chance this is a semi-supervised machine learning thing.

          (Un-disclaimer: I do research in machine learning.)

          So you've got this algorithm that, if you give it a bunch of labeled data, it can predict labels for unseen data. (Maybe it labels current best-sellers as likely or unlikely to interest a customer based on his buying habits.) Great. Well, somebody's got to label that data. Human time is expensive. On the other hand, you need as much data as possible: the more the better.

          Semi-supervi
    • It sounds a little different, though, I haven't read the patent. This is more like a computer using a human to complete a task, and like they've established some probabilistic bounds that the task will be done correctly, which is actually pretty cool.

      It sounds kind of like having an interactive proof system, except that the prover is a person. It's kind of a unique twist from the patent side (though, perhaps not a giant conceptual leap), and it's not really a YRO issue, IMHOP, though one could imagine job
  • Insert disk... (Score:5, Insightful)

    by muffel (42979) on Tuesday April 03 2007, @06:59PM (#18597193)
    ... in drive A:

    I've done that since the 80's.

  • my computer told me not to read TFA. did i miss anything?
  • by Diomidis Spinellis (661697) on Tuesday April 03 2007, @07:02PM (#18597223) Homepage
    Amazon has already deployed such a system under the name of Mechanical Turk [amazon.com]. The idea is that humans assist computers, providing what is cutely named artificial artifical intelligence. You can read more about the concept in an article [acmqueue.com] that ACM Queue run on May 2006.
    --
    Code Quality: The Open Source Perspective [spinellis.gr]
    • by mls (97121) on Tuesday April 03 2007, @07:11PM (#18597353)
      Mod parent up

      On the "Data Improvement" front, I implemented something like this maybe 5 or 6 years ago. The company had a workforce of "lower" cost data entry staff, and when volumes of data came in over the web, we validated what we could programmitically, then routed questional records to human staff for cleanup and use in building a dictionary of sorts that made our automated process better. It was more cost effective to go this hybrid computing route than to throw lots of "expensive" programming at it.
    • Also, as the example clearly shows - only college educated persons can speak foreign languages! Everyone else is retarded!

      Let's do away with the academic level and focus on proven expertise and skill. Otherwise about 60% of our top CEOs and inventors would be off digging ditches somewhere.
    • Re: (Score:3, Interesting)

      The idea is that humans assist computers, providing what is cutely named artificial artifical intelligence.

      You can spin this as "humans assisting computers" but you can just as easily think of it as humans doing work in a workflow dictated by computers. This idea is very, very, common. I mean a call-center is just a place where humans "help" computers to answer questions from other humans. And an IT support system is a place where humans "help" computers to solve the IT problems of other humans. Amazon

  • ...but I couldn't help the machine because that
    would be against the patent.
    • ...but I couldn't help the machine because that
      would be against the patent.


            You should have posted as AC, because now the patent police (and SCO) are on their way to bust down your door.
  • by pak9rabid (1011935) on Tuesday April 03 2007, @07:06PM (#18597279)
    Automaker Ford was ganted the following patent: A hybrid automobile/human driving arrangement which advantageously involves humans to assist an automobile to solve particular tasks, such as transporting a human, or other non-human items such as freight...
  • what is unique about this? what makes this qualify as non-obvious? patents generally need to be issued to people that come up with ideas the person of average skill in the relevant field could not reasonably be expected to use. in short, why is the idea of using people to solve problems that computers either can't or are very slow/ineeficient at anything new? take google for example, their new image categorization game goes along these lines- using people's brain power to tag images- so the question is:
    • "...ideas the person of average skill in the relevant field could not reasonably be expected to use."

      That is not true.
      "...to promote the progress of science and useful arts, by securing for limited times to authors and inventors the exclusive right to their respective writings and discoveries.""

      about obvious:
      " Even if the subject matter sought to be patented is not exactly shown by the prior art, and involves one or more differences over the most nearly similar thing already known, a patent may still be ref
    • Re: (Score:3, Insightful)

      We have a very obvious prior art right here staring us all in the face... the moderation system on /.

      There is no way a computer (at this time) could actually rate posts as off-topic, funny etc so people (of various educational backgrounds) are assigned by the computer to process the information and return the result to the computer. This is then verified by others doing the same thing, as well as meta moderated and all the other bits that go into who gets selected to get mod points in the future.

      Gratz Ama
  • Interactive proof system with a human prover == not terribly scary to me.
    • Re:Eh? (Score:5, Insightful)

      by twitter (104583) on Tuesday April 03 2007, @07:58PM (#18597863) Homepage Journal

      Interactive proof system with a human prover == not terribly scary to me.

      Yeah, but a patent on it is. Even more scary is a patent on a program that really just prompts the user for input.

  • by daigu (111684) on Tuesday April 03 2007, @07:10PM (#18597321) Journal

    A hybrid [boss/worker working] arrangement which advantageously involves [worker] humans to assist a [boss] to solve particular tasks, allowing the [boss] to solve the tasks more efficiently. In one embodiment, a [boss/worker] system decomposes a task, such as, for example, [making a car], into subtasks for human performance, and requests the performances. The [C-level boss/worker] system programmatically conveys the request to a [lower level boss] of the hybrid [boss/worker] arrangement, which in turn dispatches the subtasks to [workers] operated by [line level bosses]. The [workers] perform the subtasks and provide the results back to the [line level boss], which receives the responses, and generates a [report] for the task based at least in part on the results of the [worker] performances [and the rest based on whatever crap H.R. wants to hear.].

    Your scary sci-fi scenario sounds remarkably like modern working life - refined by years of Taylorism.

  • by plams (744927) on Tuesday April 03 2007, @07:11PM (#18597337) Homepage
    ...by any chance be a viable replacement for the management where I work?
  • Sounds like what CAPTCHA farms already do.
    • Re:Prior Art (Score:5, Insightful)

      by QuantumG (50515) <qg@biodome.org> on Tuesday April 03 2007, @09:20PM (#18598547) Homepage Journal
      Oh boy. I tell ya. The concept of patent clearly isn't part of the education system.

      Imagine I invent a new kind of lawn mower. I file a patent to protect my invention for 20 years so I can commercialize it without having to worry about the existing lawn mower companies snapping up my invention and beating me to market. What's the title on the patent going to be? That's right:

      "A mechanism for the automated trimming of grass."

      In the patent I will describe how the mechanism works. What prior art there has been in automatted trimming of grass, why my invention is novel and how hard/easy it is to manufacture.

      So will get posted to Slashdot about it?

      "Man Patents Lawnmower."

      Then everyone will have a bit of a moan about how the patent office doesn't know what they're doing anymore and maybe they'll quote a few lines from the patent where I'm outlining what a lawnmower is with the intention of claiming that this is what I am patenting.

  • This video on Human Computation [google.com] describes using humans as part of a distributed computing grid for interpretting captchas, and categorizing images.

    ...And they'll actually particpate, en masse -- without pay -- thinking they're just playing an online *game.*
  • by emptybody (12341) on Tuesday April 03 2007, @07:17PM (#18597413) Homepage Journal
    RSS feed for this story stated

    "Amazon Patents Humans Ass"

    that had me rolling on the floor!
    • by Anonymous Coward on Tuesday April 03 2007, @07:21PM (#18597477)
      The irony is that if they had patented it, you'd be the one rolling on the floor, but they'd be the ones laughing your ass off.
  • by Anonymous Coward on Tuesday April 03 2007, @07:38PM (#18597667)
    It's all fun and games now but it won't be funny when the machine decides your next task is to "Give me your clothes" in an Austrian accent.
  • by CptPicard (680154) on Tuesday April 03 2007, @07:39PM (#18597683)
    ... although the thought is potentially offensive to some. Wouldn't working as a wetware computer-augmenting classifier be the perfect job opportunity for a mentally handicapped person? I mean, someone with a regular IQ would find it boring over time to tell apart cats and dogs in pictures, but it sounds like a challenge for someone who is not in possession of such faculties. And this is exactly the sort of task that is troublesome for AI, while it being trivial for even "challenged" people! Cross-check the responses, reward those who vote with the consensus, and you've got something that actually might even work as a teaching tool... and how many Down's syndrome people could say they hold a "computer job"?

    Don't flame me, I'm physically disabled myself and therefore am quite familiar with the troubles disabled people of all kinds face in particular when it comes to finding meaningful employment...
    • by Anonymous Coward on Tuesday April 03 2007, @08:07PM (#18597951)
      ... although the thought is potentially offensive to some.

      There's a lot of people out there who want to be offended and are looking for ways to be offended. Why? It's a form of bullying, IMHO. They want a reason to order you to change behavior. And when you ask them why they are offended, they give some half-ass answer. It's just a power trip.

      Sorry about your handicap and I'm sorry you had to mention it so that you wouldn't be modded "Troll" or "Flamebait".

    • by StikyPad (445176) on Tuesday April 03 2007, @09:07PM (#18598467) Homepage
      This would be perfect if it could be done from home.

      And my 5-year-old would be happy because he'd get to play "games" as much as he wanted.

      "Is it bedtime yet?"

      "I SAID CLICK ON THE DOGS!!!"
  • Already done (Score:4, Informative)

    by SeaFox (739806) on Tuesday April 03 2007, @07:45PM (#18597743)
    They already do this at Target.

    The employees all wear walkie-talkies and I've heard them come on with an obviously computer synthesized voice telling them a "guest" needed assistance in _____ dept. Or more team members were needed to cashier, ect requesting to know who would address the issue. And they would answer back to it just like they were acknowledging their boss's orders.
    • Re:Already done (Score:4, Informative)

      by Manchot (847225) on Tuesday April 03 2007, @08:52PM (#18598353)
      I think you're looking too much into this. I worked at Target during high school, and what you heard is far less sinister than you believe it to be. The computer telling the "team members" that a "guest" needs assistance is triggered by a customer picking up one of the service phones peppered throughout the store. The reason that the employees try to respond so quickly is that the phones have something written on them to the effect of "A team member will be with you within the next x minutes," and people get angry if you're not there fast enough.

      As for the "Additional cashiers to the front lane," that is actually triggered by the cashiers themselves via a button on their registers. Typically, the manager up front would just call for backup directly if there was a sudden wave of customers, but on occasion, the manager would be busy elsewhere. In that case, one of the cashiers could just press the button without stopping (i.e., slowing down) to do it manually. More practically, the cashiers aren't given walkie-talkies because the collective noise from ten nearby walkies would be disruptive to the customers. Also, the phones at each lane were tied into the walkie system, but it didn't work very well, and it was just easier to push the button.

      Probably the worst computer-control issue at Target was the "speed score" system. Basically, after every transaction, they'd assign you a score (either G for green, or R for red), indicating whether you were fast enough on that transaction. Your overall scores were then tabulated on a monthly basis. When I first started, you wouldn't know your score on an individual customer, and you could only know your monthly average. Being a 17-year-old, I tried to get the highest score possible, and I did pretty well (something like best average in the store for six months). However, about halfway through my tenure there, they switched to a system that showed you your score after each customer, which soon led me to see how flawed it actually was. You see, I quickly figured out that if not for the customers themselves, I would have gotten a G on every transaction. The problem was that the system basically worked by assigning every item an allowed scan time (so a thing of dog food might be 30 seconds, while a pencil might be 5 seconds). From what I could tell, it also allowed a certain amount of time for payment. What I noticed is that as long as there were a few items (about four or more), I would always get a G, no matter what. When it came down to just a couple of items, I would often get a R. Why? As it turned out, the customer would squander my allowed time by taking a long time to figure out the machine that Target uses for credit and debit cards. In the end, the only effect that speed scores had on me was to get me angry at the people I was supposed to be serving. Yes, you heard that right: I would get a little mad at people for not being efficient enough.
  • Why is this scary? (Score:4, Interesting)

    by Gordo_1 (256312) on Tuesday April 03 2007, @08:37PM (#18598235)
    You can see the type of work available for anyone to process on Amazon's Mechanical Turk right here: http://www.mturk.com/mturk/findhits?match=false [mturk.com]

    It's things like helping categorize images or finding specific things in databases of images or inspecting contracts -- you know the kind of stuff that's really easy for humans but is really difficult for computers.

    I've tried a few in the past, however, most of the available "HITs" pay only a few pennies a piece, so I'm not about to go quitting my day job to sit at home fulfilling these requests quite yet.
    • I claim the patent on the use of a fork and a spoon. Now you're all stuck using sporks!

            That's ok, I already hold a patent on chewing food before swallowing it. So if you want people to actually make any use of the fork and spoon, I suggest you pay me royalties. A billion dollars should do it. That way if you don't pay up, I can always sue google.