Follow Slashdot blog updates by subscribing to our blog RSS feed

 



Forgot your password?
typodupeerror
×
Privacy Businesses Facebook Patents Social Networks

Facebook Patent Imagines Triggering Your Phone's Mic When a Hidden Signal Plays on TV (gizmodo.com) 169

Based on a recently published patent application, Facebook could one day use ads on television to further violate a user's privacy. From a report: The patent is titled "broadcast content view analysis based on ambient audio recording." It describes a system in which an "ambient audio fingerprint or signature" that's inaudible to the human ear could be embedded in broadcast content like a TV ad. When a hypothetical user is watching this ad, the audio fingerprint could trigger their smartphone or another device to turn on its microphone, begin recording audio and transmit data about it to Facebook.
This discussion has been archived. No new comments can be posted.

Facebook Patent Imagines Triggering Your Phone's Mic When a Hidden Signal Plays on TV

Comments Filter:
  • Or someone is, anyway. All this means is now it's gonna start getting ugly for their competition.

    • by Tuidjy ( 321055 )

      Oh, really? They are already doing it?

      Can you please explain to me how you can possibly 'trigger' your microphone only after when you detect an 'inaudible' signal from the TV? If they have a way to detect a signal before turning on the microphone, it's sure worth a patent!

      Of course, I'm just being facetious. It's probably the summary that is misguiding, as usual. In order to detect the signal, the microphone needs to be already on, i.e. the Facebook app has to already be listening to everything the phon

      • by Calydor ( 739835 )

        You realize the Facebook app on an average phone has already been granted access to the phone's mic and could have it running constantly, listening for such an activation sound, right? So when it gets its wakeup call in bat-level frequency it starts recording and transmitting to the mothership.

    • This is pretty much how all broadcast TV is tracked. Neilson gives families trackers that listen for signals and then collects them. These psychoacoustic encodings are broadcast every 2.5 seconds. Facebook seems to have patented using a smartphone to do this rather than a dedicated device.

      https://www.google.com/amp/s/w... [google.com]

  • by Rick Schumann ( 4662797 ) on Wednesday June 27, 2018 @05:55PM (#56856452) Journal
    1) You patent an idea like this so that nobody else can use it.
    2) You're fucking evil and don't give a fuck about silly frivolous things like people's privacy rights, you want all the data so you can sell it to the highest bidder.

    Time to dismantle Zuckerbook once and for all, and pass legislation preventing any company from pulling the sort of shit Zuckerbook has been perpetrating for years now.
    • Comment removed (Score:5, Insightful)

      by account_deleted ( 4530225 ) on Wednesday June 27, 2018 @06:05PM (#56856512)
      Comment removed based on user account deletion
      • by Rick Schumann ( 4662797 ) on Wednesday June 27, 2018 @06:46PM (#56856680) Journal
        The average person has a threshold that they have to be pushed beyond before they'll actually take anything like this seriously. What makes matters worse is that the average person has been so thoroughly indoctrinated by Corporate America and so-called 'social media' sites that sharing everything is what's normal and natural, and that people who want 'privacy' either have something wrong with their brains, or they're criminals with something to hide. With any luck this will all eventually catch up with everyone and there'll be a revolt. Until then all you can do is stay on-message, be consistent, and do what you can to protect yourself (i.e. don't use 'social media', so you're not part of the problem).
      • by rgmoore ( 133276 )

        Privacy? They say they have nothing to hide.

        I don't have anything to hide when I'm taking a shower, but that doesn't mean I'm OK with somebody recording it.

        • A few years ago, when privacy issues started being issues, I used to tell the "I have nothing to hide therefore I have nothing to fear" people that I'd like to install cameras and microphones, all internet-facing, in every room of their house, broadcasting 24/7. Naturally they objected to the idea; "Why would I let anyone do that?" to which I'd say "Gee, I thought you had nothing to hide and nothing to fear; were you lying when you said that?". Hilarity ensues as they get all indignated over it. Sadly, the
      • by MrKaos ( 858439 )

        So what can you do?

        Install malware on their phone and use their credit card ;)

      • Don't worry: they can't patent kidnap and bank robbery!

        or can they?

        Don't miss next week's thrilling installment!

        • by q4Fry ( 1322209 )

          Don't worry: they can't patent kidnap and bank robbery!

          or can they?

          Don't miss next week's thrilling installment!

          No they can't. The Government already has prior art.

      • Re: (Score:3, Informative)

        by mjwx ( 966435 )

        What can really be done?
        I explain shit like this to people, they call me paranoid.
        I show them proof, they say they don't care.
        Privacy? They say they have nothing to hide.

        Then when their private details and credit card numbers are published online they shout "why didn't someone do something about this" in shrill nasal tones.

        Someone could have done something about this Karen, you could have Karen. But you said it was too hard and too inconvenient to practice a few basic self preservation measures. You wanted to gratification now Karen and this is how you pay for it. I swear you'd still take sweeties from strangers if your mother didn't drill it into your head as a kid, I s

      • I explain shit like this to people, they call me paranoid.
        I show them proof, they say they don't care.

        "Whoa now, you just called me paranoid over this. Like someone was out to get me. Do you really not care that people are out to get you? Why was it paranoia 2 seconds ago, but now it's a non-event?"

        Privacy? They say they have nothing to hide.

        "Oh yeah? Mind if I see your phone and look through your browsers history? Chat history? Call list?"

        "How about your senator? Your boss? So you're a boring person, fine, no one is likely going to waste too much time going over your grocery list. But how would you feel if your boss had no privacy and everyone's sal

    • If they were interested in option 1), they could just write an article and publish it somewhere which would make it prior art. Since they spent money and time on a patent application instead, I'd say 2) is the only option.

    • by ph0rk ( 118461 )
      What, you think Google is any better? The war is over. Privacy lost.
      • Pussy little cowards like you are the reason that evil flourishes. You can't be bothered to stand up for your own rights, so you get assraped by whoever decides to do it to you, then just to prove what a useless waste of oxygen you are, you have the audacity to complain about how 'nobody is doing anything about it'. Meanwhile you're all "Thank you sir, may I have another?" to Facebook, Google, and whoever else decides to shove their virtual penis into your private-data-anus. Fix your shit, get correct, or k
    • 1) You patent an idea like this so that nobody else can use it. 2) You're fucking evil and don't give a fuck about silly frivolous things like people's privacy rights, you want all the data so you can sell it to the highest bidder. Time to dismantle Zuckerbook once and for all, and pass legislation preventing any company from pulling the sort of shit Zuckerbook has been perpetrating for years now.

      I'm not even sure how this patent is supposed to work. How does your phone know to trigger the microphone unless the microphone is already triggered? Is this inaccurate reporting and the patent is really about sending the stream that is already being recorded by Facebook? Cause to me it sounds like Facebook is basically claiming they already use your microphone 24/7 and now they're just looking for specific sounds to log more data.

  • by taustin ( 171655 ) on Wednesday June 27, 2018 @05:57PM (#56856458) Homepage Journal

    is the terms of service you didn't read before you clicked "I agree," if you're not in the room alone, in a place that one would expect privacy, like your own home, this would run afoul of wiretapping laws in all-party consent states. In some cases, it's a felony.

    I would dearly love to see Zuck in an orange jumpsuit for this.

    • They would already be on the hook for wiretapping violations caused by their app and tracking links if that was gonna happen. The problem is that our own government is just as interested in illegally collecting such data as the other cyber criminal gangs are.

      • I thought it was illegal in the US to secretly electronically record conversations without the approval of those being recorded. Opt out would not be an option.
        • Technically correct but what constitutes as "approval" seems to have been watered down quite heavily in the perception of the people actually executing this data collection process. For example, you've already been subject to this data collection process for years now. Facebook has decided that your consent was implied by being in close proximity to the mobile device of anyone who had consented already by installing the app. Despite the clear illegality of this, nobody so far has tried to stop them that

        • by taustin ( 171655 )

          Varies by state. Some states require consent by one party, some by all. Federal law is one party. In some all-party states, it's a civil offense, in some, a misdemeanor, in California and, apparently, now in Pennsylvania, it's a felony.

          • There may be a difference between recording telephone conversations - which is what you may be talking about - and non-telephony. However, activating a device connected to the Internet by Wi-Fi when there might be one or more persons in the room could be illegal everywhere. It's not a telephone call situation. This is somewhat like someone placing a hidden microphone connected to a recording device in a room. This scenario shows up in detective novels. The suggestion that in some locations the recording ind
            • by Khyber ( 864651 )

              "It's not a telephone call situation"

              This is where we need to actually prey upon politician's stupidity - it happened via our smartphone, it counts as wiretapping. Drill that old-fashioned concept into their heads.

    • Comment removed based on user account deletion
    • by AmiMoJo ( 196126 )

      This is why we need laws like GDPR. Companies know that they can use a TOS-bomb to make people agree to pretty much anything, up to and including ownership of their eternal soul, so we need to create a standard TOS of our own that they have to agree to first.

  • So, Facebook has patented a new way of SPAM... Nice.

    Who wouldn't want to waste data bandwidth and battery to see SPAM?

  • by c ( 8461 )

    ... that's why I don't have Facebook apps on my phone, or allow most apps access to the microphone.

  • by Anonymous Coward on Wednesday June 27, 2018 @06:05PM (#56856514)

    I'd love a pop-up EVERY TIME an app on my iPhone needs permission to access this or that (with the option to okay it into perpetuity should I choose). And instead of simply "OK" to grant permission, offer me a list: OK for 5/10/30 minutes, 1/3/6/12 hour(s), 1/7/30/60/90 day(s), or forever. Perhaps even the option to okay permissions for the app "for X minutes OR until the app is no longer active or is sent to the background, whichever is soonest."

    Then I could be SURE that granting that one app that needed to read a QR code so got camera access doesn't FOREVER have camera access. This would fix issues with Facebook wanting to access my camera, mic, phone contact list, photo library, etc. when I'm not expecting it.

    Another awesome option would be to grant FAKE permission. I.e., an app asks for my phone contacts and won't let me continue unless I grant it FULL access, I can click "OK--grant access to empty phone contacts" or "fake mic that only records white noise" or "fake camera that only records black as if obscured/covered by a phone case".

    Yes, apps could detect permissions. Request access to motion/gyro sensors, grant access to fake, and suddenly movement detected is zero... that would be suspicious. Even so, I'd love that option.

    And finally, I don't want apps to be able to query and discover if permissions are temporary or permanent. They just have permmissions--for now--that's all they can know.

    • by vlad30 ( 44644 )
      I'd prefer an option thats fills their database with random data or data I choose such as congress and senators addresses, or that facebook fanatic till they realise these companies are crap
    • Cyanogenmod used to do this back in the Android 2.x days I think.

    • Comment removed based on user account deletion
    • by AmiMoJo ( 196126 )

      Fake data doesn't seem to offer any real benefit. It will be too easy to detect if any developer really cares about it. Also, I like that simply denying a permission sends a clear message to the app and the developer.

  • by theCat ( 36907 ) on Wednesday June 27, 2018 @06:06PM (#56856520) Journal

    Amazon eventually has something similar planned for Alexa, where casually spoken words (not directed at Alexa) will do exactly the same thing. The trend here is that any device in your vicinity (not even your own home, anywhere at all) can be triggered by any kind of sound (voice or ads, audible or not) to turn on your phone and record other conversation, or maybe to direct your phone web client to an online ad or retailer.

    We're screwed.

    • Reminds me of one of the original things for the Xbox Kinect. It was going to scan your room for things to advertise about, eg: Dorito bags, Mountain Dew bottles, etc.
    • by AmiMoJo ( 196126 )

      Just build an app that whispers random things now and then to trigger these devices. Enjoy the ensuing chaos.

  • by Anonymous Coward on Wednesday June 27, 2018 @06:19PM (#56856566)

    But if it only turns on the microphone when it "hears" the sound, how does it hear it?

    Of course the microphone is turned on all the time, just that when it hears the sound it starts recording and send it home.

    Still a horrible idea and whoever conceived it should lose their basic human rights as a punishment since they want to take some of them (privacy) away from others. There is a special place in hell for people like these.

    • It is basically how all smartphones already operate. The microphone is on all the time, an when detecting key audio signature they start sending all it picks up to Apple or Google. Those signatures being "Ok Google" or "Siri".
  • by drew_kime ( 303965 ) on Wednesday June 27, 2018 @06:21PM (#56856576) Journal
    Remember the story here [slashdot.org] just two weeks ago?

    The La Liga app, [gizmodo.com] which is the official streaming app for Spain’s most popular football league, has reportedly been using the microphones on fans’ phones to root out unauthorized broadcasts of matches in public venues like bars and restaurants.

    Sounds like the same thing.

  • Arbitron, now owned by Nielsen [wikipedia.org], had a technology that injected inaudible information into radio signals. The information contained the station and content. This was picked up by small recording devices that people ("panelists") wore on their belt [wikipedia.org]. These people were monetarily compensated for the privilege of sharing their listening habits, unlike Facebook. At night the user would connect the device to a base where it would recharge and send the information to the main office. Later devices used cell ph
  • TV, Radio ads triggering, these Alexa, whatever devices? Companies throwing out ads to buy a pretend product just to get peoples money!

    Just my 2 cents ;)
  • by myid ( 3783581 ) on Wednesday June 27, 2018 @06:35PM (#56856628)

    Phones and computers need a manual (not software) "data capture" on/off switch. This switch would physically disable the phone's microphone and cameras (and if possible, screen capture).

    If I manually slide the data capture switch to OFF, then the mic and cameras are physically disabled. No matter what any data, software, or user preferences are, the mic and cameras are physically unable to capture sound or images. They can't capture sound or images again, until I manually slide the data capture switch back to ON.

    • by AmiMoJo ( 196126 )

      You can get cases with a cover for the camera, or stick-on privacy sliders designed for laptops but which fit phones okay. Add a bit of acoustic blocking foam to cover the microphone when closed.

      Another option to block the microphone is a dummy one in the headphone socket for phones that support headsets that way. Bluetooth and USB also work. Or you can go the other way and physically disconnect the mic on the phone, then connect an external one when you need it.

    • by mjwx ( 966435 )

      Phones and computers need a manual (not software) "data capture" on/off switch. This switch would physically disable the phone's microphone and cameras (and if possible, screen capture).

      If I manually slide the data capture switch to OFF, then the mic and cameras are physically disabled. No matter what any data, software, or user preferences are, the mic and cameras are physically unable to capture sound or images. They can't capture sound or images again, until I manually slide the data capture switch back to ON.

      Or rather the OS denies access to everything by default and you have to approve use when they app tries to use it. I mean all sensors, camera, GPS, microphone, accelerator/gyro, so on and so forth.

      I beleive Android does this already, not that it stops people from somnambulently clicking "allow", but it at least gives those of us who care a chance.

      Also default deny of sensor access when the application isn't open and active. A messenger application does not need to listen when I'm not using it.

  • I thought there was some pretty obvious prior art [slashdot.org] for this, but checking the filing date, it seems they got in just in time, 3 weeks before their competitors who actually have devices capable of it started doing this shit in real life.

    But really, we need to stop letting companies patent obvious orwellian crap.

  • Hey, another reason to not subscribe to pay TV.

  • My cellphone isn't allowed to watch television.

  • by markdavis ( 642305 ) on Wednesday June 27, 2018 @07:21PM (#56856820)

    >" It describes a system in which an "ambient audio fingerprint or signature" that's inaudible to the human ear could be embedded in broadcast content like a TV ad. When a hypothetical user is watching this ad, the audio fingerprint could trigger their smartphone or another device to turn on its microphone"

    How can it "turn the microphone on" if it was already "on" and constantly listening for this audible signal? Thus, the mic was already "on" and analyzing everything, all the time. This is aside from the asinine premise of this whole concept. I am sure we all have a BURNING need for our phones to be listening all the time, burning up the battery, doing god-knows-what in the background, sending personal info to places like Facebook, all so we can watch COMMERCIALS and then get even more automatic COMMERCIALS on our phones and give companies even more metrics about our personal lives, whereabouts, believes, and associations. Oh, man, sign me up now! I will make sure to throw away my DVR in the process, too, so I can watch COMMERCIALS religiously...

    What I want are HARDWARE switches for: microphone, cameras, and radios on my devices. Funny how many devices USED to have such things in the past.

  • This has already been done. Audio beacons. Those tracking companies hate microphone permissions on iOS (and possibly android now) for this reason.

    Earlier they could turn on the mic at will, now users a bit more aware.

  • Pollute their data (Score:4, Interesting)

    by Solandri ( 704621 ) on Wednesday June 27, 2018 @07:57PM (#56856976)
    As I've said before [slashdot.org], I believe the best strategy for fighting this type of privacy invasion is to simply pollute their incoming data. Figure out which triggers they're using to initiate the recording (e.g. inaudible audio signal at the beginning of a commercial), and duplicate it and program your phone and other speakers to play them back anywhere and everywhere. The mall, the park, stadiums, restaurants, concerts, movie theaters, amusement parks, traffic jams (over your car stereo with your windows rolled down), YouTube videos, etc.

    There's an apocryphal story that at the end of the Cold War, members of the KGB and CIA got together for beer and to swap war stories. The CIA spooks lamented how hard their job had been. They had to struggle just to get anyone into the country since the Soviet Union was such a closed society, while the KGB could simply enter on a tourist visa and drive up to (and even take a tour of) most targets in the U.S. The KGB spooks disagreed, saying that theirs had been the harder job. The U.S. produced so much information that they had to devote huge resources to sift through it all to figure out which was credible and which was not. e.g. If the National Enquirer published a story about the USAF testing a captured UFO at Area 51, they had to figure out if it was made-up or if there was really something to it.
  • You mean Facebook is gathering private data about us?

    OMG.. nothing is sacred anymore!

  • Prior shArt; already shouldn't exist.

  • Comment removed based on user account deletion
  • by JustAnotherOldGuy ( 4145623 ) on Wednesday June 27, 2018 @10:47PM (#56857570) Journal

    ....how is this not illegal?

    It seems like a classic example of wiretapping, especially as it's done without the user's consent (EULAs notwithstanding).

    Fucking marketers...they should all die in a fire.

    This is reason #3,255,094,649 as to why I don't use Facebook.

    • It seems like a classic example of wiretapping, especially as it's done without the user's consent (EULAs notwithstanding).

      Being in an EULA alone doesn't make it legal or un-challengable.

    • ....how is this not illegal? It seems like a classic example of wiretapping

      Since when is wiretapping wiretapping when the person being "wiretapped" actively consents to the "wiretapping"?

  • by tsa ( 15680 ) on Thursday June 28, 2018 @12:26AM (#56857822) Homepage

    This is why I don't use apps. They steal your contact lists, use your camera and microphone when it's not necessary for the functioning of the app and they do some mining on the side. Apps suck. Use the website.

    • This is why I don't use apps. They steal your contact lists, use your camera and microphone when it's not necessary for the functioning of the app and they do some mining on the side. Apps suck. Use the website.

      This is why I don't do generalisations. Posts like the above which make wildly inaccurate generalisations would make me look stupid so I apply some thought and only talk in specifics.

    • by mjwx ( 966435 )

      This is why I don't use apps. They steal your contact lists, use your camera and microphone when it's not necessary for the functioning of the app and they do some mining on the side. Apps suck. Use the website.

      This, uninstalled Facebook and now use Firefox with Ublock and Ghostery. As a side effect, I get about 20% more idle time on my battery.

  • How can the smartphone ever hear the audio fingerprint if it is not already listing to everything at all times? So this can only work if the smartphone is already hearing everything and then I don't see a reason why you need a trigger to send everything that is overheard to facebook.

    Lets just hope that this only works when you have the facebook app installed. So don't install that app. If you really need that shite... errr... site, you can also open it in you browser.

    • Indeed, but here is the bit I didn't initially get... if it starts recording when it hears an audio signal from a TV or the like then surely what it records will mostly be the audio from said TV. If the trigger is at the start of an advert and then starts recording then they would the record the audio of the ad... something they already know. If they collect say 10 seconds of audio from before the trigger event and run for ad-length-plus- 20 seconds they get to hear the content that precedes and follows.
      • by Askmum ( 1038780 )
        Why need such an elaborate scheme to check if your ad is being broadcast? Surely you can rig something to record a channel and check that programmatically? Why would you need a third party phone for that? Unless you want to check your exposure rate. And then still: why does Facebook need this and not the party that paid for the ad?
        My first idea when reading your response was that Facebook was maybe trying to get the reaction to the ad from the viewer. "Hey! That's a cool gizamadoodle! Let's go out and buy
      • by Anonymous Coward

        I like the track you were running down, it was just heading the wrong direction. Now, it is plausible that compliance can be monitored this way but I'm thinking that would just be a happy side effect. What is more important to the advertisers, which is what FB wants to provide, are things like did they change channels as soon as it aired? Did they watch the whole thing? Did they swap channels but then come back a minute or 2 later or did it run them away from the channel altogther. Did users immediately

      • It would also help advertisers to catch networks and streaming services that habitually mangle their commercials by cutting them off a second or two early, or showing the same commercial multiple times in a row. Anybody who's ever used the CW's streaming app (and CW Seed) knows exactly what I'm talking about... it's not bad enough they show 30-40 minutes of commercials per 40 minutes of actual show... they make you watch the same commercials over... and over... and over... often back to back (to back to bac

  • Somebody watched too much Serenity (movie from 2005), where reactions of River are triggered by TV messages https://www.imdb.com/title/tt0... [imdb.com] It is insane what some consider now patentable.
  • Just because they do it with a microphone instead of a cable? AGES ago, there was a product for your desktop PC that did the same thing. You'd run a cable from one of the audio outputs from your sound system (and the cable end had an RCA passthrough) and then into your sound card. Then a daemon on your PC would listen for audio blips that would tell it what website to visit to accompany programming. IIRC they gave them away at Rat Shack, and I went in just to get the cable which was a nice long piece of fre

  • ... straight up illegal wire-tapping? Facebook is effing evil.
  • It's already been done.

A complex system that works is invariably found to have evolved from a simple system that works.

Working...