A New Corporate AI Can Read Your Emails - and Your Mind (fortune.com) 120
"Okay, as of last night, who were the people who were most disgruntled...? Show me the top 10." An anonymous Slashdot reader shares their report on a fascinating Fortune magazine article:
"One company says it can spot 'insider threats' before they happen -- by reading all your workers' email." Working with a former CIA consultant, Stroz Friedberg developed a software that "combs through an organization's emails and text messages -- millions a day, the company says -- looking for high usage of words and phrases that language psychologists associate with certain mental states and personality profiles...
"Many companies already have the ability to run keyword searches of employees' emails, looking for worrisome words and phrases like 'embezzle' and 'I loathe this job'. But the Stroz Friedberg software, called Scout, aspires to go a giant step further, detecting indirectly, through unconscious syntactic and grammatical clues, workers' anger, financial or personal stress, and other tip-offs that an employee might be about to lose it... It uses an algorithm based on linguistic tells found to connote feelings of victimization, anger, and blame."
The article reports that 27% of cyber-attacks "come from within," according to a study of 562 organizations that was partly conducted by the U.S. Secret Service, with 43% of the surveyed companies reporting an "insider attack" within the last year.
"Many companies already have the ability to run keyword searches of employees' emails, looking for worrisome words and phrases like 'embezzle' and 'I loathe this job'. But the Stroz Friedberg software, called Scout, aspires to go a giant step further, detecting indirectly, through unconscious syntactic and grammatical clues, workers' anger, financial or personal stress, and other tip-offs that an employee might be about to lose it... It uses an algorithm based on linguistic tells found to connote feelings of victimization, anger, and blame."
The article reports that 27% of cyber-attacks "come from within," according to a study of 562 organizations that was partly conducted by the U.S. Secret Service, with 43% of the surveyed companies reporting an "insider attack" within the last year.
Morons (Score:3)
We use our smartphone's private mail to trash the bosses.
Re: (Score:1)
We use our smartphone's private mail to trash the bosses.
That's why they're looking for subconscious cues* instead of explicit statements of anger.
* technical term : thoughtcrime
Re: (Score:2)
Re: (Score:2)
+1 Insightful
Re: Morons (Score:1)
Re: (Score:3)
As the bosses will do analyses like "Which are the 1% I should fire", the matching algorithm (no AI in there) will resort to partial syntactic matches when it cannot fulfill the quota otherwise. Even a name with suspicious parts will get you fired then.
Re: (Score:2)
Slashdot sucks because, instead of discussing technology, it's a bunch of paranoid delusional tinfoil hat nutjobs.
If you want my delusions... you'll have to pry them from my cold, dead mind.
Clippy says... (Score:4, Funny)
Re: (Score:2)
The idiot here is you. You have no clue what "AI" today can and cannot do. Your statements are pure fantasy.
based on value to company, that puts them in XS (Score:2)
that ought to winnow out the bosses with silly ideas.
hahahahah ha haha oh jeez, my side hurts....
Re: (Score:2)
Initially, yes. Then they will do a whitelist of all the bosses emails. You know like all the security rules do not apply to people high enough in the hierarchy.
Re: (Score:1)
You DESERVE to get caught if you use the word "embezzle" in an email you send through the company's email system.
Re: (Score:3)
Probably auto-corrected from bambozzle :)
Re: (Score:2)
Fear mongering (Score:1)
Frankly I think this is nothing more than fear mongering. I also feel sorry for anyone accused by this software; I'm sure having to crawl on the carpet and somehow argue against some shady, dubious algorithm will be a wonderful experience.
Also, do people really send emails from their corporate account with the words, "I loathe this job"? Give me a break.
Who is talking about "accusations"? (Score:2)
Any place I worked for before would've used the flags raised by such software only to alert the manager. It would be up to him then to decide how (and even whether) to act.
Staffing is a difficult and expensive part of running a corporation. Maybe, not for burger-joints — but certainly for anything using corporate e-mail to begin with. Firing or even disciplining an otherwise useful employee over his being tired or experiencing a financial strain is
Re: (Score:1)
You're a complete and utter cretin, or an absolute tool. It's not really worth it to discern which.
Many of the people who are scathing about poor internal processes are exactly those people who are positioned to, and capable of, effecting change in an organization. If they are not permitted to discuss the areas that are wrong, the tactics necessary to navigate a block, and bounce their ideas off other colleagues who they know will not react hysterically at internal communications that wouldn't pass the mark
Re: (Score:2, Insightful)
You're a complete and utter cretin, or an absolute tool. It's not really worth it to discern which.
Many of the people who are scathing about poor internal processes are exactly those people who are positioned to, and capable of, effecting change in an organization. If they are not permitted to discuss the areas that are wrong, the tactics necessary to navigate a block, and bounce their ideas off other colleagues who they know will not react hysterically at internal communications that wouldn't pass the marketing department, then the business will flounder all the faster.
Agreed. Certainly it is simpler to work with employees that will accept anything, no matter how ridiculous, and keep trying to do their job without complaint, but that just means the problems are masked not eliminated. So you have major structural problems, but everyone who was willing to give a damn or even point them out is gone. At best the company is running significantly below the efficiency it should be, and that alone can be enough to mean its eventual collapse, when forced to compete with a compe
Re: (Score:1)
can act a a malignant cancer eating away at the guts of the company
You're assuming managers give a flying fsck about what's good for the company.
Re: (Score:1)
Anti-social management (Score:2)
Why don't they just ASK our opinions on office flow and harmony (or lack of) instead of buy expensive buggy crapware to do it?
Re: (Score:2)
That's like those ad companies that try to figure out what our interests are instead of directly asking us to check a few boxes on a form.
Re: (Score:1)
Many people are happy to say what they think about general org practices that need some rework.
it also works in reverse (Score:5, Insightful)
No intelligence here.
The mindlessness of this technology is it's number one selling point.
As rumour goes around (you're soaking in it), dutiful employees will onboard yet another reason to paint within arbitrary and demeaning corporate lines like good passionless drones (have I flunked the test?)
Here is a rather chilling passage from The Gulag Archipelago by Aleksandr Solzhenitsyn. [mannerofspeaking.org]
Re: (Score:1)
I worked at a startup with a "presenteeism" culture. This is the exact sort of toxic nonsense that ultimately motivated me to quit.
Re: (Score:3, Informative)
Having spent my childhood under a similar dictatorship, you stopped clapping only when instructed to do so by the highest party member in the room. That's how it worked.
Guess I had better change my signature (Score:2, Funny)
What this software really means is that I, like many other employees, am going to have to change my signature.
--
Ima Embezzler, 123 Ihatemyjob Street, Killmy Coworkers, California
Once known, becomes completely useless (Score:4, Insightful)
People will just use other channels for that type of communication. And there is also a serious risk: Many people will not communicate needed information for fear to be caught by this. In the ultimate consequence this can do much more damage than it helps.
Re: (Score:2)
Hahahahaha, you are funny. And stupid (ell, what do you expect from an AC...). Nothing goes faster through the grapevine than people getting fired for unclear or suspicious reasons. And unlike you I actually have evidence of the problem I describe happening. No, I cannot talk about it, I an under NDA.
I bitch and whine where the bosses see and hear me (Score:2)
I bitch about work in the company's chat rooms. I know my boss, and his boss, can see my messages. That doesn't stop me from not-so-subtly complaining about corporate bureacracy.
Currently, humans read my communications and make subjective judgement calls based on which snippets of my conversation they might have noticed. Hopefully they think "Ray is highly motivated to improve our most problemtic processes". :)
The the only difference a system like this would make for me would be that the interpretation wo
Re: (Score:2)
Nobody that is actually critical is threatened by this. I would not be either. But it is important to also provide reasonable working conditions to the average worker, or social peace will be threatened. And they will not know how to deal with this and clamp up in fear. I have seen it happening in a similar situation.
Re: (Score:2)
Not necessarily bad (Score:1, Insightful)
I know, I'm supposed to have a knee-jerk reaction that this is bad and innocent people will get in trouble, yada yada yada... but I don't. There's far too much fear mongering here that Slashdot is almost unreadable these days. It could be an interesting idea in linguistics and data mining to identify potential workplace threats and troubled workers. There shouldn't be an expectation of privacy in workplace emails. If you want that, use a private account to discuss things.
Whether this is good or bad comes do
Re: Not necessarily bad (Score:1, Insightful)
Why bother trying to write an interesting comment that might spur on discussion when it's going to quickly be hit with a -1? This system isn't necessarily going to be used for evil purposes and the heuristics might have a lot of interesting applications. Personal assistants like Cortana and Siri might be able to detect a person's mood and interact with the person accordingly, which is actually useful. It's also a hell of a lot more interesting than the paranoid fear mongering in most of these comments.
Slash
Re: (Score:1)
To be fair, a lot of what you're talking about wrt the scoring system is a side effect of scoring in general. People will look for things to game, and gaming for a high score to get your comments higher visibility could be understood by some to be "winning" socially. Many people will use whatever metric they can to make themselves feel socially valuable, which is why any technology that hopes to facilitate meaningful commentary *will not use numbers in meaningful ways*. Reddit, Slashdot, Stack Overflow, Img
Re: (Score:2)
Those who participate fully and log in also get karma feedback, which influences their ability to moderate. It promotes groupthink, which is one of the reasons I refuse to fully participate and stick to being an AC.
Have you checked a mirror lately, because I'm pretty sure you have a tinfoil hat on too.
Re:Not necessarily bad (Score:4, Interesting)
It could be an interesting idea in linguistics and data mining to identify potential workplace threats and troubled workers.
Being an "interesting" idea from an intellectual point of view says absolutely *nothing* about whether it's a good idea or not.
There shouldn't be an expectation of privacy in workplace emails. If you want that, use a private account to discuss things.
Okay; the fact you're expressing that pat response here suggests that you don't understand (or weren't paying attention to) the difference between this and the typical (straightforward) "employers are reading my workplace email" thread. I actually wonder whether you even got the point of the story at all.
This isn't spying on people directly expressing hostile or subversive thoughts against the company, this is using it on (potentially) superficially work-related and neutral email content to determine the underlying psychological attitude of the employee.
Given that the employee is probably *required* to use email in this manner as part of their job, and given that this isn't something they're likely to be consciously doing (else they'd avoid doing it, duh) it's not as if they have a choice in the matter.
Whether this is good or bad comes down to how you react to an alert.
The issue here- and the reason most people quite rightly expressed the (supposedly) "kneejerk" reaction you dismiss- is that they already know based on past experience how large corporations or similar entities- i.e. the people likely to be buying this technology- will probably use this sort of power.
For genuinely troubled employees, however, this might actually be useful if it leads to a confidential meeting with a third party or ombudsman who tries to help the employee.
Yeah, because large US-style corporations are well-known for protecting employees with problems and won't simply use this as an early warning on someone they can get rid of before they become a problem. Or might not have, but why take the chance?
I saw the example in the story. A nice, touchy-feely way to justify an intrusive technology, but let's get real here.
If it's used to actually help troubled employers who might not reach out for help on their own, it could actually help people while protecting the company. If used properly, it's a good thing.
The question is, how likely to you think it is to be used "properly" in your sense of the word?
Your problem is that you seem to view the technology in a purely abstract sense- i.e. one that could theoretically be used for good or bad. Well, theoretically it could be, yes.
However, your so-called "tinfoil hat crowd" knows damn well that such technologies don't exist in isolation, know what type of people it's been designed for, and the type of people and organisations it's likely to be sold to. Based on past experience, it's not unreasonable to draw such conclusions on how it's likely to be used.
So, you can keep expressing your (repeated) dismissal of its critics as "paranoid delusional", but that doesn't make your counter-argument any stronger.
Re: (Score:2)
The beatings will continue until morale improves.
Re: (Score:2)
... and the meetings will continue to find out why the work isn't getting done.
Wow! (Score:2)
Re: (Score:2)
I hope it is your own truck. Because otherwise, you will be tracked even more than in the office. GPS tracking devices are becoming the norm and they are probably considering microphones and cameras too.
Re: Assume all corporate mail is read by someone.. (Score:2)
... and write accordingly. I do it for as long I can remember.
Anyway... who in their right mind would write 'I loathe this job' in a corporate mail?
* * * *
Those who do not grovel or worship those in charge for the opportunity to work for them. Those whose skills could transfer to any number of companies if push came to shove.
These are your " go-to " people. They get shit done. Quickly and efficiently. They do not deal with stupidity or bureaucracy well. Give them a task, however, and it gets done.
You c
Is there a market for an email scrubber then? (Score:1)
If this gets to be a problem, maybe someone should write a program that will 'scrub' your email before you post it, Flag, remove, or replace those subconscious red flags that you put in.
I work in HR analytics, would never install (Score:1)
I get that many clueless HR departments would install this, but those with actual (competent) analytics teams would avoid this or implement it very carefully. It is a huge can of worms with minimal benefit. Maybe you correctly flag a few risky people, but you equally risk false flags with expensive legal ramifications. Not only that, but you suddenly have a massive trove of data that an upset employee could use against you to potentially show a pattern of practice in a discrimination case, legit or not. Eve
Business Email Etiquette 101: (Score:3, Insightful)
1. Do not, under any circumstance, say anything in email that you wouldn't say to your boss' face.
2. See #1.
It's not rocket science, people. Most IT depts I've been in have language in the "IT Policy" newbs must sign saying something like "All communications may be monitored bla bla bla"
Completely Irrelevant (Score:1, Insightful)
RTFA.
This is not about being rude or stupid in email. This is digital "micro-tells" - The idea that people give away their emotional state by subconscious actions that are not visible to the untrained eye. Word choice, sentence construction, word count, punctuation, time of day that the message is sent, time elapsed between receiving a message and responding, etc.
Its total bullshit (just as real-life micro-tells are total bullshit) and the result is going to be arbitrary persecution of people singled out
I think the point of this kinda big data tech (Score:2)
Re: (Score:2)
It's almost like... like they don't want employees at all.
Legal dept will advise them differently (Score:5, Insightful)
This stuff falls into pseudo-science much like a polygraph does. The first time they fire someone based on what amounts to ' digital profiling ' it will likely be quite a costly mistake.
Besides, there is nothing in my contract that states I have to like my job. I just have to do it.
I would think that if folks were not afraid of the fallout, any given company would find that a rather significant percentage of their workforce thinks less than positive thoughts about their job in general.
Re:Legal dept will advise them differently (Score:4, Interesting)
Agree 100%. I was tasked to implement a sentiment scoring feature like this in a corporate monitoring/surveillance product a couple of years back, intended to evaluate IMs, emails, etc. for potential leaks/corporate espionage/other bad stuff. I told them that we didn't have the time or in-house expertise to do it ourselves, and every single one of the commercially available libraries that I evaluated turned out to be snake oil.
This plays right into Google's hand... (Score:3)
In the near future, employees will protecting themselves from false (or otherwise) accusations by never personally getting involved in their own email correspondence.
http://www.wired.com/2015/11/google-is-using-ai-to-create-automatic-replies-in-gmail/
Figures. (Score:1)
How do you know whether it works? (Score:2)
The More That You Lie And Cheat, The More Paranoid (Score:2)
you become, from worrying about retribution.
you can see the trend clearly in the government and large corporations.
I see no problem with this! (Score:2)
I've always thought that saying anything negative about my company, co-workers, etc, using company resources is a "violation" of my "professional ethics" anyway. When I'm on a job, I see myself as a professional IT worker, and don't discuss my personal feelings about anything at all via corporate email. My feelings towards the corp have little to do with system uptime, resolving hardware issues, etc. My feelings might be useful if I'm ta
Re: (Score:2)
Oh yeah the good old RPG Paranoïa, loved this
I may send this to a coworker soon (Score:1)
"Joe, I'm really worried about my new puppy. I think he's smarter than his mom. I'm not sure if he's stealing food while she's around or if he's embezzling it behind her back.
I don't think my kid's too happy that I made him get a job this summer. Last week I heard him say I loathe this job. I'm not sure if he's angry at me or angry at the fact that it's a minimum-wage job, but he seems pretty pissed off. Thankfully, he vents his stress at the local school, which is a lot better than going postal."
Let's
I have had similar access. yes, you can read minds (Score:3)
It was my experience that the people who told the same "fact" multiple different ways were the most damaging to the company.
So, while this system might be able to spot people clearly up to no good, I hope they use the ML stuff to correlate damage to certain behaviours. For instance micromanagement would easily be detectable in emails and is a great way to chase away some of the top talent. I would say that detecting that would be far better than detecting some employees who are looking for a new job. If anything a bunch of underlings continuously looking for new jobs would say more about their manager than about them as individuals.
A secretary pilfering some money out of petty cash might cost the company a tiny amount like $100,000 per year. Losing a single top programmer to micromanagement could cost the company millions or more. Losing a stream of top programmers could literally cost the company everything.
The point of this (Score:1)
The point of this is more to steer productivity as to prevent sabotage.
It's a constant whip cracking over the heads of the spineless and gullible.
"Anti-sabotage" is only an excuse really.
Re: (Score:2)
Self censorship, Soviet style (Score:2)
All this will result in is people being more careful about how they word their emails. Even now it is an incredibly stupid thing to rant on corporate email - it gets recorded for posterity and can be used against you at appraisal time, or get you fired.
Just last week... (Score:2)
We had another article where another federal agency was looking for information much like this:
https://yro.slashdot.org/story... [slashdot.org]
Minority report (Score:2)
Corporate thinking at its finest (Score:2)
How about this Secret Trick (Score:2)
Assuming y'all are stuck w/ Outlook at work, set your default to Rich Text. Then write a few lines of horrificness into your signature, and format them as white text.
Nobody but the algorithm will see it.
Yes, yes, I know that everyone who reads your mail as plaintext will too. It's just a dang joke, 'mkay?
No problem (Score:2)
This doesn't bother me at all. I'm sure that my employer would see that I have the complete confidence in management and enthusiasm for our mission.
Related Uses (Score:1)
Re: (Score:2)
In the EU it's pretty much always illegal to read your employees' emails.
Yes, we're so lucky in the UK to be part of an organisation that protect employees .... Oh wait!