Stories
Slash Boxes
Comments

News for nerds, stuff that matters

Slashdot Log In

Log In

Create Account  |  Retrieve Password

Online Publisher Blocks LinuxToday Referrals

Posted by timothy on Sun Mar 21, 2004 03:59 PM
from the right-to-free-linkage dept.
MadChicken writes "This weekend, LinuxToday found that their link to an article was blocked by CMP Media LLC (publishers of Information Week). The editorial with full details is here. Could this have impact on other online news sites?"
+ -
story
This discussion has been archived. No new comments can be posted.
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
 Full
 Abbreviated
 Hidden
More
Loading... please wait.
  • Why bother (Score:5, Insightful)

    by Anonymous Coward on Sunday March 21 2004, @04:01PM (#8628971)
    What does denying links achieve? The web is great because it is just that. Start blocking links and it will start to fall apart.
    • Re:Why bother (Score:5, Insightful)

      by sfjoe (470510) on Sunday March 21 2004, @08:37PM (#8630353)
      What does denying links achieve? The web is great because it is just that. Start blocking links and it will start to fall apart.

      No, it won't. Start blocking links and people will stop coming to your site. Instead they'll go to a similar competing site. There are extemely few sites that are so blindingly original that similar information can't be found elsewhere. This is especially true of corporate-driven websites.
  • by ttldkns (737309) on Sunday March 21 2004, @04:05PM (#8628990) Homepage
    No more slashdot effect once evryone realises you can block us?

    • by gunix (547717) on Sunday March 21 2004, @04:12PM (#8629026)
      Can I tell my brower not to tell that I'm following a link when I enter a site?
      Wouldn't that solve the problem?
      • by Simon (S2) (600188) on Sunday March 21 2004, @04:14PM (#8629036) Homepage
        Can I tell my brower not to tell that I'm following a link when I enter a site?

        yes. that would solve the problem.

        in mozilla you can set the network.http.sendRefererHeader value to 0.

        or just open the link in a new tab.
        • by Feelvoid (99543) on Sunday March 21 2004, @05:26PM (#8629358) Journal
          In Opera, You can toggle the sending of the Referrer Header at any time.

          Use the quick menu: Just hit F12, then 'f'. (on v6.03 at least)

          I can see lots of uses for this. You can use this to hide where you're coming from, such as clicking on info links from BitTorrent repositories of questionable nature. Or when trying to get through to sites who have blocked access via Referrer from Slashdot.

          From the online docs [opera.com]:

          "
          Disabling referrer logging

          Do you want Opera to send information referring to the page from where the document or picture was requested?

          If you enable this option in File > Preferences > Privacy, Web servers can store information about the site that you last visited before you jumped to the current one. This allows webmasters to analyze how people find their way to his website.

          Disable this option if..."
          [Remainder of text deleted to fit within fair-use guidelines. Ahem.]

          It would wreak havoc on the spirit of the internet to have user-definable Referrer fields, though...

          -j.
      • by billstewart (78916) on Sunday March 21 2004, @04:42PM (#8629164) Journal
        Other people posted how to set your browser to do this consistently, but if you don't want to do that, just type the URL that's getting blocked into a new browser window, or copy and paste it if it's too long to retype. That way there's no REFERER associated with it.

        On the other hand, some websites that don't like deep linking will only show you their deeper pages if you DO have a REFERER set from one of their other pages - so you have to go in through the front door. That's one reason you might not want to block REFERER permanently.

    • by svanstrom (734343) <tony@svanstrom.org> on Sunday March 21 2004, @04:13PM (#8629033) Homepage
      I've already set such things up on some sites which might get /.:ed; basically it means that all people surfing to these sites from a page at /. will get a static snapshot of the contents... it's the same contents, just up to 30 minutes old and without it killing the databases etc. =)
      • by sir_cello (634395) on Sunday March 21 2004, @04:35PM (#8629133)

        Employing some form of anti-slashdot mechanism is entirely justified: the issue here is that you're legitimately addressing an economic/cost/resource problem (although, your approach is a little weak: you should employ some form of request rate limiting as the slashdot effect can occur from other sources). You have a right to do this.

        However, simply blocking references by origin with no specific justification, especially when that origin is pursing a similar field of operation sounds very anti-trust: i.e. refusal to supply.

        • by svanstrom (734343) <tony@svanstrom.org> on Sunday March 21 2004, @05:08PM (#8629275) Homepage
          I also use it on some sites to prevent deeplinking, not to mention people linking directly to certain files (images etc)... but I do allow some sites to do deeplinking.

          I do this simply because I want to control what a person has read before visiting certain information, like forcing them to read a warning/explanatory text before viewing statistics about something. Without that explanatory text it might be possible that people are going to misinterpret the data; but I don't have to force them to read my warning if I know that the site doing the deeplinking are good at explaining the data to the reader...
      • Hmm.... (Score:5, Interesting)

        by Kjella (173770) on Sunday March 21 2004, @04:58PM (#8629231) Homepage
        ...could that be developed into a generic anti-slashdotting? I.e. you simply keep count of the referrers, which you got spare power to do before the real crunch starts... if load gets too high, issue static pages to the top referrer(s).Hmm 30secs of thinking, but it definately sounds patentable :D.

        Kjella
  • Marketing ploy ? (Score:5, Interesting)

    by Space cowboy (13680) * on Sunday March 21 2004, @04:05PM (#8628991) Journal
    The cynic within immediately asks 'who gains ?' from reducing the number of users on your site by denying traffic from what is essentially a free referral service. It doesn't seem to make any sense... If the story was being copied verbatim, and the source-site was losing ad revenue then there's just cause to block the copying site, but in this case Linux Today is only posting excerpts containing links ...

    So, what gain can there be ? Does the process of having an outcry against you, then acquiescing to public demand (becoming a 'good guy' again) give you a sufficiently high profile that it's worth losing some page-views temporarily ? I think that it might....

    Simon the cynic.

    • Re:Marketing ploy ? (Score:4, Interesting)

      by k_head (754277) on Sunday March 21 2004, @04:12PM (#8629024)
      No need to be cynical there are only two reasons.
      1) Malice
      2) Incompetence.

      I doubt it's 1) because they are not blocking links from newsforge. Of course maybe somebody over there got pissed off at linux today for some weird reason but it seems unlikely given the "cut off my nose to spite my face" nature of it.

      That leaves us with 2). Somebody made a mistake and blocked the wrong referrer.

      I am sure somebody who works at CMP will post an explanation here before the conspiracy theories start flying.
    • by cookie_cutter (533841) on Sunday March 21 2004, @04:52PM (#8629209)
      These websites are supported by add revenue. Some users are more likely to click on an add than others. Therefore, it might make economic sense to block some classes of users since they aren't likely to click on an add enough to recoup the cost of serving them the page.

      I only state this hypothetically. I doubt that information week has collected such statistics. I even doubt that sufficient statistics could be collected to accurately identify a group of users so unlikely to click on an ad to make the almost free cost of serving a page too high.

      For other types of services, like ones which are more bandwidth heavy, I can see this being a more legitimate response.

  • Most people with something to say dream of being slashdotted. Yes, your server melts and your pipes burn, but it's worth it to get 100,000 geeks talking about your project.

    So, which brilliant head of marketing thought "hey, they're linking to our pages, giving us free publicity... the bastards, block 'em!"

    Good job, Jimmy!

    ROTFL.
  • by cheezus (95036) on Sunday March 21 2004, @04:06PM (#8628995) Homepage
    My advertisers certainly won't be happy that all these people are seeing their ad via a link to my hit story. I'd better cut them off, and fast!
  • by sygin (659338) on Sunday March 21 2004, @04:09PM (#8629008)
    Aparently when you click on the link provided by Linux Today you get: "Unfortunately, we cannot satisfy this particular request because it comes from a source that is not authorized to redistribute our content..." This is not redistribution in my opinion. This is how the net works(?).
  • Why? (Score:5, Interesting)

    by segfault_0 (181690) on Sunday March 21 2004, @04:11PM (#8629020)
    This kind of silent blocking of a referrer does nothing but hurt the blocking site. If their point was that they dont want their material reproduced on another site, this block doesn't stop that - actually it encourages more if it since the site in question cant link to the original material. They are well within their rights but it doesnt seem like a very good strategy for a company who depends so much on the internet community.
    • Re:Why? (Score:5, Insightful)

      by timeOday (582209) on Sunday March 21 2004, @04:45PM (#8629180)
      Here's where this really leads. If more sites start doing this, you will see HTTP_REFERRER disappear in a heartbeat. Why should I be generous enough to tell you where I've been, only to be denied access? I can just as easily make my browser tell you I came from somewhere on your site.
  • by Anonymous Coward on Sunday March 21 2004, @04:14PM (#8629037)
    How ironic, they block LinuxToday to keep the traffic down, then they get slashdotted because of it, heh.
  • by dougmc (70836) <dougmc+slashdot@frenzied.us> on Sunday March 21 2004, @04:15PM (#8629039) Homepage
    If they want to configure their server to refuse to serve up pages if the Referrer: header contains something they don't approve of, that's certainly their right to do so. It's their server to do with as they please.

    We've (well, many others and I) have always said that if you don't want people linking to you, configure your web server to block it -- it's not difficult. CMP has done this.

    But even though they have the right to do something, that doesn't mean that they should. I don't know anymore more about this story than the LinuxToday editorial, but after reading it, I definately believe that LinuxToday did nothing wrong (what they did certainly does fall under the category of `Fair Use'), and reacted accordingly when they discovered the block -- except that I saw no mention of CMP being contact. Perhaps they were contacted and it just didn't make it into the editorial, but if not, they should have been. It could have just been a misunderstanding or misconfiguration, though the message seen does suggest otherwise.

    I predict that CMP will change their configuration shortly, probably due in large part to the LinuxToday editorial and this /. article. We'll see if I'm right ...

  • by doormat (63648) on Sunday March 21 2004, @04:16PM (#8629044) Journal
    Edit user.js and add/change

    user_pref("network.http.sendRefererHeader", 0);

    No more referers sent.
  • by pherris (314792) on Sunday March 21 2004, @04:17PM (#8629048) Homepage Journal
    1. Open 'about:config'
    2. Set 'network.http.sendRefererHeader' to 0
    3. Enjoy.

    This simply kills off the referer tag from being sent and lets you through. While it's very unlikely this will cause problems, some web sites might not work w/o the tag.

    • Actually.... (Score:5, Informative)

      by Kjella (173770) on Sunday March 21 2004, @04:46PM (#8629183) Homepage
      While it's very unlikely this will cause problems, some web sites might not work w/o the tag.

      Actually, quite a few use this as leech-protection, in order to prevent external direct links to downloads. Privoxy does this the smart way - it forges a referrer header from whatever site you're loading. If I follow a link to say, CNN, they will see "www.cnn.com" as the referrer.

      Kjella
  • by The I Shing (700142) * on Sunday March 21 2004, @04:18PM (#8629056) Journal
    I swear that some of these kinds of decisions are made by people with grilled cheese for brains.

    It is unfathomable to me that someone would block incoming traffic to an article on their website. Maybe redirect the visitor to the home if it's that necessary to force people to come in through the "front door," as it were, but to make the visitor feel like he's intruding somehow... that just seems pretty dumb to me.

    Website operators need to think about how what they do is perceived by visitors, the same way hotel operators and shopping mall operators think about it. Don't make visitors feel unwelcome, for Pete's sake!
  • by Hobbex (41473) on Sunday March 21 2004, @04:20PM (#8629063)
    The referrer field is, especially when it is used to act against my interest (by blocking access to something), my own browser being hostile toward me. Without the active participation of my _own_ browser, they would not be able to block me from accessing the site. This is on the level of DRM, and ought not be acceptable in the free software world.

    Now, in mozilla you can turn of referrer all together, but that is not good enough, because then they can simpyl start blocking access to deep pages when there is no referrer (this will create problems for instance for emailed links, but I know some sites do it (porn...)).

    So mozilla needs to go further to assist it's users, rather than be party restrictions on them. My software should serve me, and me alone. Here is what it needs:

    - Always set "Referrer" to the root of the host.
    - Always set "Referrer" to one directory above the current page.
    - And, most importantly, support for an html extension where the "a" tag (or any other, now that other things can be links) has a parameter that tells the browser referrer to use. So that Mozilla could be set to respect links like this:

    <a href="http://slashdot.org" referrer="http://www.google.com">

    and then set the HTTP referrer field accordingly. That way the browser would not betraying me my providing the source of my link to the destination site, so that they can use it against me.
    • by Hobbex (41473) on Sunday March 21 2004, @04:40PM (#8629156)
      It should be noted that RFC 2616 (HTTP/1.1) backs up my concern about the "Referer" (great, like if programmers needed help spelling badly):

      Because the source of a link might be private information or might
      reveal an otherwise private information source, it is strongly
      recommended that the user be able to select whether or not the
      Referer field is sent. For example, a browser client could have a
      toggle switch for browsing openly/anonymously, which would
      respectively enable/disable the sending of Referer and From
      information.


      As far as I know, no browser contains a GUI dialog for toggling "referer". Not even the "privacy" pain discusses it at all. In Galeon at least, it can be turned off by using middle button and opening in a new tab, which sends no "referer" in the HTTP request. I don't remember if this goes for mozilla too.
    • Actually there is a plugin to do this. You can manually set the referer or have it be the URL itself. I have used for awhile now. it's very useful. I have it running right now. Nevermind the bad english, the guy is french.

      http://refspoof.mozdev.org

      It's functional. To install it you just have to go to http://refspoof.mozdev.org and follow the Install link. (you must do that with Mozilla RC3+ as browser). it should install automatically.
  • by tstoneman (589372) on Sunday March 21 2004, @04:24PM (#8629086)
    I don't get it... to me this is completely short-sighted.

    But having these referral sites, I have been introduced to news sites that I would never have thought to go to. From slashdot, I now regularly scan through cnet's site, etc.

    why not take advantage of the extra eyeballs and put more targetted advertising? Ads are the only thing keeping these content sites anyway... This to me would be the smarter business decision, instead of just blocking people from viewing free content. Why not put up an ad from Redhat or Microsoft whenever a viewer comes from LinuxJournal???

    This is a mark of a stupid business person.
  • by LostCluster (625375) * on Sunday March 21 2004, @04:26PM (#8629090) Homepage
    It's well known that the #1 factor in the Google PageRank sorting routine is the count of links to your page from sites that have no relation to you. Therefore, blocking other site's refererals will just lead to them not to linking you, and your placement in Google to drop.
  • by ishmalius (153450) on Sunday March 21 2004, @04:36PM (#8629138)
    There might be a perfectly good reason this is occurring. It might be a software error. It might be a temporary fix for a temporary problem. Who knows?

    But even if it is intentional, it is totally within their rights to set up their servers any way they see fit.

  • by fm6 (162816) on Sunday March 21 2004, @04:47PM (#8629187) Homepage Journal
    Before getting up in arms, why didn't anybody at LinuxToday ask what was going on? They've just gone and jumped to the conclusion that IW is somehow attempting to censor LinuxToday. Maybe it's just some kind of attempt to prevent deep linking. Maybe some nitwit at IW saw a bunch of referrals from LT and thought it was a DoS attack.

    (No, don't respond to this post telling me why these things can't be true. Arguing about what it could be is just as stupid as the original assumption as to what it is. This is like arguing about what time it is, when the real question should be "Who's got a watch?")

    Plus it's dumb to assume that IW did this without attempting to contact LT. Maybe the LT email server is broken? The message got discarded by an spam filter? The recipient discarded it without reading it? Happens all the time.

    When you have a problem like this, you should work with the other party to solve it. If they refuse to cooperate or explain, then you have something to complain about. Going immediately into crusade mode based on total ignorance is childish.

    • Going immediately into crusade mode based on total ignorance is childish.

      A childish as, say, posting a rant without having read the linked article first?

    • by An Onerous Coward (222037) on Sunday March 21 2004, @05:39PM (#8629403) Homepage
      Interesting. You jump all over everyone for speculating about why InformationWeek would be blocking links from LinuxToday. Then in the very next sentence, you make the unsubstantiated assertion that IW must have tried to contact LT before setting up the block, and make a bunch of uninformed speculations about why the e-mail didn't get through.

      Here's what we do know:

      1: Links from LT to stories on IW result in a message about unauthorized content distribution.

      2: Many online publishers consider deep linking a form of copyright violation.

      3: #1 is precisely what one would expect to happen when a publisher from #2 decides to act upon that belief.

      4: Referrer blocks don't just set themselves up.

      The people at LT are still investigating why it happened, and they haven't ruled out an error. But from the evidence gathered so far, it doesn't look like an error; it looks like a shortsighted attempt by the publisher to control how its content is distributed.
  • CMP Media Spam (Score:4, Interesting)

    by macdaddy (38372) on Sunday March 21 2004, @06:05PM (#8629525) Homepage Journal
    I don't know about the rest of ya'll but this really doesn't surprise me in the least given my experience with them. I subscribe to Sysadm Mag. Ever since I subscribed I've been getting spam for all their other magazines. The spam always comes from email-publisher.com, better known as the spammers at topica.com [spews.org]. Why CMP is using a known spammer's services I have no idea. I've tried unsubscribing to no avail. If it wasn't for Sysadm Mag and a few of their other nice mags I'd tell them to stick it.
  • by dunhamrc (535457) on Sunday March 21 2004, @07:04PM (#8629856)
    I went to the articel url posted in the comments here, and at the bottom of the page I noticed a link saying "Licence this Article". Clicking it provides a pop-up window which lets me get a "Quick Price" (SM?) on how much I should pay for re-distributing the article. If I want to link to the article from my corporate or academic website, the cost is $2.50. If I want to email a link to the article to one friend, the price is $5.00. This despite the fact that there's a link at the top of the article which apparently lets you email it for free. This service is provided to CMP Publishing by an outfit calling itself the Copyright Clearance Center, Inc. They are at www.copyright.com. *Sigh*
    • by turnstyle (588788) on Sunday March 21 2004, @04:09PM (#8629007) Homepage
      Generally most sites welcome incoming traffic (especially ad-driven sites), but if some site doesn't welcome the traffic, it's it their perogative to block?

      I see this all the time when people want to stop "leeching." Clearly this isn't a "leeching" situation, but rather a "deep linking" situation, but isn't it the right of the site-op to just redirect referrers from outside?

    • Re:its thier site (Score:5, Insightful)

      by MRK (27619) on Sunday March 21 2004, @04:16PM (#8629043)
      Yeah, but it is

      1. counterproductive, since they're just refusing traffic. AFAIK linuxtoday wasn't publishing a copy (which I could see being argued as theft ... but besides which this tactic wouldn't have worked against either), but posting a link to information week's article

      2. pointless, since the people that are reading these types of articles might have a better idea of how the web works than the publisher apparently does, and realize that by simply copy and pasting the URL into the address bar (or by blocking their browser's reporting of HTTP referer) they can read the article without hitting the useless block.
          • Re:its thier site (Score:5, Insightful)

            by Grishnakh (216268) on Sunday March 21 2004, @05:10PM (#8629289)
            Linking is required if you want to get any new readers. How the heck do you think anyone's going to find out about their site if no one can get there from a link, google, etc.?

            If you want to make a big website, fill it up with content, and then keep it a total secret so no one can see it, you have every right to do that. But what's the point of that? Most of these places make money from advertising, and no advertiser is going to pay you if you don't have any readers.
    • Re:its thier site (Score:5, Insightful)

      by B'Trey (111263) on Sunday March 21 2004, @04:52PM (#8629212)
      As a libertarian and strong defender of personal rights, it flat out pisses me off when I see someone post crap like the parent.

      Of COURSE they can block whomever they want. Unless you're replying to a post that is advocating bringing a lawsuit, passing a new law to prohibit referral blocking or bringing in the National Guard to stop them from referral blocking, then what on earth is the point of your post? Yes, they can block whomever they want, and I can utilize my freedom of speech to point out that they're being stupid and will lose any business they may have gotten from me if they keep such a lame policy in place.

      Freedom to take an action does not mean freedom from the responsibility of that action, it simply means that neither the government or anyone else can use force to prevent you from taking the action. As I have yet to see a post advocating using force to change their policy, your post is completely inane.
    • by fmaxwell (249001) on Sunday March 21 2004, @04:54PM (#8629216) Homepage Journal
      Yes, they can block who they want, but they don't have a right to determine who will have fair use rights. The message that they displayed was "Unfortunately, we cannot satisfy this particular request because it comes from a source that is not authorized to redistribute our content..." That implies that LinuxToday was violating CMP's copyright (because CMP has no legal right to decide who is 'authorized' to make fair-use excerpts. Thus, CMP has slandered LinuxToday.

      On a wider scale, we have seen large corporate entities go to great lengths to prevent fair use. The RIAA and MPAA have redefined fair use and put copy protection into place to prevent fair use copying and backup. Broadcasters will have a "flag" in HDTV broadcasts that tells digital recording devices whether a broadcast can be recorded. Software companies have long fought against fair use. I just bought Unreal Tournament 2004. It uses a form of copy protection and, on top of that, requires that a "Play CD" be in the drive. You can't back up that CD using normal methods and you're hosed if it gets damaged or lost. (There were cracks out the next day, but 99% of people will never know about the cracks.)

      We need laws protecting fair use before large corporations effectively quash it. Should CMP be allowed to "punish" a site for exercising their fair use rights to excerpt? I see both sides of this one, but, given the big picture of corporations deciding to prevent fair use, I have to side with LinuxToday.
    • Re:its thier site (Score:4, Insightful)

      by pla (258480) on Sunday March 21 2004, @05:48PM (#8629438) Journal
      they can block whoever they want

      No.

      They can try to block whomever they want. That does not mean the same as saying they "can" block such people.

      A number of simple workarounds exist, such as disabling referrers in your browser altogether; simply cutting-and-pasting the URL into your browser's URL bar; using a fake referrer that almost everyone accepts (such as Google); or my personal favorite, always use a page as its own referrer (I've seen a few sites the first two will break, and can imagine some that might block Google, but never a site that will block itself).

      In any case, this has little to do with "can" and "cannot". It has to do with the very nature of the web, and the idea of fair-use. The web exists as links. Blocking some of them hurts everyone on the web, not just one or two sites. As for "unauthorized", sorry, but if you run a web site without some form of password protection, you have implicitly "authorized" the entire world to visit, like it or not.

      I do need to question the sanity of a site, which derives its revenues from banner ad views, choosing to reduce the number of ad views. But that doesn't matter beyond "how stupid can people get?". Let them shoot themselves in the wallet, doesn't much matter to me. But preventing me from seeing their site, just because I only learned about it from a meta-news site? That I most certainly do care about!
    • Re:I'd Be Worried (Score:5, Informative)

      by dbc (135354) on Sunday March 21 2004, @05:45PM (#8629424)
      Just so nobody is misled by your "entertainment publishing company" comment, here is a list of CMP Media's print rags (copy/pasted from their web site):

      Bank Systems & Technology
      BioMechanics
      C/C++ Users Journal
      Call Center
      CMP Books
      Communications Convergence
      CRN
      DB2 Magazine
      Diagnostic Imaging
      Diagnostic Imaging Asia Pacific
      Diagnostic Imaging Europe

      Diagnostic Imaging SCAN
      Dr. Dobb's Journal
      DV Magazine
      EE Times
      Embedded Systems Programming Magazine
      Game Developer
      Geriatric Times
      InformationWeek
      Insurance & Technology
      Intelligent Enterprise Magazine
      MSDN Magazine

      Network Computing
      Network Magazine
      Optimize
      Psychiatric Times
      Software Development
      SysAdmin
      Technology & Learning
      Transform Magazine
      VARBusiness
      Wall Street & Technology
      Windows Developer Network
      Xtreme Video

      Several of which many SlashDot'ers probably read.

      From time-to-time, I've gotten several of them. CMP is decidedly uneven -- some of their rags are good, some are woefully clueless. My personal assesment is that their management is mostly clueless, except for being able to sell advertising and bring those dollars to the bottom line.

      So, while I agree with "I'd be worried, except that it is CMP media"... I think your characterization of them as entertainment media needs to be clarified as the sarcasm that it is.

      In any case, their "please don't send me traffic" attitude is clueless.