RKG Logo 434-978-4300

I enjoy stumbling onto new things, and so changed my default FireFox homepage from Google’s personalized homepage to Yahoo’s redirect to a random URL (random.yahoo.com/bin/ryl) just to shake things up. After randomly hitting content spam pages (MFA) a few times when opening the browser in the morning, I began to wonder about their prevalence. After all, the web is a huge haystack, and those bogus pages must be occasional needles, right?

Curious, I tried 50 random pages from random.yahoo.com/bin/ryl. I’m assuming (big assumption) that Y! isn’t filtering all that much, save for language — that’s my guess because (a) all the results were in english, (b) three of the 50 were broken links, and (c) three of the 50 were porn sites.

Of the 50, four were clearly junk pages solely designed to generate search revenue. These four URLs were all concatenations of two common dictionary words which didn’t make much sense together, clearly suggesting they were purchased by a ‘bot. (The most amusing of the four was dochunter.com
, which can’t seem to decide if the page is about hunting moose, choosing a MD, or
– gasp — hunting doctors).

This survey is decidedly unscientific, is based on a tiny sample, and depends critically on the randomness of random.yahoo.com/bin/ryl, which isn’t known.

But still, 4 in 50 is 8% — that is amazingly high, in my opinion. The web is well over 11.5 billion pages (that estimate is over 18 months stale) — 8% of 11.5b is over 900 million junk pages.

Even if this estimate is off on the high side by an order of magnitude, that suggests at least 100 million bogus content pages siphoning value from advertisers to spammers. Scary.

If you like this post, consider subscribing to our RSS feed. You can also have new posts sent to you via email.


Related Posts

    No related posts.

Your Comment

Tags

RKG

Trackback

http://www.rimmkaufman.com/rkgblog/2006/07/03/content-spam-at-8/trackback/

Blogs Citing This Post

  1. Pingback: Quack, Quack: Made-For-AdSense Spam on January 25, 2008

Email Updates

Categories

Recent Comments

  • George Michie: Doesn’t have to be, it can be intra-adgroup as well.
  • Josh: George – I take it you’re referencing a scenario where your exact-match keywords are not listed as negative exact match keywords...
  • George Michie: Melissa, you’re right, it’s always happened to varying degrees, particularly since the advent of extended broad match....
  • Mel66: I don’t think this is a bug. It’s been happening for years. It *is* impossible to manage, and I can’t help but wonder if...
  • George Michie: Thanks Matt, Sometimes humor serves a purpose.
  • George Michie: Ken, sadly, as Jim stated above, too few people look under the hood and raise Cain. We’re very fortunate to have great reps on...
  • Matt: This is great! I started out reading this with the same anger that I feel everyday I spend unnecessary amounts of time optimizing to get...
  • Ken Truman: Right on, George. This is yet another one of the vagaries of broad matching that continues to drive smart advertisers mad. Your post...
  • George Michie: Interesting idea, Mark. The question might be: would advertisers know someone’s Twitter handle? Most require an email, but I...
  • @markthijssen: What if you would ask a consumer about his experience with the product some days/weeks/months after the sale via twitter. This might...
  • George Michie: Thanks Kenny, Another particularly annoying variation on the theme involves flashing the brand ads around on general searches. The...
  • Kenny: I’ve seen this happen too – very annoying, especially when the broad match ad that is served is specific to a particular...
  • George Michie: Jim, I think you’re right on that last piece. To me, Google doesn’t have to see this as either/or, by simply offering...
  • Jim Novo: I’ve also written about this “smart client” problem, the idea that a lot of what Google “suggests” or does...
  • Kathleen Raines: In my letter I did put the wrong month. I said April it should have been May.

Blog Stats

  • Posts: 948
  • Words: 451,089
  • Comments: 2,862

Administration