I still have one nagging question: What is this ‘crawler cap’ and where did it come from? Admittedly, I’ve only been in the SEO industry for about 18 months, but I’ve never heard of it, and I didn’t get a chance to ask Shari, myself.

Can anyone tell me, or point me in the right direction as to where it comes from? Which SE(s) employ it? What are the specifics (what’s the formula)… what increases the cap, lowers it, and by how much, etc.?

Thanks!

The biggest problem we have with duplicate content is when we get a new client who already has a site built. A few too many rely on template services related to their specific industry, apparently not understanding that the content they buy is also found on hundreds of other sites (sometimes owned by competitors) – same headline, text and images.

The looks on their faces when they realize *their* great site is simply one of dozens of cookie-cutter great sites is really sad.

The looks when they discover how much time and effort (and often money) it will take to “unduplicate” the content is even sadder.

They are really predictable; one look at the poorly-constructed introductions or the “get-rich-quick” themes and I know they’re not worth my time. Ever.

It’s such a relief that there are people who are trying to get to the bottom of this (and hopefully find a way to stop it).

Kudos for posting a very relevant topic whom many will relate to.