Brett Loses His Mind Part 2
November 21, 2005
Well it didn’t take long for some people to realize that BT could use some help getting all of those 2,050,000 pages out of Google.
And Danny also brings up a good point about how long it should really take for WebmasterWorld to go missing from SERPS.
If search engines are hitting that robots.txt ban repeatedly, they ought to be dropping those pages in short order, or they aren’t very good search engines.
Of course, Danny is correct. If an average mom & pop site excluded all bots, it certainly wouldn’t take 60 days for the pages to disappear. But what about a site like WebmasterWorld? Over 2 million pages of content that is served to searchers thousands of times a day. Will the engines give WebmasterWorld preferential treatment because they don’t want to lose all that valuable content?
Only time will tell. The clock is now ticking………
Comments
2 Responses to “Brett Loses His Mind Part 2”
Before You Reply, Please Read My Comment Policy
I have a cunning plan to bring Google to their knees it goes like this:
User-agent: Googlebot
Disallow: /
So if, after a count of three, we all put this in our robots.txt file. Fiendishly clever, Google with no results - well whacked!
[...] At first, I didn’t get it. While some of us thought he had lost his mind, we knew that Brett Tabke was no dummy. You don’t build the most successful webmaster forum on the web without understanding a thing or two about a thing or two. [...]