Getting Unnoticed

While I was working on the conversion, I setup a sub-domain at testbed.jclark.org. Unfortunately, I forgot to disable pings, and my testbed site ended up pinging something (pingomatic, I think). Google indexed the test site, and Technorati climbed all over it. Technorati found a special hacked version of my old blosxom site that contained links to the real site (jclark.org), so now my technorati inbound links page is full of posts from the test site that linked to me. Since this is now a dead site, I didn’t want it indexed by any search engine.

As soon as I figured out what happened, I killed testbed.jclark.org with a .htaccess mod_rewrite rule that makes every URI on the site return 410 Gone. After a few days, nothing had changed. A little research revealed how to get removed from Google. In short, I added a robots.txt file disallowing all User Agents (I could have disallowed only Googlebot). To hasten the process, I used the url removal system to request an expedited check of my robots.txt file. I also had to modify my mod_rewrite rules to serve robots.txt, since I was sending 410 for every request. Within a day, the test site was gone from Google.

Getting delisted from Technorati has proven more difficult. I’ve been unable to find any instructions on the website. I tried using the ping form to have some posts re-spidered, knowing they would return a 410, but no change so far. I sent an email to support about a week ago, to which I’ve received no reply. A day later, all of the posts had dissapeared, only to return hours later. If anyone knows how to get delisted, please leave me a comment.

Both comments and pings are currently closed.

Comments are closed.