{"id":323,"date":"2006-08-29T18:53:59","date_gmt":"2006-08-29T22:53:59","guid":{"rendered":"http:\/\/jclark.org\/weblog\/2006\/08\/29\/getting-unnoticed\/"},"modified":"2006-08-29T18:53:59","modified_gmt":"2006-08-29T22:53:59","slug":"getting-unnoticed","status":"publish","type":"post","link":"https:\/\/jclark.org\/weblog\/2006\/08\/29\/getting-unnoticed\/","title":{"rendered":"Getting Unnoticed"},"content":{"rendered":"<p>While I was working on the conversion, I setup a sub-domain at <code>testbed.jclark.org<\/code>.  Unfortunately, I forgot to disable pings, and my testbed site ended up pinging something (<a href=\"http:\/\/pingomatic.com\/\">pingomatic<\/a>, I think).  <a href=\"http:\/\/google.com\/\">Google<\/a> indexed the test site, and <a href=\"http:\/\/technorati.com\/\">Technorati <\/a> climbed all over it.  Technorati found a special hacked version of my old blosxom site that contained links to the real site (jclark.org), so now my <a href=\"http:\/\/www.technorati.com\/search\/http:\/\/www.jclark.org\/weblog\">technorati inbound links page<\/a> is full of posts from the test site that linked to me.  Since this is now a dead site, I didn&#8217;t want it indexed by any search engine.<\/p>\n<p>As soon as I figured out what happened, I killed testbed.jclark.org with a .htaccess <code>mod_rewrite<\/code> rule that makes every URI on the site return <a href=\"http:\/\/www.w3.org\/Protocols\/rfc2616\/rfc2616-sec10.html#sec10.4.11\">410 Gone<\/a>.  After a few days, nothing had changed.  A little research revealed <a href=\"http:\/\/www.google.com\/support\/webmasters\/bin\/answer.py?answer=35302\">how to get removed from Google<\/a>.  In short, I added a robots.txt file disallowing all User Agents (I could have disallowed only Googlebot).  To hasten the process, I used the <a href=\"http:\/\/services.google.com\/urlconsole\/controller\">url removal system<\/a> to request an expedited check of my robots.txt file.  I also had to  modify my <code>mod_rewrite<\/code> rules to serve robots.txt, since I was sending 410 for every request.  Within a day, the test site was gone from Google. <\/p>\n<p>Getting delisted from Technorati has proven more difficult.  I&#8217;ve been unable to find any instructions on the website.  I tried using the ping form to have some posts re-spidered, knowing they would return a 410, but no change so far.  I sent an email to support about a week ago, to which I&#8217;ve received no reply.  A day later, all of the posts had dissapeared, only to return hours later.  If anyone knows how to get delisted, please leave me a comment.  <\/p>","protected":false},"excerpt":{"rendered":"<p>While I was working on the conversion, I setup a sub-domain at testbed.jclark.org. Unfortunately, I forgot to disable pings, and my testbed site ended up pinging something (pingomatic, I think). Google indexed the test site, and Technorati climbed all over it. Technorati found a special hacked version of my old blosxom site that contained links [&hellip;]<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[47,37,49],"class_list":["post-323","post","type-post","status-publish","format-standard","hentry","category-uncategorized","tag-google","tag-mod_rewrite","tag-technorati"],"_links":{"self":[{"href":"https:\/\/jclark.org\/weblog\/wp-json\/wp\/v2\/posts\/323","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/jclark.org\/weblog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/jclark.org\/weblog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/jclark.org\/weblog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/jclark.org\/weblog\/wp-json\/wp\/v2\/comments?post=323"}],"version-history":[{"count":0,"href":"https:\/\/jclark.org\/weblog\/wp-json\/wp\/v2\/posts\/323\/revisions"}],"wp:attachment":[{"href":"https:\/\/jclark.org\/weblog\/wp-json\/wp\/v2\/media?parent=323"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/jclark.org\/weblog\/wp-json\/wp\/v2\/categories?post=323"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/jclark.org\/weblog\/wp-json\/wp\/v2\/tags?post=323"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}