{"id":973,"date":"2010-06-22T13:10:51","date_gmt":"2010-06-22T17:10:51","guid":{"rendered":"http:\/\/cd34.com\/blog\/?p=973"},"modified":"2010-06-22T13:10:51","modified_gmt":"2010-06-22T17:10:51","slug":"not-cool-cuil","status":"publish","type":"post","link":"https:\/\/cd34.com\/blog\/boring\/not-cool-cuil\/","title":{"rendered":"Not cool, Cuil"},"content":{"rendered":"<p>Not that it impacts this site, but, here&#8217;s another fine example of a company that doesn&#8217;t quite understand distributed computing.<\/p>\n<p><code>67.218.116.171 - - [22\/Jun\/2010:12:22:40 -0400] \"GET \/robots.txt HTTP\/1.1\" 200 102 \"-\" \"Mozilla\/5.0 (Twiceler-0.9 http:\/\/www.cuil.com\/twiceler\/robot.html)\"<br \/>\n67.218.116.168 - - [22\/Jun\/2010:12:30:12 -0400] \"GET \/robots.txt HTTP\/1.1\" 200 102 \"-\" \"Mozilla\/5.0 (Twiceler-0.9 http:\/\/www.cuil.com\/twiceler\/robot.html)\"<br \/>\n67.218.116.167 - - [22\/Jun\/2010:12:31:57 -0400] \"GET \/robots.txt HTTP\/1.1\" 200 102 \"-\" \"Mozilla\/5.0 (Twiceler-0.9 http:\/\/www.cuil.com\/twiceler\/robot.html)\"<br \/>\n67.218.116.169 - - [22\/Jun\/2010:12:32:55 -0400] \"GET \/robots.txt HTTP\/1.1\" 200 102 \"-\" \"Mozilla\/5.0 (Twiceler-0.9 http:\/\/www.cuil.com\/twiceler\/robot.html)\"<br \/>\n216.129.119.45 - - [22\/Jun\/2010:12:33:52 -0400] \"GET \/robots.txt HTTP\/1.1\" 200 102 \"-\" \"Mozilla\/5.0 (Twiceler-0.9 http:\/\/www.cuil.com\/twiceler\/robot.html)\"<br \/>\n216.129.119.49 - - [22\/Jun\/2010:12:37:30 -0400] \"GET \/robots.txt HTTP\/1.1\" 200 102 \"-\" \"Mozilla\/5.0 (Twiceler-0.9 http:\/\/www.cuil.com\/twiceler\/robot.html)\"<br \/>\n216.129.119.42 - - [22\/Jun\/2010:12:37:51 -0400] \"GET \/robots.txt HTTP\/1.1\" 200 102 \"-\" \"Mozilla\/5.0 (Twiceler-0.9 http:\/\/www.cuil.com\/twiceler\/robot.html)\"<br \/>\n67.218.116.165 - - [22\/Jun\/2010:12:40:05 -0400] \"GET \/robots.txt HTTP\/1.1\" 200 102 \"-\" \"Mozilla\/5.0 (Twiceler-0.9 http:\/\/www.cuil.com\/twiceler\/robot.html)\"<br \/>\n67.218.116.170 - - [22\/Jun\/2010:12:40:27 -0400] \"GET \/robots.txt HTTP\/1.1\" 200 102 \"-\" \"Mozilla\/5.0 (Twiceler-0.9 http:\/\/www.cuil.com\/twiceler\/robot.html)\"<br \/>\n216.129.119.47 - - [22\/Jun\/2010:12:41:25 -0400] \"GET \/robots.txt HTTP\/1.1\" 200 102 \"-\" \"Mozilla\/5.0 (Twiceler-0.9 http:\/\/www.cuil.com\/twiceler\/robot.html)\"<br \/>\n216.129.119.40 - - [22\/Jun\/2010:12:42:52 -0400] \"GET \/robots.txt HTTP\/1.1\" 200 102 \"-\" \"Mozilla\/5.0 (Twiceler-0.9 http:\/\/www.cuil.com\/twiceler\/robot.html)\"<br \/>\n216.129.119.43 - - [22\/Jun\/2010:12:43:01 -0400] \"GET \/robots.txt HTTP\/1.1\" 200 102 \"-\" \"Mozilla\/5.0 (Twiceler-0.9 http:\/\/www.cuil.com\/twiceler\/robot.html)\"<br \/>\n67.218.116.164 - - [22\/Jun\/2010:12:43:37 -0400] \"GET \/robots.txt HTTP\/1.1\" 200 102 \"-\" \"Mozilla\/5.0 (Twiceler-0.9 http:\/\/www.cuil.com\/twiceler\/robot.html)\"<br \/>\n216.129.119.45 - - [22\/Jun\/2010:12:52:25 -0400] \"GET \/%7Emcd\/crossovernext.html HTTP\/1.1\" 404 354 \"-\" \"Mozilla\/5.0 (Twiceler-0.9 http:\/\/www.cuil.com\/twiceler\/robot.html)\"<br \/>\n216.129.119.41 - - [22\/Jun\/2010:12:55:37 -0400] \"GET \/robots.txt HTTP\/1.1\" 200 102 \"-\" \"Mozilla\/5.0 (Twiceler-0.9 http:\/\/www.cuil.com\/twiceler\/robot.html)\"<br \/>\n67.218.116.166 - - [22\/Jun\/2010:12:56:53 -0400] \"GET \/robots.txt HTTP\/1.1\" 200 102 \"-\" \"Mozilla\/5.0 (Twiceler-0.9 http:\/\/www.cuil.com\/twiceler\/robot.html)\"<br \/>\n<\/code><\/p>\n<p>All that for a 404 on a page that hasn&#8217;t existed in 10 years.<\/p>\n<div style=\"float:left;\">\n<div id=\"fb-root\"><\/div>\n<fb:like href=\"https:\/\/cd34.com\/blog\/boring\/not-cool-cuil\/\" width=\"250\" send=\"false\" show_faces=\"false\" layout=\"button_count\" action=\"recommend\"><\/fb:like>\n<\/div><div style=\"clear:both;\"><\/div>","protected":false},"excerpt":{"rendered":"<p>Not that it impacts this site, but, here&#8217;s another fine example of a company that doesn&#8217;t quite understand distributed computing. 67.218.116.171 &#8211; &#8211; [22\/Jun\/2010:12:22:40 -0400] &#8220;GET \/robots.txt HTTP\/1.1&#8221; 200 102 &#8220;-&#8221; &#8220;Mozilla\/5.0 (Twiceler-0.9 http:\/\/www.cuil.com\/twiceler\/robot.html)&#8221; 67.218.116.168 &#8211; &#8211; [22\/Jun\/2010:12:30:12 -0400] &#8220;GET \/robots.txt HTTP\/1.1&#8221; 200 102 &#8220;-&#8221; &#8220;Mozilla\/5.0 (Twiceler-0.9 http:\/\/www.cuil.com\/twiceler\/robot.html)&#8221; 67.218.116.167 &#8211; &#8211; [22\/Jun\/2010:12:31:57 -0400] &#8220;GET \/robots.txt [&hellip;]<\/p>\n<div style=\"float:left;\">\n<div id=\"fb-root\"><\/div>\n<fb:like href=\"https:\/\/cd34.com\/blog\/boring\/not-cool-cuil\/\" width=\"250\" send=\"false\" show_faces=\"false\" layout=\"button_count\" action=\"recommend\"><\/fb:like>\n<\/div><div style=\"clear:both;\"><\/div>","protected":false},"author":15,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[129,127,128],"class_list":["post-973","post","type-post","status-publish","format-standard","hentry","category-boring","tag-bad-spider","tag-cuil","tag-robots-txt"],"_links":{"self":[{"href":"https:\/\/cd34.com\/blog\/wp-json\/wp\/v2\/posts\/973","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cd34.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cd34.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cd34.com\/blog\/wp-json\/wp\/v2\/users\/15"}],"replies":[{"embeddable":true,"href":"https:\/\/cd34.com\/blog\/wp-json\/wp\/v2\/comments?post=973"}],"version-history":[{"count":1,"href":"https:\/\/cd34.com\/blog\/wp-json\/wp\/v2\/posts\/973\/revisions"}],"predecessor-version":[{"id":974,"href":"https:\/\/cd34.com\/blog\/wp-json\/wp\/v2\/posts\/973\/revisions\/974"}],"wp:attachment":[{"href":"https:\/\/cd34.com\/blog\/wp-json\/wp\/v2\/media?parent=973"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cd34.com\/blog\/wp-json\/wp\/v2\/categories?post=973"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cd34.com\/blog\/wp-json\/wp\/v2\/tags?post=973"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}