White House Website Limits Iraq-Related Crawling?

Posted on by T.H.

* Whitehouse.gov Robots.txt(keith)
* Technorati(http://www.whitehouse.gov/robots.txt)
* Blogdex(whitehouse.gov/robots.txt)
* Metafilter: Comments
* White House Website Limits Iraq-Related Crawling(slashdot)
* White House Website and History(from dan gillmor, but the comments are more interesting)

Discover more from T.H. Schee

Subscribe to get the latest posts sent to your email.