Wow. This is interesting. I found a comparison of the whitehouse.gov’s robots.txt file from the Bush administration vs. Obama’s. Looks like the new administration is a little less paranoid. Well, at least at the start of the administration. Let’s hope it stays that way. Related posts No related posts.