So, I can see the argument towards enjoying the moment, but if it snowed in Key West, you can bet most people will be taking photos to share that moment with those who missed it.
I, personally, am alright with ignoring ROBOTS.TXT for archival purposes. I would rather my mistakes become immortalized, than lose those mistakes forever. If it was so easy to forget the past, I would have no reason to try to be the best me.