4da8cf976f49a9bdc501c01e60577d821052e11b
Andrew Lewman update robots.txt with site...

Andrew Lewman authored 14 years ago

1) Sitemap: http://www.torproject.org/sitemap.xml
2) Sitemap: https://www.torproject.org/sitemap.xml
Andrew Lewman Update robots.txt.

Andrew Lewman authored 16 years ago

3) User-Agent: *