REP

• Explicitly logged during second crawl only

• 59/149 (~40%) of sites had a robots.txt file

• Earlier crawl (for Ariadne article) showed 33% of sites used REP

• No META tag REP

Previous slide

Next slide

Back to first slide

View graphic version