usefulfor.com/security security dojo

check for robots.txt

Some times it is useful to check if a given HTTP server has a robots.txt file in it. If it exist it may disclose interesting information, useful for a pentest

Popularity: 5% [?]