check for robots.txt
Tuesday, October 23rd, 2007Some times it is useful to check if a given HTTP server has a robots.txt file in it. If it exist it may disclose interesting information, useful for a pentest ![]()
(more…)
Some times it is useful to check if a given HTTP server has a robots.txt file in it. If it exist it may disclose interesting information, useful for a pentest ![]()
(more…)