iExploit

Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Sign In Apply for Membership

Top Posters

Who's Online (2)

Powered by Vanilla. Made with Bootstrap.
Looking to introduce yourself? Look no further, and click here! We also have IRC! [irc.evilzone.org #iexploit]
robot and how to find it
  • a_tek7
    Posts: 14
    what is robot and how it can be configured to hide some parts of a website from search engine for example admin 's login page?
  • Sh3llc0d3
    Posts: 1,910
    robots.txt is found in the sites root directory if it exists.

    http://tools.seobook.com/robots-txt/
  • mandi
    Posts: 207
    use a crawler and scan the site.. you will find it something like robots.txt

    and regarding your second question,you answered the question by your-self :)
  • a_tek7
    Posts: 14
    Tx bros.
    when I'm using crawler I have to use Proxy or vpn?
  • Sh3llc0d3
    Posts: 1,910
    If you want to stay hidden and you'll be conducting further activities on the same host then using a vpn/proxy may be worthwhile but either-way crawling a site is quite noisy and will soon be filling up the server's access logs.
Add a Comment