Thread Rating:
  • 0 Vote(s) - 0 Average
Share Thread:
What is the purpose of robots.txt file?
#11
Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.
Cheapest VPS | $1 VPS Hosting
Cheap Dedicated Servers | Free Setup and IPMI | Unmetered Bandwidth


Messages In This Thread

Forum Jump:


Users browsing this thread: 1 Guest(s)