Thread Rating:
  • 0 Vote(s) - 0 Average
Share Thread:
Is robots.txt file enough to block some pages from Search Engines?
#3
(10-24-2019, 05:52 AM)lammao Wrote: Is robots.txt file enough to block some pages from Search Engines? I mean from crawling and indexing.

Robots.text file only tells search engines or suggest some might say that it can or cannot crawl & index any page. It doesn't necessarily blocks them. .htaccess file is the best option for you as @ksmith29 suggested.
Reply
[-] The following 1 user Likes danni's post:
  • lammao


Messages In This Thread
RE: Is robots.txt file enough to block some pages from Search Engines? - by danni - 10-30-2019, 07:28 AM

Forum Jump:


Users browsing this thread: 2 Guest(s)
[-]
Ad

[-]
Top Articles
100+ Social Bookmarking Sites List
55+ Image Submission Sites List

[-]
Recent Posts
https://www.facebook.com/My.Pureganics.CBD.Gummies.Official/
Pureganics CBD Gummies:- Furthermore, analysts are as yet attempting to understand the s...BeverlyKessler — 08:53 AM
https://www.facebook.com/My.Pureganics.CBD.Gummies.Official/
Pureganics CBD Gummies:- Furthermore, analysts are as yet attempting to understand the s...BeverlyKessler — 08:52 AM
https://store-fast-burn-keto-gummies.webflow.io/
Fast Burn Keto Gummies Be aware about detail estimates. make use of greater modest pla...anuevarichard — 08:31 AM
PhenoMAN Gummies United Kingdom: Your Key to Sexual Wellness
GET SPECIAL OFFER THIS WEEK SALE UP TO 85% OFF PhenoMAN Gummies United Kingdom- Fin...drickaany — 07:55 AM
What are the top digital marketing tools..?
Hello! There are many digital marketing tools available to help you with various aspects ...jahnvi arora — 06:06 AM

[-]
Follow us on Facebook