Sometime you may notice that your blog pages are not indexing although you have left no stone upturned. If you experience such type of incident make sure your pages are not blocked by robots.txt. Robot.txt is a file which instruct the web crawlers (Google Bots) which pages or specific part of your blog is permitted to crawl and indexing.
If you are new and do not have sufficient knowledge about indexing, I advise you not to use this at initial stage. In blogger go to “setting” and under “Crawlers and indexing” leave the custom robots.txt turned off. In default setting google already have turned it off. If you really wish to control the visibility of pages, you may use “Custom Robots Header Tags” to manage and control the particular page visibility.
No comments:
Post a Comment
Welcome to Make Blog