01-16-2018, 07:38 AM | #1 |
Registered User
Join Date: Jul 2014
Posts: 177
|
Robot.txt file
If google bot fail to access robot.txt what are its effects of SEO practice ?
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
01-21-2018, 10:03 PM | #2 |
Registered User
Join Date: Sep 2017
Posts: 177
|
Robots.txt is a text file webmasters create to instruct web robots (typically search engine robots) how to crawl pages on their website.
|
01-22-2018, 02:57 AM | #3 |
Registered User
Join Date: Dec 2017
Posts: 235
|
Robots.txt is a text file webmasters create to instruct web robots (typically search engine robots) how to crawl pages on their website.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
01-29-2018, 12:53 AM | #4 |
Registered User
Join Date: Oct 2017
Posts: 51
|
hi,
Search engines may not crawl your websites if roborts.txt are absent
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
02-07-2018, 12:25 AM | #5 |
Registered User
Join Date: Nov 2017
Posts: 156
|
In a nutshell. Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. It works likes this: a robot wants to vists a Web site URL, say http://www.example.com/welcome.html.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
02-14-2018, 01:05 AM | #6 |
Registered User
Join Date: Feb 2018
Location: India
Posts: 14
|
Not so important. I got indexed website's page without the Robots.txt.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
What is robot.txt file and what are the benefits of using it..? | AshokDixit89 | Search Engine Optimization | 8 | 05-05-2017 04:30 AM |
Why We Use robot.txt file In Seo..? | ankitasharma123 | Search Engine Optimization | 7 | 04-20-2017 12:59 PM |
Which pages should be put in robot.txt file? | Martinricky | Search Engine Optimization | 1 | 07-24-2016 11:15 PM |
how can create the Robot.txt file | eagleeye dental | Search Engine Optimization | 0 | 09-01-2014 09:40 PM |