What is robot.txt file and what are the benefits of using it? - Site Owners Forums

		Site Owners Forums - Webmaster Forums > General Arena > Social Networks
What is robot.txt file and what are the benefits of using it?

FAQ

Calendar

Today's Posts

Notices

Welcome to SiteOwnersForums.com #1 Webmasters Community Online

You are currently viewing our forum as a guest which gives you limited access.
Membership is absolutely FREE and registration is FAST & SIMPLE so please, Register Today and join one of the friendliest communities on the net!
If you have any problems with the registration process or your account login, please contact us.

Thread Tools

Rate Thread

Display Modes

03-25-2016, 05:57 AM	#7
sudeepkhana Registered User Join Date: Jan 2016 Location: India Posts: 1,258	Robot.txt is a text file kept on the web servers. The robot.txt allows the site admin to permit/allow which Search engines(like google, yahoo,bing) can crawl the site. Some times the admins won't allow any of the search engines to crawl at all. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

« Previous Thread | Next Thread »

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

Posting Rules
You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is On HTML code is Off Forum Rules

Forum Jump

All times are GMT -7. The time now is 02:19 PM.