what is robot.txt in blogger..? - Site Owners Forums

		Site Owners Forums - Webmaster Forums > Search Engine Optimization > Search Engine Optimization
what is robot.txt in blogger..?

FAQ

Calendar

Today's Posts

Mark Forums Read

Notices

Welcome to SiteOwnersForums.com #1 Webmasters Community Online

You are currently viewing our forum as a guest which gives you limited access.
Membership is absolutely FREE and registration is FAST & SIMPLE so please, Register Today and join one of the friendliest communities on the net!
If you have any problems with the registration process or your account login, please contact us.

Thread Tools

Rate Thread

Display Modes

04-05-2019, 03:44 AM	#1
Sojan Babu Registered User Join Date: May 2017 Posts: 245	Robots.txt is a text file webmasters create to instruct web robots (typically search engine robots) how to crawl pages on their website. The robots.txt file is part of the robots exclusion protocol (REP), a group of web standards that regulate how robots crawl the web, access and index content, and serve that content up to users. Allowing all web crawlers access to all content User-agent: * Disallow: Using this syntax in a robots.txt file tells web crawlers to crawl all pages on www.example.com, including the homepage. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

« Previous Thread | Next Thread »

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

Thread Tools
Show Printable Version Email this Page
Display Modes	Rate This Thread
Switch to Linear Mode Hybrid Mode Switch to Threaded Mode	Rate This Thread:

Posting Rules
You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is Off HTML code is Off Forum Rules

Forum Jump

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
robot.txt	Shivam Tripathi	Web Promotion	5	12-16-2018 10:11 PM
Brandon Brice is top rated rated Social Media Blogger	deepakrajput	Post your ad here	0	04-24-2015 04:48 AM
how to eligible for adsense in blogger	ifte111	Making money on the web	2	11-01-2014 08:35 AM
Per post keywords in Blogger	Shamatae	Search Engine Optimization	3	10-10-2014 01:42 AM
Blogger Sitemap through Google Webmaster Tools	Shamatae	Google	1	12-06-2013 01:00 AM

All times are GMT -7. The time now is 11:56 AM.