Go Back   Site Owners Forums - Webmaster Forums > Search Engine Optimization > Search Engine Optimization > Google

Notices


Reply
 
Thread Tools Rate Thread Display Modes
Old 05-29-2012, 02:08 AM   #1
eooc.box
Registered User
 
Join Date: Mar 2012
Posts: 87
Google question

I worked on a robots.txt for a customer to disallow certain areas of the site from google crawls and indexing... well, not just google but all bots... However, google is ignoring the robots.txt and doing its own thing anyway. Anybody else have this problem?

Google's been using up about 10GB/month on this particular site. Slurp was the worst culprit though topping out about 13GB. The site is heavily trafficked and the bandwidth is consistently going through the roof so any little bit of reduction would help them.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
eooc.box is offline   Reply With Quote

Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
OPTIMIZE YOUR SITE SUCCESSFULLY FOR Google. bobo.cx Google 25 05-10-2017 05:45 AM
Google Alerts Question wryfhk22 Search Engine Optimization 1 10-02-2014 03:11 AM
Google notice of unnatural links detected 101 Mark Jackson Google 2 11-04-2012 11:01 PM
Google lead the search for the socialization of the future development of social sear Chinese holiday Google 0 02-12-2012 11:38 PM
Question concerning Google and redirects mjvndhsb Google 0 10-10-2011 12:15 AM


All times are GMT -7. The time now is 02:48 PM.


Powered by vBulletin Copyright © 2020 vBulletin Solutions, Inc.