Register on the forum now to remove ALL ads + popups + get access to tons of hidden content for members only!

Go Back   Site Owners Forums - Webmaster Forums > Search Engine Optimization > Search Engine Optimization


Thread Tools Rate Thread Display Modes
Old 08-06-2015, 12:18 AM   #1
Registered User
Join Date: Sep 2014
Posts: 681
Should you panic for new Google warnings over media?

Hey everyone, Google is warning everyone about Googlebots not being able to access CSS and JS files. I thought this might be a good idea to share with you guys and hear your side of the story.
Couple of days ago we saw a flood of warnings from Google for some of our websites, although these warning were not penalizing any of the websites but we decided to take action and fix the issues.

It all started with some messages in Google Webmaster tools, showing that Googlebot (Google little spiders) cannot access your JavaScript (JS) and/or CSS files. Well previously there was no errors and suddenly Google cannot access the files. The new algorithm Google has deployed, needs access to some deeper levels of a website to be able to index the website even better.

Most developers when they set up robots.txt (a text file to show search engines where they can and cannot see), block (disallow) templates, image galleries and other types of media. But Google does not like that anymore, and wants to dig deeper into the website. How to solve this issue though is not a difficult process.

To allow Googlebot to crawl and see those parts of your website, there are some workarounds but the easiest is to allow Googlebot to index images, media, templates and modules through your robots.txt file. Simply take out “disallow” function from those areas and fetch with Google to test the new robot.txt.

There are some points to consider while fixing this. Do not totally remove or delete your robots.txt, you need a robot.txt file for other bots. The only spiders on internet are not for search engines, and although you cannot stop misuse with robot.txt but it can help prevent some bots accessing specific parts of your website. That being said, robots.txt is not an obligatory command for bots and it is a suggestion, so there are pages disallowed by robots.txt but still being indexed. Therefore do not use this method to hide or secure a certain file or part of your website. If you type in "" you will be able to see your robots.txt, and if you are hiding anything, it would show everyone what that would be.
Mobile Application Development Firm | Game Development USA | Mobile Application Developer | Game Developer USA
Ruby707 is offline   Reply With Quote

Old 08-06-2015, 03:30 AM   #2
Registered User
Join Date: Aug 2014
Location: Bangalore
Posts: 3,036
Simple one should never panic, and that doesn't go for just SEO but anything in life.
ketul is offline   Reply With Quote

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
would you like to your webiste first page in google? shoaib Marfatiy Search Engine Optimization 9 02-07-2017 03:16 AM
A Banned Site Re-indexed By Google and MSN Live within 24 hours - EASY! theshawnchin Google 15 07-28-2015 12:02 AM
How to find hidden social media referral traffic in Google Analytic? geneliabravo Search Engine Optimization 1 03-27-2015 12:34 AM
Google Plus will over take the Facebook in Social Media Promotions? sahithya Search Engine Optimization 0 06-04-2014 05:01 AM
Google Sending Warnings about “Artificial” Or “Unnatural” Links Google 1 06-26-2012 06:44 AM

All times are GMT -7. The time now is 03:13 AM.

Powered by vBulletin Copyright © 2013 vBulletin Solutions, Inc.