Google Search Console Indexing issue continued

Support
#1

Hi,

This is picking up from this closed topic

I turned off Cloudflare and the issue with resources not loading in Google Mobile-Friendly Test remained.
https://search.google.com/test/mobile-friendly?id=FTR6n9Mxv3-gU91N2k9aFg

The page appears correctly on any mobile device I check it on, with all the resources loading correctly

What else can I look at to get the resources to load on Google’s Mobile-Friendly Test page?

Thanks,

J

#2

Hi Jhaysin,

Thanks for reaching out.

Your site blocks access from bot, an example is google bot which responsible for crawling your sites. Please check this tool http://www.botsimulator.com/ and paste your site’s URL and you’ll get this result

Then try accessing normally as a browser

When accessed by GoogleBot, your server returns Error 520, I recommend contacting your hosting provider. This isn’t related to Wordpress, theme, or any coding. It’s more on security or firewall, or similar.

Thanks!

#3

Thanks again Rad.

I showed the botsimulator.com data to my server support, and they were able to clear the error on the site.

However, the page loading issues on Google’s Mobile-Friendly Test page remain
https://search.google.com/test/mobile-friendly?id=cldTmM9aiZRcCOd0IIv1nQ

What else can I look at?

Best regards,

J.Gilman | Creative Director

Danger Press
675 Metropolitan Parkway SW
Suite 6020
Atlanta, GA 30310-2082
404 822 2376

Daily in the shop

Event Printing

Store

#4

Hi Jhaysin,

They didn’t fix it, it still the same. The screenshot you provided doesn’t show the Googlebot user agent, that’s why it works. Please choose google bot and let them test it again.

And this is the test in your screenshot

Thanks!

#5

Thanks for clarifying Rad.

My server support is looking for errors
I sent the correction and this was the response:

The above-provided third-party tool is not a viable way to simulate Google bot’s activity. The configured Captcha on the server is blocking Googlebot useragents if they do not originate from Google’s IP address ranges.

The server is configured in this way in order to ensure no malicious bots abuse Google’s useragent as we do not want to have such malicious traffic.

According to the access log, I was able to locate access from Google bots:

Code:
65.121.54.150 - - [25/Apr/2019:11:14:34 -0500] "GET /wp-content/uploads/2015/10/111209.jpg HTTP/1.0" 200 14233 "https://www.google.com/" "Mozilla/5.0 (X11; CrOS x86_64 11647.104.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.88 Safari/537.36"

#6

Hi Jhaysin,

Yes, that tool is just a simulation but still blocked, it’s enough evidence that it blocks anything that carries a name of the bot, Googlebot is just one of them.

And they confirmed, their server is configured to blocked malicious bots that use Google useragents. The question is, why the actual tool of Google (Google Mobile Friendly) is blocked as well? I only use the above tool as a comparison which then has the same result as the real tool from Google.

It will usually say, 403 not found, 500 internal error, or any valid error. But it says other error, or unknown error similar to that simulation.

This makes me assume their security isn’t working well as it can’t really see what’s a malicious bot.

Plus, it looks like they forgot to check the details of the logs. This has no Googlebot useragents

65.121.54.150 - - [25/Apr/2019:11:14:34 -0500] "GET /wp-content/uploads/2015/10/111209.jpg HTTP/1.0" 200 14233 "https://www.google.com/" "Mozilla/5.0 (X11; CrOS x86_64 11647.104.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.88 Safari/537.36"

They assume it’s a Googlebot since it has google.com, but if they will check the IP here http://whois.domaintools.com/65.121.54.150. It’s not accessed from google bot, Googlebot is still blocked. I think they should thoroughly test it :slight_smile:

Thanks!

#7

This topic was automatically closed 10 days after the last reply. New replies are no longer allowed.