Links not crawable and robots.txt

[markusp80]

Hi! I am trying to improve speed, SEO etc for my website, and I know it’s outside of the scopte for your support. But maybe you at least hve some insight. I have seen your standard answer here and there in the forum with getting developer help etc.

But I can at least try.

The website is https://shootit.se

1. Links are not crawlable. Is there a way to add some custom code to make Google page speed insight not react the way it does? I’m guessing it has something to do with my menu?

2. Do you have any idea why the robots cannot be reahed? It’s there, just click this link: https://shootit.se/robots.txt
   The sitemap is there as well.

These are the only two faults I receive and I literally do everything I can to follow best practices (95-99/100) and the SEO should be higher.

[ruenel]

Hello @markusp80,

Thanks for writing in! It is best that you use a complete SEO plugin like the one from Yoast so that you do not have to worry about setting up the robot.txt file or any related issues. Be advised that this is merely a suggestion since we are not SEO experts.

Best Regards.

[markusp80]

Hi! I use Yoast, but I had not activated the robots.txt function. I did that but still Google Page Speed insight could not fetch it yesterday.

But when I tried it today it seems to work, and SEO score was raised from 86 to 93, so the issue is solved.

[ruenel]

Hey @markusp80,

Thanks for the heads up.

RueNel