Robots.txt

[Borislav_VD]

Which is the very best robots.txt for your theme I wish to show just the pages . Not the content , galleries, plugins , wp admin etc . just the pages . Which robots.txt should I use . I use the yoast seo

[XSupport]

Hi there,

Thanks for writing in.

There’s no theme specific robots.txt file. It’s a user preference and responsibility to add it depending on their preferred setup. There is online generator for robots.txt and there are plugins that you can install too.

http://tools.seobook.com/robots-txt/generator/
https://yoast.com/wordpress-robots-txt-example/ (SEO Yoast plugin)

Once you created it, just upload it through FTP at your wordpress’s root folder.

Thanks.