Not quite. It is best if you go revert to the default robots.txt. You have this :.
The robots.txt report shows which robots.txt files Google found for the top 20 hosts on your site, the last time they were crawled, and any warnings or ...
Old Hard to Find TV Series on DVD
Thanks to our users for alerting us to an issue with incorrectly reporting that sites and Sitemaps were being blocked by robots.txt files. We have resolved this ...
A robots.txt file provides restrictions to search engine robots (known as "bots") that crawl the web. These bots are automated, and before they access pages ...
I'm getting a nag from Google saying that I need to add a couple of lines to my robots.txt file so that it can index my images properly. How do ...
We have an article on how best to setup your robots. ... Test and fix in Google Search Console. Google helps you find and fix issues with your ...
txt file, here's the fix: Generally this is because you accientally checked "Hide this page from search engines" in the SEO settings of a specific page, or for ...
Solved: Hi there, I haven't been indexed by Google for my blog posts. What am I doing wrong? Having solved this problem, where should I go next? The.
So looking at Ahrefs, all my blog links are blocked from robots.txt. Is this normal? Cause when I googled my blogs, nothing shows. Not even the ...
The shopify robots.txt file (uneditable by users) is disallowing all blogs from being crawled by Google. This makes it impossible to do any ...