Google say URL is blocked by robots.txt but it isn't

Asked May 13 '20 at 05:01

Active May 13 '20 at 05:01

Viewed 52 times

My Google search console says that my submitted URL is blocked by robots.txt, but I checked header, tags and robots.txt it isn't. My URL was on #1 for my target keyword and daily get 1000 clicks before this error. After trying everything I have to duplicate page and make 301 redirect but issue not gone. here's what error I am getting: But When I Test Live URL it show everything fine: here's my robots.txt

User-agent:*
Disallow:/search
Allow:/

Sitemap:https://www.chanakyadrishti.com/sitemap.xml
Sitemap:https://www.chanakyadrishti.com/feeds/pages/default?orderby=UPDATED

asked May 13 '20 at 05:01

Ajay Malik

Check your url using this tool: https://www.google.com/webmasters/tools/robots-testing-tool – Maximillian Laumeister May 13 '20 at 06:22
1

@MaximillianLaumeister I did and it say not blocked by robots.txt – Ajay Malik May 13 '20 at 13:39
What content-type is on that URL? Is it an HTML page or something else like an image? GSC doesn't report accurately for images and other content that Google doesn't index is web-search. See Google's URL inspection says my image URL is blocked by robots.txt — I don't even have one! – Stephen Ostermiller May 14 '20 at 15:40
@StephenOstermiller it's a text/html page. I also duplicate it and 301 redirect it to new page but still getting same error – Ajay Malik May 15 '20 at 03:43

Google say URL is blocked by robots.txt but it isn't

0 Answers0