• This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn more.

BUG Robots.txt error

biggie100

New member
Messages
3
Likes
0
Points
1
#1
Hi I clicked create the right robots.txt by accident, so I turned it off, but now search console can't fetch the robots.txt when I use the testing tool, the robots.txt can be viewed on the url, and google bot is allowed to view it, but for some reason it can't fetch the robots, web.dev also gives this error

Error

1
<html><meta http-equiv="refresh" content="0;/.well-known/captcha/"></meta></head></html>
Syntax not understood
 

Temyk

Developer & Support
Messages
1,129
Likes
42
Points
48
#2
Hello.

You can send me the contents of the file robots.txt?
 

biggie100

New member
Messages
3
Likes
0
Points
1
#3
I don't think it's the contents of the robots file, I think it is being redirected for some reason, as search console and web.dev aren't picking it up, but the url is visible and isn't blocked
 

Temyk

Developer & Support
Messages
1,129
Likes
42
Points
48
#5
Most likely, for requests from third-party services, the server asks you to enter a captcha. Perhaps this is DDoS protection

In any case, you can disable the plugin and check if it solved the problem.