Facebook Debugger returning 403
24

Facebook debugger has recently been returning 403 errors for our pages. It was previously working and we never did any adjustments. The problem became prevalent February 28, 2024.

Brent
Asked about 3 years ago
Lion

same here

March 4 at 11:12 AM
Binod

Hello, I had resolved the issues and write the blog about resolution. I hope this will helps https://sobiztrend.com/facebook-url-returned-a-bad-http-response-code/

March 4 at 11:56 PM
Neil

come on facebook WTF

March 10 at 11:26 PM
Xavier

Same problem.Are you on WP with Wordfence Plugin ?

March 26 at 8:12 AM
妹尾 みどり

same here

September 19 at 2:12 AM
Carlos

Hi everyone, I’m trying to report a persistent issue with the Facebook Sharing Debugger tool.

When scraping my website, the Debugger returns a 403 Forbidden error.

However, I've confirmed the following:

✅ The site is public and fully accessible worldwide ✅ robots.txt allows all user-agents:

User-agent: * Disallow:

✅ My hosting provider (Crazy Domains) confirmed that:

facebookexternalhit is explicitly allowed

There are no ModSecurity blocks

Facebook bot connections appear as successful in server logs

✅ Other platforms (like LinkedIn) display link previews correctly ✅ I tested using the Health Check plugin to disable all plugins and still get the same error ✅ I’ve tried all the recommended steps, but the 403 persists only on Facebook

If anyone from the Meta team can look into this, or if other devs have found a solution/workaround, I’d greatly appreciate it.

Thanks in advance!

April 7 at 3:22 PM
Selected Answer
1

We are having the same problem, specifically when setting the "User data deletion" URL for a Login app. What's really annoying is that this URL:

https://www.anitacameron.com/-/Home/privacy/

is rejected by Facebook, while this URL:

https://www.lasvegasbestrealestate.com/-/Home/privacy/

is accepted. Both URLs go into the same backend code, and have identical robots.txt files. WTF, Facebook, indeed.

April 18 at 11:21 AM
Joe
Massimo

The FB engine is obviously not able to handle robots.txt files in the best possible way, try to put allow:* in the FB section and invalidate the robots.txt with the batch inalidator (https://developers.facebook.com/tools/debug/sharing/batch/).

April 18 at 6:10 PM
1

Hi, Did you manage to find a solution to the above mentioned error? This issue also affected a website I manage. The server firewall blocks requests as it retrieves data from links every second.

June 17 at 5:10 AM
József
Binod

Hello Jozsef,

Update robots.txt of your website. https://sobiztrend.com/facebook-url-returned-a-bad-http-response-code/

June 17 at 6:09 AM
1

I'm reading all thread but still have the same problem here https://www.fondoposte.it/ Can anyone help me please?

October 4 at 12:23 AM
Federico
1

For me, I made sure that Cloudflare wasn't generating its own robots.txt to disallow AI bots. All In One SEO for WordPress has that feature now, so I didn't need Cloudflare to run that.

I also add my Facebook page meta ID to the head of the site.

And, I followed the instruction to allow the User-agent: facebookexternalhit

The Facebook debugger still reported an error. However, I stepped away from the computer for a few hours, and upon returning, the issue was resolved.

August 13 at 8:59 PM
Tony
1

I have a rather strange encounter with the 403 response status for 2 of the websites I worked on when I scrap any links or pages from those 2 websites, but my colleagues who then went and scrap the same 2 websites, they get 200 response status. The websites are public facing, the websites' robots.txt did not block the User-agent: facebookexternalhit and in fact even allow it and place it at the beginning of the robots.txt file!! Cloudfront and Cloudflare settings on those 2 websites did not block any bots/crawlers. So now I suspect getting 403 response status from just using the Facebook Debugger tool to scrap website after YOU logged in with your own Facebook account might be different from other Facebook users who also scrap the same URLs. I seriously need help on this kind of issue... like what's with the differences of different legit Facebook users logged into use the Facebook Debugger Tool can get different http response status!!!

October 23 at 6:32 PM
Kong Ghee
1

Still unresolved.

Fix your shit facebook.

April 23 at 8:18 PM
Gareth
1

If CloudFlare proxy is enabled for your domain, that's the issue. I disabled it, and everything returned to normal.

May 1 at 2:38 AM
Kiệt
2

Read this thread https://developers.facebook.com/support/bugs/1085796049211789/

March 5 at 8:34 AM
Massimo
2

Same problem.Are you on WP with Wordfence Plugin ?

March 26 at 8:12 AM
Xavier
Sonali

same problem

March 26 at 9:03 AM
Xavier

You use Wordfence plug-in on Wordpress ?

March 27 at 10:34 AM
2

I can confirm similar behavior on multiple independent websites hosted on different configurations.

I tested:

disabling ModSecurity robots.txt configuration different WordPress/theme versions direct server responses outside Facebook debugger

Everything returns HTTP 200 correctly for normal requests and other crawlers, while Facebook debugger still randomly reports 403 or 429 responses.

This looks more like an issue with facebookexternalhit crawling/rate limiting than a website configuration problem.

May 7 at 10:22 AM
Paweł
Pratik

Hey Pawel, did you find any fix? I’ve been facing a similar issue for the past few days as well.

May 7 at 10:39 PM
3

Facebook has apparently added an explanation now: This response code could be due to a robots.txt block. Please allowlist facebookexternalhit on your sites robots.txt config to utilize Facebook scraping

I have no blocks on facebookexternalhit on my site robots. but already allowed it, still same issue.

March 4 at 8:58 PM
Brent
5

+1 Same problem

March 1 at 2:32 AM
Loic
5

+1 Same problem

March 1 at 2:35 AM
Chong
5

+1 Same issue here too, for a couple of days now

March 1 at 7:12 AM
Gavin
5

Same issue same timeframe!

March 2 at 8:50 AM
TC
5

still not resolve.

March 3 at 2:40 PM
Binod
Massimo

Report here https://developers.facebook.com/support/bugs/1085796049211789/

March 3 at 5:52 PM
6

Same issue here https://developers.facebook.com/community/threads/945101610321800/

March 1 at 7:02 PM
Massimo
Brent

No chance we're going to get a quick resolution from this :(

March 1 at 11:47 PM
Massimo

No hope of being able to report to Facebook

March 2 at 3:41 AM
7

Same issue. We thought it might be Cloudflare WAF rules, but we created a Skip exception rule and so that was not it. We can replicate the user agent and we get a 200 with cURL request. All other open graph tools are able to fetch without issue.

March 1 at 9:00 AM
Ed
Brent

Exactly the same problem. I thought I was going crazy already. It started with a supposed issue with the og:image on just one page. Was that the same issue you had?

March 1 at 9:18 AM
Luis

Did you solve de issue? We have similar problem.

March 1 at 2:46 PM
Brent

We still haven’t found a solution…

March 1 at 4:24 PM
14

Plus 1. We are also experiencing this same issue.

February 29 at 6:36 PM
Richard