No link Preview: Response 418 "I am a teapot" - MisinformationLinkDetector?
3

Problem:

All https://progressive.com/lifelanes/ links are not generating preview images on Facebook. It's a Wordpress site running on Linux Servers.

Troubleshooting Steps:

  • We have confirmed Open Graph tags are present on the pages, particularly our current Quiz campaign. https://www.progressive.com/lifelanes/household/character-quiz/
  • We have also used the Sharing Debugger / Linter which shows Life Lanes URLs are returning a 418 response code. (I am a teapot!)
  • Interestingly https://progressive.com/answers/ and https://progressive.com/auto/ (separate properties/servers) are also returning 418 but they DO generate preview images correctly
  • Link previews are working fine on other platforms like X, LinkedIn, and even in Teams chat.
  • I drafted a post on Facebook and compared the graphql/ responses from the network panel to see the difference between successful previews and failed ones. The only significant difference in the request/response headers seems to indicate: cometMisinformationLinkDetectorPluginInternalStateReducerQuery (see attachment) which makes me think it may be on the Facebook side.
  • I have also tried changing my User Agent string to facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php) per https://developers.facebook.com/docs/sharing/webmasters/ but the page renders fine.
  • We know this feature used to work approximately a year ago, but not sure when it stopped.

Thanks in advance for any help or insights!

Shawn
Asked about a year ago
Selected Answer
1

we are having the same problem with https://www.ilpuntoamezzogiorno.it/

February 7 at 2:27 AM
Massimiliano
Anthony

How did you resolve this? Your site appears to be running fine again

August 16 at 2:19 PM
Massimiliano

There was a problem on the sul certificate we changed the configuration on the server

August 16 at 2:33 PM
2

I am having same error.

If I disable a few plugins, the error disappears, ADvanced Ads, and Allinone SEO.

Am running multisite and on Cloudways using Cloudflare with 8GB ram for environment.

This is new, it always worked in past. The only new thing is I moved to Multisite

January 1 at 7:52 AM
John
Shawn

Sounds like maybe it’s related to performance? You think if the response is too slow it sends 418?

January 1 at 4:44 PM
2

I am getting the same, response code 418 with no image preview from Apache2 server on Ubuntu. This use to work fine, I thought it stopped after upgrading my server to Ubuntu 20.06.4 but I now think that's a red herring. If I upload the same content to my other server (also running Apache2 on Linux) it scrapes fine, returning HTTP 200, but on my Ubuntu server it returns 418.

Using a custom user agent: facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php) the server returns HTTP/1.1 200 OK so the 418 code must be generated by the Facebook scraper itself?

This really needs to be fixed as Facebook sharing is important for my sites.

January 22 at 2:18 AM
Rory
4

I had this issue for weeks. Was able to resolve it today finally.

Looks like SSL certificate can cause this issue if not installed properly. Missing certificate chain can cause trust issues and crawlers ends up getting 418 code.

If you check here [https://www.sslshopper.com/ssl-checker.html#hostname=https://www.progressive.com/] , it'll tell you certificate is not trusted in all browsers. While this doesn't human visitors, FB's crawlers seem to dislike it.

Please try re installing SSL certificate including CA bundle and see if that helps.

February 18 at 2:32 AM
Prajwol
Toan

Same with my case. Thank a lot.

April 12 at 1:43 AM