Partial Outageshare-external
Facebook's link crawler (facebookexternalhit/1.1) is making an extreme amount of requests to our site
1

Does anyone have any idea who to contact about the Facebook link preview crawler (user agent http://www.facebook.com/externalhit_uatext.php)? It's constantly making requests to our site in what seems to be a loop of sorts. Things have gotten bad enough that I've had to rate limit it! At the rate things are going, I'm sure it's blocking legitimate requests for previews of links on our site.

Eric
Asked about a month ago
Eric

I've started rate limiting the crawler. I'll report back and see what kind of effect that has on us. I'm also going to look into whether or not temporarily disabling ads has any effect.

March 25 at 7:42 AM
Eric

Disabling ads had no effect!

April 4 at 9:34 AM
Darin

We're having the same issue. We started using Facebook Ads a few months ago, so I'm suspicious about the connection.

6 hours ago