Post-mortem: codefloe.com was slow or down on Nov 18, ~20:05–20:25 UTC.
A crawler on ~156k residential proxy IPs requested ~940k issue-list filter combinations, a few per IP. This allowed it to bypass our per-IP limits.
What we changed after this event:
- If you are not signed in, some pages now show "Checking your browser" for about 2 seconds, then load by themselves. No JavaScript, no puzzle, and at most once a day.
- This always applies to filtered issue, PR and milestone lists. During heavy traffic it briefly covers other pages too.
- Signed-in users never see it.
- Visitors who are not signed in only get a capped share of our servers, so a flood can no longer slow down everyone else.
- Our regional edges now answer crawlers themselves instead of passing them on.