It's nice¹ that someone at Facebook really wants our load-bearing ML image training data². It's not so nice that they didn't bother setting up a local cache for it and instead deluged our web server with thousands or even tens of thousands of connections. Now they can talk to the hand for a while and I hope they enjoy it.
(Of course FB's crawler was also scraping the heck out of the rest of the web server too.)
¹ "nice" in some sense.
² https://mastodon.social/@cks/115851872715237648
Wow, people do some extremely slow downloads from work's main web server. We roll logs at midnight and Apache wrote the last log record to the old file at 03:58 (for a request that had started at 23:27).
(For our sins we've become a load-bearing source of ML image training data, for the "CIFAR" image dataset. We average 40 Mbytes/sec outgoing web server bandwidth most days.)