“For a start, I never really appreciated the fact that Go secretly calls home to Google to fetch modules through a proxy (you can set GOPROXY=direct to fix this).”
Five percent of all requests to git.sr.ht come from Google’s Go module proxy, and every one is a full git clone. The crawler runs on many nodes that each fetch the same repos independently. Google changed its user agent and stopped there. A trillion-dollar company is pushing its infrastructure costs onto a small host.