Creepy Crawlies
55 points by zdw 22 hours ago | 10 comments
initramfs 29 minutes ago
I've been noticing page views in the past several months with a much wider span of origin on my Blogger stats. Before I would get a few from several countries, but now I am getting views from tiny countries and obscure or outdated browsers and operating systems, which leads me to think scrapers could be using VPN services in various countries along with header anonymizers that mask the device that they are using.
replyExtensions like ModHeader, BrowserMask do this: https://github.com/apify/crawlee-python
https://github.com/mthcht/Masquerade-Spoofer
Great for AI scrapers, bad for hosters and everyone else.
Artoooooor 34 minutes ago
How expensive would AI access be if every user paid their fair share instead of shoving it on the people doing the actual work?
replyjruohonen 22 hours ago
Off-topic, but anyone with which he did the plots?
reply
Interestingly enough, cgit bills itself as "a hyperfast web frontend for git repositories" [0]. Alas, nothing is fast enough for the bots, it would appear.
[0] https://git.zx2c4.com/cgit/about/