Luu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 2 days agoTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comexternal-linkmessage-square117fedilinkarrow-up1559arrow-down16cross-posted to: [email protected]
arrow-up1553arrow-down1external-linkTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comLuu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 2 days agomessage-square117fedilinkcross-posted to: [email protected]
minus-squareSparky@lemmy.blahaj.zonelinkfedilinkEnglisharrow-up1·8 hours agoOut of the 60gb/month of traffic my website gets, 20gb is because of bytedance’s webscraper. I haven’t gotten around to blocking them as bandwidth isn’t an issue but damn do they send a lot of requests.
Out of the 60gb/month of traffic my website gets, 20gb is because of bytedance’s webscraper. I haven’t gotten around to blocking them as bandwidth isn’t an issue but damn do they send a lot of requests.