Luu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 3 months agoTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comexternal-linkmessage-square131fedilinkarrow-up1572arrow-down17cross-posted to: [email protected]
arrow-up1565arrow-down1external-linkTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comLuu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 3 months agomessage-square131fedilinkcross-posted to: [email protected]
minus-squareobject [Object]@lemmy.blahaj.zonelinkfedilinkEnglisharrow-up1·3 months agoOut of the 60gb/month of traffic my website gets, 20gb is because of bytedance’s webscraper. I haven’t gotten around to blocking them as bandwidth isn’t an issue but damn do they send a lot of requests.
Out of the 60gb/month of traffic my website gets, 20gb is because of bytedance’s webscraper. I haven’t gotten around to blocking them as bandwidth isn’t an issue but damn do they send a lot of requests.