UngodlyAudrey🏳️⚧️@beehaw.org to Technology@beehaw.org · 2 years agoSites scramble to block ChatGPT web crawler after instructions emergearstechnica.comexternal-linkmessage-square35fedilinkarrow-up1179arrow-down10cross-posted to: [email protected]
arrow-up1179arrow-down1external-linkSites scramble to block ChatGPT web crawler after instructions emergearstechnica.comUngodlyAudrey🏳️⚧️@beehaw.org to Technology@beehaw.org · 2 years agomessage-square35fedilinkcross-posted to: [email protected]
minus-squarem-p{3}AlinkfedilinkEnglisharrow-up26·2 years agoLemmy.ca added a block at the nginx level for it https://lemmy.ca/comment/1999439 # curl -H 'User-agent: GPTBot' https://lemmy.ca/ -i HTTP/2 403
minus-squareThe Bard in Green@lemmy.starlightkel.xyzlinkfedilinkEnglisharrow-up3·2 years agoHilariously, unless ALL lemmy instances do this, anyone that federates with you will have to block it too or any communities they sync with you will be available on their instances…
Lemmy.ca added a block at the nginx level for it
https://lemmy.ca/comment/1999439
# curl -H 'User-agent: GPTBot' https://lemmy.ca/ -i HTTP/2 403Hilariously, unless ALL lemmy instances do this, anyone that federates with you will have to block it too or any communities they sync with you will be available on their instances…
I know but at this point you do what you can.
deleted by creator