minus-squarekrakenfury@lemmy.sdf.orgtoSelfhosted@lemmy.world•How to combat large amounts of Ai scraperslinkfedilinkEnglisharrow-up2arrow-down1·15 hours agoIs ignoring robots.txt considered “honest”? linkfedilink
Is ignoring robots.txt considered “honest”?