2 days ago
p3k dots

Blocking LLM crawlers, without JavaScript

Here’s an easy way to block crawlers, which demands no JS capabilities or proof of work from visitors, and is computationally cheap for the server.

Relevant: You don’t need Anubis (via lobste.rs).