|
Jon, do you know what consent is? Their robots.txt is telling us that they don’t want bots. And because everyone keeps ignoring that, they implemented cloudflare bot protection to really emphasise that they don’t want bots. Circumventing their bot protection feels wrong and I’ll not go that route.
|