Wall Street Journal, WSJ, Free version, recipe improvement for full text of all ar

[kovidgoyal]

I'm not in favor of this, you are basically stealing content that the content producers want you to pay for. It's one thing if calibre gets content that is made available for free, for free, but in the cases where the content is protected by a paywall, I am going to respect that paywall. You can well argue that having paywalls is stupid, but that's not the point.

That said, nothing stopping you from creating a custom recipe that forges the referer. But such a recipe will not be made a calibre builtin.

[Starson17]

Originally Posted by kovidgoyal

I'm not in favor of this,

I agree with this. It's why I didn't work on it, even though I'm interested from a technical perspective how it works. Calibre shouldn't be involved in sending incorrect headers to bypass paywalls.

Companies that open the paywall to Google are trying to straddle the line of more eyeballs on the free side and more money on the paywall side, but that's their choice. If you want to write a recipe or use it for yourself, with header control, that's also something I'm comfortable with, but not as a built-in.