There's a built-in Calibre recipe for The Register. I've been trying to adapt it so I can get the comments that readers make (as well as the articles) but without much luck.
The biggest stumbling block appears to be that there's no easy way of getting a list of stories with comments, other than assuming that every story has got some comments.
So for a story such as
http://forums.theregister.co.uk/foru...7/speed_limit/
the comments are at
http://forums.theregister.co.uk/foru...7/speed_limit/
where the /1/ in the URL is the page number of the comments. This can run to 2 or 3 pages... however, there's also a mobile version of the site
http://m.forums.theregister.co.uk/fo...7/speed_limit/
...but again, this breaks comments into pages 1, 2 .. n
Needless to say I'm stuck. Anyone got any ideas please?
In an ideal world we'd have the original story followed by its comments within one recipe.