LWN.net Weekly News recipe

[wcooley]

Originally Posted by nbigaouette

Thanks a lot for the recipe! It will be a lot easier to read offline. I really appreciate.

The only thing missing would be the inclusion of the comments section. The comments on lwn are of high quality and always interesting to read. Is that possible? It might be harder to include though...

Thanks again.

I agree that the comments on LWN are usually good reading themselves, but I chose to exclude them because it's not easy to represent the nesting of replies, which is context important for making sense of the replies. Also, I intend implement parsing the "One big page", rather than fetching all of the sections separately, and that page does not have the comments in-line. (I could still fetch the comments, of course, but it's one more thing to implement.)

[wcooley]

I have updated the LWN recipe again:

https://raw.github.com/wcooley/calib..._weekly.recipe

There was some breakage due to a regex that was too loose and changes in the content of the site; I ended up rewriting the parse_index stuff quite a bit in the process.