The Daily Mail Newspaper

[Keios]

Hello all,

I have recently bought a kindle and really appreciate being able to read the daily mail on it however i miss having the comments being available to read since they are often very entertaining.

Can anyone add a piece of code to the recipe in order to potentially capture the comments from each article?

best wishes

Alex

[Starson17]

Originally Posted by Keios

Can anyone add a piece of code to the recipe in order to potentially capture the comments from each article?

Try changing this:

    keep_only_tags = [dict(name='div', attrs={'id':'js-article-text'})]

to this:

    keep_only_tags = [dict(name='div', attrs={'id':['js-article-text','js-comments']})]

[Keios]

Hello Starson17,

That code works great and can now download the latest six comments for each article, would it be possible to tweak it slightly more to be able to view all the comments?

Thanks again!

best wishes,

Alex