[oneillpt]

Originally Posted by josepinto

Hi,

Público.pt recibe does not work.
I only get the titles.

Can someone take a look?

Thanks in advance.

José Pinto

Replace the keep_only_tags and remove_tags lines by:

keep_only_tags = [dict(attrs={'class':['hentry article single']})]
remove_tags    = [dict(attrs={'class':['entry-options entry-options-above group','entry-options entry-options-below group', 'module tag-list']})]

This produces a big file. If you want to drop the photos for articles with photos, use the following keep_only_tags line instead (with the same remove_tags line):

keep_only_tags = [dict(attrs={'class':['entry-header single-header','entry-body']})]