foreign affairs
the comments section and issue section articles are the same.. I think adding ignore duplicates is much easier..
Quote:
ignore_duplicate_articles = {'title', 'url'}
remove_empty_feeds = True
|
foreign policy cover - it loads older edition cover image.. change
Quote:
img = soup.find('img', attrs={'data-lazy-src': lambda x: x and '-cover' in x})
self.cover_url = img['data-lazy-src']
|