Tried adding the "delay" line from the recipe on github in the link above.
One time the paper download with articles in the "Front Page" section but all other sections were empty (headings only)
Tried several more times and all sections come up empty.
Tried changing the delay to 2 seconds, then 3 secs, then 5 secs. Still no articles.
Maybe I'm doing something wrong.
This is the relevant section of my "customized recipe" with the delay at line 94:
class NewYorkTimes(BasicNewsRecipe):
if is_web_edition:
title = 'The New York Times (Web)'
description = 'New York Times (Web). You can edit the recipe to remove sections you are not interested in.'
else:
title = 'NY Times ***'
description = 'Today\'s New York Times'
encoding = 'utf-8'
__author__ = 'Kovid Goyal'
language = 'en'
ignore_duplicate_articles = {'title', 'url'}
no_stylesheets = True
compress_news_images = True
compress_news_images_auto_size = 5
conversion_options = {'flow_size': 0}
delay = 0 if use_wayback_machine else 1
extra_css = '''
body {text-align: left}
'''
@property
def nyt_parser(self):
ans = getattr(self, '_nyt_parser', None)
|