View Single Post
Old 04-17-2010, 07:07 AM   #1
mkgtu
Member
mkgtu began at the beginning.
 
Posts: 24
Karma: 10
Join Date: Feb 2010
Device: Kindle 2&3, Kindle Fire
New York Review of Books recipe broken

It seems that NYBooks has made some subtle changes in the format of their website which cause the calibre recipe to no longer work. For example, the recipe looks for a "nybooks.com/register" page, which no longer exists. The new "login" page is at "nybooks.com/account/signin". But even after changing that line in the recipe, it encounters difficulty with the "Form name": it looks for "login" but can't find it. The new website seems to use Sign In rather than Login. I tried changing that, but I haven't found the right words yet. I changed the Form Name to (nr = 1) as found in the NYTimes recipe for that same line, which removes the "login" error, but the fetching fails then by not finding the Username or EMail part of the form.

I am a subscriber to the print edition and therefore always download the full edition, and everything worked fine about a week ago. It is only in the last week or so that the format of the website has changed. I also tried using the "no subscription" version of the recipe, but that no longer works either.

I'm really a novice at customizing recipes. Maybe some other NY Review readers have encountered the same problem and are more proficient at the recipe business. Maybe the original creator of the recipe would be willing to experiment with a revision. I'd be glad to provide a Username and Password if that would help. (Actually my email and a temporary password are in the error details below)

I am also pasting below the details of the error messages. The first for the subscription version which stalls at the login function. The second (and perhaps more troubling) is for the "no subscription" which does not deal with any logins but stalls with and error called "index out of range". This leads me to believe that even after fixing the login issue, the recipe still will not work on the new website format.

SUBSCRIPTION error:
ERROR: Conversion Error: <b>Failed</b>: Fetch news from New York Review of Books

Fetch news from New York Review of Books
Resolved conversion options
{'asciiize': False,
'author_sort': None,
'authors': None,
'base_font_size': 0,
'book_producer': None,
'chapter': None,
'chapter_mark': 'pagebreak',
'comments': None,
'cover': None,
'debug_pipeline': None,
'disable_font_rescaling': False,
'dont_compress': False,
'dont_download_recipe': False,
'dont_justify': False,
'extra_css': None,
'font_size_mapping': None,
'footer_regex': '(?i)(?<=<hr>)((\\s*<a name=\\d+></a>((<img.+?>)*<br>\\s*)?\\d+<br>\\s*.*?\\s*)|(\\s* <a name=\\d+></a>((<img.+?>)*<br>\\s*)?.*?<br>\\s*\\d+))(?=<br>)' ,
'header_regex': '(?i)(?<=<hr>)((\\s*<a name=\\d+></a>((<img.+?>)*<br>\\s*)?\\d+<br>\\s*.*?\\s*)|(\\s* <a name=\\d+></a>((<img.+?>)*<br>\\s*)?.*?<br>\\s*\\d+))(?=<br>)' ,
'input_encoding': None,
'input_profile': <calibre.customize.profiles.InputProfile object at 0x041B4410>,
'insert_blank_line': False,
'insert_metadata': False,
'isbn': None,
'language': None,
'level1_toc': None,
'level2_toc': None,
'level3_toc': None,
'line_height': 0,
'linearize_tables': False,
'lrf': False,
'margin_bottom': 5.0,
'margin_left': 5.0,
'margin_right': 5.0,
'margin_top': 5.0,
'max_toc_links': 50,
'no_chapters_in_toc': False,
'no_inline_navbars': True,
'no_inline_toc': False,
'output_profile': <calibre.customize.profiles.KindleOutput object at 0x041B4730>,
'page_breaks_before': None,
'password': 'nyrb72448',
'personal_doc': '[PDOC]',
'prefer_author_sort': False,
'prefer_metadata_cover': False,
'preprocess_html': False,
'pretty_print': False,
'pubdate': None,
'publisher': None,
'rating': None,
'read_metadata_from_opf': None,
'remove_first_image': False,
'remove_footer': False,
'remove_header': False,
'remove_paragraph_spacing': False,
'remove_paragraph_spacing_indent_size': 1.5,
'rescale_images': False,
'series': None,
'series_index': None,
'tags': None,
'test': False,
'timestamp': None,
'title': None,
'title_sort': None,
'toc_filter': None,
'toc_threshold': 6,
'toc_title': None,
'use_auto_toc': False,
'username': 'mekelly@ftml.net',
'verbose': 2}
InputFormatPlugin: Recipe Input running
Python function terminated unexpectedly
no form matching name 'login' (Error Code: 1)
Traceback (most recent call last):
File "site.py", line 103, in main
File "site.py", line 85, in run_entry_point
File "site-packages\calibre\utils\ipc\worker.py", line 99, in main
File "site-packages\calibre\gui2\convert\gui_conversion.py", line 24, in gui_convert
File "site-packages\calibre\ebooks\conversion\plumber.py", line 787, in run
File "site-packages\calibre\customize\conversion.py", line 211, in __call__
File "site-packages\calibre\web\feeds\input.py", line 100, in convert
File "site-packages\calibre\web\feeds\news.py", line 567, in __init__
File "c:\users\michael\appdata\local\temp\calibre_0.6.4 7_qll5qg_recipes\recipe0.py", line 32, in get_browser
br.select_form(name='login')
File "site-packages\mechanize-0.1.11-py2.6.egg\mechanize\_mechanize.py", line 530, in select_form
mechanize._mechanize.FormNotFoundError: no form matching name 'login'


"NO SUBSCRIPTION" error:
InputFormatPlugin: Recipe Input running
Python function terminated unexpectedly
list index out of range (Error Code: 1)
Traceback (most recent call last):
File "site.py", line 103, in main
File "site.py", line 85, in run_entry_point
File "site-packages\calibre\utils\ipc\worker.py", line 99, in main
File "site-packages\calibre\gui2\convert\gui_conversion.py", line 24, in gui_convert
File "site-packages\calibre\ebooks\conversion\plumber.py", line 787, in run
File "site-packages\calibre\customize\conversion.py", line 211, in __call__
File "site-packages\calibre\web\feeds\input.py", line 104, in convert
File "site-packages\calibre\web\feeds\news.py", line 653, in download
File "site-packages\calibre\web\feeds\news.py", line 770, in build_index
File "c:\users\michael\appdata\local\temp\calibre_0.6.4 7_g9qezw_recipes\recipe0.py", line 57, in parse_index
date = root.xpath('//h4[@class = "date"]')[0]
IndexError: list index out of range
mkgtu is offline   Reply With Quote