04-17-2010, 06:07 AM | #1 |
Zealot
Posts: 129
Karma: 33000
Join Date: Feb 2010
Device: Currently:Voyage, Oasis 3, Kindle mobile apps, andKindle Fire
|
New York Review of Books recipe broken
It seems that NYBooks has made some subtle changes in the format of their website which cause the calibre recipe to no longer work. For example, the recipe looks for a "nybooks.com/register" page, which no longer exists. The new "login" page is at "nybooks.com/account/signin". But even after changing that line in the recipe, it encounters difficulty with the "Form name": it looks for "login" but can't find it. The new website seems to use Sign In rather than Login. I tried changing that, but I haven't found the right words yet. I changed the Form Name to (nr = 1) as found in the NYTimes recipe for that same line, which removes the "login" error, but the fetching fails then by not finding the Username or EMail part of the form.
I am a subscriber to the print edition and therefore always download the full edition, and everything worked fine about a week ago. It is only in the last week or so that the format of the website has changed. I also tried using the "no subscription" version of the recipe, but that no longer works either. I'm really a novice at customizing recipes. Maybe some other NY Review readers have encountered the same problem and are more proficient at the recipe business. Maybe the original creator of the recipe would be willing to experiment with a revision. I'd be glad to provide a Username and Password if that would help. (Actually my email and a temporary password are in the error details below) I am also pasting below the details of the error messages. The first for the subscription version which stalls at the login function. The second (and perhaps more troubling) is for the "no subscription" which does not deal with any logins but stalls with and error called "index out of range". This leads me to believe that even after fixing the login issue, the recipe still will not work on the new website format. SUBSCRIPTION error: ERROR: Conversion Error: <b>Failed</b>: Fetch news from New York Review of Books Fetch news from New York Review of Books Resolved conversion options {'asciiize': False, 'author_sort': None, 'authors': None, 'base_font_size': 0, 'book_producer': None, 'chapter': None, 'chapter_mark': 'pagebreak', 'comments': None, 'cover': None, 'debug_pipeline': None, 'disable_font_rescaling': False, 'dont_compress': False, 'dont_download_recipe': False, 'dont_justify': False, 'extra_css': None, 'font_size_mapping': None, 'footer_regex': '(?i)(?<=<hr>)((\\s*<a name=\\d+></a>((<img.+?>)*<br>\\s*)?\\d+<br>\\s*.*?\\s*)|(\\s* <a name=\\d+></a>((<img.+?>)*<br>\\s*)?.*?<br>\\s*\\d+))(?=<br>)' , 'header_regex': '(?i)(?<=<hr>)((\\s*<a name=\\d+></a>((<img.+?>)*<br>\\s*)?\\d+<br>\\s*.*?\\s*)|(\\s* <a name=\\d+></a>((<img.+?>)*<br>\\s*)?.*?<br>\\s*\\d+))(?=<br>)' , 'input_encoding': None, 'input_profile': <calibre.customize.profiles.InputProfile object at 0x041B4410>, 'insert_blank_line': False, 'insert_metadata': False, 'isbn': None, 'language': None, 'level1_toc': None, 'level2_toc': None, 'level3_toc': None, 'line_height': 0, 'linearize_tables': False, 'lrf': False, 'margin_bottom': 5.0, 'margin_left': 5.0, 'margin_right': 5.0, 'margin_top': 5.0, 'max_toc_links': 50, 'no_chapters_in_toc': False, 'no_inline_navbars': True, 'no_inline_toc': False, 'output_profile': <calibre.customize.profiles.KindleOutput object at 0x041B4730>, 'page_breaks_before': None, 'password': 'nyrb72448', 'personal_doc': '[PDOC]', 'prefer_author_sort': False, 'prefer_metadata_cover': False, 'preprocess_html': False, 'pretty_print': False, 'pubdate': None, 'publisher': None, 'rating': None, 'read_metadata_from_opf': None, 'remove_first_image': False, 'remove_footer': False, 'remove_header': False, 'remove_paragraph_spacing': False, 'remove_paragraph_spacing_indent_size': 1.5, 'rescale_images': False, 'series': None, 'series_index': None, 'tags': None, 'test': False, 'timestamp': None, 'title': None, 'title_sort': None, 'toc_filter': None, 'toc_threshold': 6, 'toc_title': None, 'use_auto_toc': False, 'username': 'mekelly@ftml.net', 'verbose': 2} InputFormatPlugin: Recipe Input running Python function terminated unexpectedly no form matching name 'login' (Error Code: 1) Traceback (most recent call last): File "site.py", line 103, in main File "site.py", line 85, in run_entry_point File "site-packages\calibre\utils\ipc\worker.py", line 99, in main File "site-packages\calibre\gui2\convert\gui_conversion.py", line 24, in gui_convert File "site-packages\calibre\ebooks\conversion\plumber.py", line 787, in run File "site-packages\calibre\customize\conversion.py", line 211, in __call__ File "site-packages\calibre\web\feeds\input.py", line 100, in convert File "site-packages\calibre\web\feeds\news.py", line 567, in __init__ File "c:\users\michael\appdata\local\temp\calibre_0.6.4 7_qll5qg_recipes\recipe0.py", line 32, in get_browser br.select_form(name='login') File "site-packages\mechanize-0.1.11-py2.6.egg\mechanize\_mechanize.py", line 530, in select_form mechanize._mechanize.FormNotFoundError: no form matching name 'login' "NO SUBSCRIPTION" error: InputFormatPlugin: Recipe Input running Python function terminated unexpectedly list index out of range (Error Code: 1) Traceback (most recent call last): File "site.py", line 103, in main File "site.py", line 85, in run_entry_point File "site-packages\calibre\utils\ipc\worker.py", line 99, in main File "site-packages\calibre\gui2\convert\gui_conversion.py", line 24, in gui_convert File "site-packages\calibre\ebooks\conversion\plumber.py", line 787, in run File "site-packages\calibre\customize\conversion.py", line 211, in __call__ File "site-packages\calibre\web\feeds\input.py", line 104, in convert File "site-packages\calibre\web\feeds\news.py", line 653, in download File "site-packages\calibre\web\feeds\news.py", line 770, in build_index File "c:\users\michael\appdata\local\temp\calibre_0.6.4 7_g9qezw_recipes\recipe0.py", line 57, in parse_index date = root.xpath('//h4[@class = "date"]')[0] IndexError: list index out of range |
04-17-2010, 06:38 AM | #2 |
Member
Posts: 18
Karma: 482
Join Date: Apr 2010
Device: Sony PRS-600
|
If you allow me. The spanish newspaper "El País" seems broken to.
|
Advert | |
|
04-17-2010, 06:43 AM | #3 |
creator of calibre
Posts: 44,346
Karma: 23661992
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
reports of broken recipes belong in tickets. Forum posts get lost
|
04-17-2010, 07:00 AM | #4 |
Member
Posts: 18
Karma: 482
Join Date: Apr 2010
Device: Sony PRS-600
|
I, for my part, wasn't aware of that. Will do.
But, now that you're here. Thanks for this amazing piece of software. And thanks for making life easier for linux-users who read ebooks (by making it crossplatform). |
04-17-2010, 07:58 AM | #5 |
Zealot
Posts: 129
Karma: 33000
Join Date: Feb 2010
Device: Currently:Voyage, Oasis 3, Kindle mobile apps, andKindle Fire
|
I submitted this NYRB broken recipe as a bug ticket also (#5317) because I wasn't sure where to post it. Hopefully it will get some results in one place or another. Thanks.
|
Advert | |
|
Tags |
calibre recipes, custom recipes, new york review of books |
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
New York Times recipe broken? | gianfri | Calibre | 1 | 03-20-2010 09:52 AM |
Engadget Recipe Broken | pars_andy | Calibre | 1 | 12-01-2009 10:39 PM |
New York Times recipe | madrone26 | Calibre | 4 | 04-02-2009 01:13 PM |
Economist Recipe - broken? | dieterpops | Calibre | 1 | 02-20-2009 09:14 PM |
New York Review of Books Article on Google Books | BenG | News | 2 | 01-26-2009 05:50 PM |