Pajamas Media and Big Hollywood, updates please

[Mauser]

I'm running version 0.9.11

Pajamas Media only gets a single link in the TOC, which leads to a page with just "Pajamas Media" at the top. But I've seen the RSS page in some copies of the script, and that looks okay.

Spoiler:

Fetch news from Pajamas Media
Resolved conversion options
calibre version: 0.9.11
{'asciiize': False,
'author_sort': None,
'authors': None,
'base_font_size': 0,
'book_producer': None,
'change_justification': 'original',
'chapter': None,
'chapter_mark': 'pagebreak',
'comments': None,
'cover': None,
'debug_pipeline': None,
'dehyphenate': True,
'delete_blank_paragraphs': True,
'disable_font_rescaling': False,
'dont_compress': False,
'dont_download_recipe': False,
'duplicate_links_in_toc': False,
'embed_font_family': None,
'enable_heuristics': False,
'extra_css': None,
'extract_to': None,
'filter_css': None,
'fix_indents': True,
'font_size_mapping': None,
'format_scene_breaks': True,
'html_unwrap_factor': 0.4,
'input_encoding': None,
'input_profile': <calibre.customize.profiles.InputProfile object at 0x03384050>,
'insert_blank_line': False,
'insert_blank_line_size': 0.5,
'insert_metadata': False,
'isbn': None,
'italicize_common_cases': True,
'keep_ligatures': False,
'language': None,
'level1_toc': None,
'level2_toc': None,
'level3_toc': None,
'line_height': 0,
'linearize_tables': False,
'lrf': False,
'margin_bottom': 5.0,
'margin_left': 5.0,
'margin_right': 5.0,
'margin_top': 5.0,
'markup_chapter_headings': True,
'max_toc_links': 50,
'minimum_line_height': 120.0,
'mobi_file_type': 'old',
'mobi_ignore_margins': False,
'mobi_keep_original_images': False,
'mobi_toc_at_start': False,
'no_chapters_in_toc': False,
'no_inline_navbars': True,
'no_inline_toc': False,
'output_profile': <calibre.customize.profiles.KindleOutput object at 0x03384390>,
'page_breaks_before': None,
'personal_doc': '[PDOC]',
'prefer_author_sort': False,
'prefer_metadata_cover': False,
'pretty_print': False,
'pubdate': None,
'publisher': None,
'rating': None,
'read_metadata_from_opf': None,
'remove_fake_margins': True,
'remove_first_image': False,
'remove_paragraph_spacing': False,
'remove_paragraph_spacing_indent_size': 1.5,
'renumber_headings': True,
'replace_scene_breaks': '',
'search_replace': None,
'series': None,
'series_index': None,
'share_not_sync': False,
'smarten_punctuation': False,
'sr1_replace': '',
'sr1_search': '',
'sr2_replace': '',
'sr2_search': '',
'sr3_replace': '',
'sr3_search': '',
'start_reading_at': None,
'subset_embedded_fonts': False,
'tags': None,
'test': False,
'timestamp': None,
'title': None,
'title_sort': None,
'toc_filter': None,
'toc_threshold': 6,
'toc_title': None,
'unsmarten_punctuation': False,
'unwrap_lines': True,
'use_auto_toc': False,
'verbose': 2}
InputFormatPlugin: Recipe Input running
Using custom recipe
Skipping article PJTV’s Poliwood: Does Hollywood Need to Rethink Its Relationship to Violence? (Thu, 20 Dec, 2012 23:10) from feed pajamas Media as it is too old.
Skipping article For ‘A Well-Regulated Militia,’ What Firearms, Gear, and Skills Should You Own? (Thu, 20 Dec, 2012 22:53) from feed pajamas Media as it is too old.
Skipping article DHS Delays REAL ID Implementation Indefinitely (Thu, 20 Dec, 2012 16:46) from feed pajamas Media as it is too old.
Skipping article Document Says Iran Orders Assassination of Bahrain’s King (Thu, 20 Dec, 2012 16:38) from feed pajamas Media as it is too old.
Skipping article The Amiga Filling Lieberman’s Hawkish Shoes (Thu, 20 Dec, 2012 15:20) from feed pajamas Media as it is too old.
Skipping article Reid Seeing ‘Gyrations I’ve Never Seen Before’ on the Hill (Thu, 20 Dec, 2012 14:05) from feed pajamas Media as it is too old.
Skipping article Gun Control: It’s the Software, Stupid, Not the Hardware (Thu, 20 Dec, 2012 07:53) from feed pajamas Media as it is too old.
Synthesizing mastheadImage
DownloadingDownloadingDownloading
Fetching http://pjmedia.com/blog/last-state-b...appeals-court/

Fetching http://pjmedia.com/blog/a-gun-crime-...actually-help/

Fetching http://pjmedia.com/blog/fiscal-cliff...-deal-with-it/
Could not fetch link http://pjmedia.com/blog/last-state-b...appeals-court/
Could not fetch linkCould not fetch link http://pjmedia.com/blog/a-gun-crime-...actually-help/ Traceback (most recent call last):
File "site-packages\calibre\web\fetch\simple.py", line 474, in process_links
File "site-packages\calibre\web\fetch\simple.py", line 199, in get_soup
File "<string>", line 39, in preprocess_html
File "site-packages\calibre\ebooks\BeautifulSoup.py", line 190, in insert
AttributeError: 'NoneType' object has no attribute 'parent'

http://pjmedia.com/blog/fiscal-cliff...-deal-with-it/
Traceback (most recent call last):
File "site-packages\calibre\web\fetch\simple.py", line 474, in process_links
File "site-packages\calibre\web\fetch\simple.py", line 199, in get_soup
File "<string>", line 39, in preprocess_html
File "site-packages\calibre\ebooks\BeautifulSoup.py", line 190, in insert
AttributeError: 'NoneType' object has no attribute 'parent'

http://pjmedia.com/blog/last-state-b...appeals-court/ Traceback (most recent call last):
File "site-packages\calibre\web\fetch\simple.py", line 474, in process_links
File "site-packages\calibre\web\fetch\simple.py", line 199, in get_soup
File "<string>", line 39, in preprocess_html
File "site-packages\calibre\ebooks\BeautifulSoup.py", line 190, in insert
AttributeError: 'NoneType' object has no attribute 'parent'

http://pjmedia.com/blog/a-gun-crime-...actually-help/ saved to
saved to
http://pjmedia.com/blog/fiscal-cliff...-deal-with-it/
saved to
Failed to download article: Last State Ban Against Concealed Carry Struck Down by Appeals Court from http://pjmedia.com/blog/last-state-b...appeals-court/
Traceback (most recent call last):
File "site-packages\calibre\utils\threadpool.py", line 95, in run
File "site-packages\calibre\web\feeds\news.py", line 1017, in fetch_article
File "site-packages\calibre\web\feeds\news.py", line 1012, in _fetch_article
Exception: Could not fetch article. The debug traceback is available earlier in this log



Failed to download article: A Gun Crime Proposal (That Might Actually Help) from http://pjmedia.com/blog/a-gun-crime-...actually-help/
Traceback (most recent call last):
File "site-packages\calibre\utils\threadpool.py", line 95, in run
File "site-packages\calibre\web\feeds\news.py", line 1017, in fetch_article
File "site-packages\calibre\web\feeds\news.py", line 1012, in _fetch_article
Exception: Could not fetch article. The debug traceback is available earlier in this log



Failed to download article: Fiscal Cliff: Drink Some Eggnog and Deal With It from http://pjmedia.com/blog/fiscal-cliff...-deal-with-it/
Traceback (most recent call last):
File "site-packages\calibre\utils\threadpool.py", line 95, in run
File "site-packages\calibre\web\feeds\news.py", line 1017, in fetch_article
File "site-packages\calibre\web\feeds\news.py", line 1012, in _fetch_article
Exception: Could not fetch article. The debug traceback is available earlier in this log



Failed to download the following articles:
Last State Ban Against Concealed Carry Struck Down by Appeals Court from pajamas Media
http://pjmedia.com/blog/last-state-b...appeals-court/
Traceback (most recent call last):
File "site-packages\calibre\utils\threadpool.py", line 95, in run
File "site-packages\calibre\web\feeds\news.py", line 1017, in fetch_article
File "site-packages\calibre\web\feeds\news.py", line 1012, in _fetch_article
Exception: Could not fetch article. The debug traceback is available earlier in this log

A Gun Crime Proposal (That Might Actually Help) from pajamas Media
http://pjmedia.com/blog/a-gun-crime-...actually-help/
Traceback (most recent call last):
File "site-packages\calibre\utils\threadpool.py", line 95, in run
File "site-packages\calibre\web\feeds\news.py", line 1017, in fetch_article
File "site-packages\calibre\web\feeds\news.py", line 1012, in _fetch_article
Exception: Could not fetch article. The debug traceback is available earlier in this log

Fiscal Cliff: Drink Some Eggnog and Deal With It from pajamas Media
http://pjmedia.com/blog/fiscal-cliff...-deal-with-it/
Traceback (most recent call last):
File "site-packages\calibre\utils\threadpool.py", line 95, in run
File "site-packages\calibre\web\feeds\news.py", line 1017, in fetch_article
File "site-packages\calibre\web\feeds\news.py", line 1012, in _fetch_article
Exception: Could not fetch article. The debug traceback is available earlier in this log

Parsing all content...
Parsing index.html ...
Forcing index.html into XHTML namespace
Parsing feed_0/index.html ...
Forcing feed_0/index.html into XHTML namespace
Reading TOC from NCX...
Merging user specified metadata...
Detecting structure...
Flattening CSS and remapping font sizes...
Source base font size is 12.00000pt
Removing fake margins...
Found 3 items of level: div_1
Found 1 items of level: div_2
Found 2 items of level: p_2
Ignoring level p_2
div_1 left margin stats: Counter()
div_1 right margin stats: Counter()
div_2 left margin stats: Counter()
div_2 right margin stats: Counter()
Cleaning up manifest...
Trimming unused files from manifest...
Creating MOBI Output...
Serializing resources...
Using mastheadImage supplied in manifest...
Creating MOBI 6 output
Applying case-transforming CSS...
Parsing manglecase.css ...
Rasterizing SVG images...
Converting XHTML to Mobipocket markup...
Serializing markup content...
Compressing markup content...
No TOC, MOBI index not generated
MOBI output written to C:\DOCUME~1\Richard\LOCALS~1\Temp\calibre_0.9.11_t mp_vtjlo7\rvkboe_recipe_out.mobi

Okay, looking at that, it looks like it DOES find some articles, but fails to download them properly, or some other problem.

Big Hollywood fails to find the page, although other sites from the same group (like "Big Government") work.

Spoiler:

Fetch news from Big Hollywood
Resolved conversion options
calibre version: 0.9.11
{'asciiize': False,
'author_sort': None,
'authors': None,
'base_font_size': 0,
'book_producer': None,
'change_justification': 'original',
'chapter': None,
'chapter_mark': 'pagebreak',
'comments': None,
'cover': None,
'debug_pipeline': None,
'dehyphenate': True,
'delete_blank_paragraphs': True,
'disable_font_rescaling': False,
'dont_compress': False,
'dont_download_recipe': False,
'duplicate_links_in_toc': False,
'embed_font_family': None,
'enable_heuristics': False,
'extra_css': None,
'extract_to': None,
'filter_css': None,
'fix_indents': True,
'font_size_mapping': None,
'format_scene_breaks': True,
'html_unwrap_factor': 0.4,
'input_encoding': None,
'input_profile': <calibre.customize.profiles.InputProfile object at 0x03384050>,
'insert_blank_line': False,
'insert_blank_line_size': 0.5,
'insert_metadata': False,
'isbn': None,
'italicize_common_cases': True,
'keep_ligatures': False,
'language': None,
'level1_toc': None,
'level2_toc': None,
'level3_toc': None,
'line_height': 0,
'linearize_tables': False,
'lrf': False,
'margin_bottom': 5.0,
'margin_left': 5.0,
'margin_right': 5.0,
'margin_top': 5.0,
'markup_chapter_headings': True,
'max_toc_links': 50,
'minimum_line_height': 120.0,
'mobi_file_type': 'old',
'mobi_ignore_margins': False,
'mobi_keep_original_images': False,
'mobi_toc_at_start': False,
'no_chapters_in_toc': False,
'no_inline_navbars': True,
'no_inline_toc': False,
'output_profile': <calibre.customize.profiles.KindleOutput object at 0x03384390>,
'page_breaks_before': None,
'personal_doc': '[PDOC]',
'prefer_author_sort': False,
'prefer_metadata_cover': False,
'pretty_print': False,
'pubdate': None,
'publisher': None,
'rating': None,
'read_metadata_from_opf': None,
'remove_fake_margins': True,
'remove_first_image': False,
'remove_paragraph_spacing': False,
'remove_paragraph_spacing_indent_size': 1.5,
'renumber_headings': True,
'replace_scene_breaks': '',
'search_replace': None,
'series': None,
'series_index': None,
'share_not_sync': False,
'smarten_punctuation': False,
'sr1_replace': '',
'sr1_search': '',
'sr2_replace': '',
'sr2_search': '',
'sr3_replace': '',
'sr3_search': '',
'start_reading_at': None,
'subset_embedded_fonts': False,
'tags': None,
'test': False,
'timestamp': None,
'title': None,
'title_sort': None,
'toc_filter': None,
'toc_threshold': 6,
'toc_title': None,
'unsmarten_punctuation': False,
'unwrap_lines': True,
'use_auto_toc': False,
'verbose': 2}
InputFormatPlugin: Recipe Input running
Using custom recipe
Python function terminated unexpectedly
No articles found, aborting (Error Code: 1)
Traceback (most recent call last):
File "site.py", line 132, in main
File "site.py", line 109, in run_entry_point
File "site-packages\calibre\utils\ipc\worker.py", line 186, in main
File "site-packages\calibre\gui2\convert\gui_conversion.py", line 25, in gui_convert
File "site-packages\calibre\ebooks\conversion\plumber.py", line 1009, in run
File "site-packages\calibre\customize\conversion.py", line 239, in __call__
File "site-packages\calibre\ebooks\conversion\plugins\recipe_ input.py", line 109, in convert
File "site-packages\calibre\web\feeds\news.py", line 891, in download
File "site-packages\calibre\web\feeds\news.py", line 1066, in build_index
ValueError: No articles found, aborting