recipe request: Galaxy's Edge Magazine

[camiller]

http://www.galaxysedge.com/

New digital sci-fi magazine, published 6 times a year, online html version is free. Looks like it will require parsing of html, no rss feed available. And there is no "nice" stuff (like style tags unique to the story links) to work with in the html. In fact I'm guessing they are not using any real content management to build pages dynamically.

If nobody else tackles it I might have some time in 6-8 weeks.

[Krittika Goyal]

here you are

[camiller]

Thank you!

[josepinto]

Originally Posted by Krittika Goyal

here you are

Hi,

Title of the recipe says "The Hindu", instead of "Galaxy's Edge Magazine".

José Pinto

[Krittika Goyal]

yes sorry I used the hindu as a template.please change it in your copy. it has been corrected in the copy you would download from calibre.

[josepinto]

Originally Posted by Krittika Goyal

yes sorry I used the hindu as a template.please change it in your copy. it has been corrected in the copy you would download from calibre.

Hi,
The recipe still contaisn references to The Hindu site, and several characters are not recognized on Kindle Touch, mainly '

José Pinto

[josepinto]

Recolher as notícias de The Galaxy's Edge
Resolved conversion options
calibre version: 0.9.31
{'asciiize': False,
'author_sort': None,
'authors': None,
'base_font_size': 0,
'book_producer': None,
'change_justification': 'original',
'chapter': None,
'chapter_mark': 'pagebreak',
'comments': None,
'cover': None,
'debug_pipeline': None,
'dehyphenate': True,
'delete_blank_paragraphs': True,
'disable_font_rescaling': False,
'dont_compress': False,
'dont_download_recipe': False,
'duplicate_links_in_toc': False,
'embed_font_family': None,
'enable_heuristics': False,
'extra_css': None,
'extract_to': None,
'filter_css': None,
'fix_indents': True,
'font_size_mapping': None,
'format_scene_breaks': True,
'html_unwrap_factor': 0.4,
'input_encoding': None,
'input_profile': <calibre.customize.profiles.InputProfile object at 0x03901F30>,
'insert_blank_line': False,
'insert_blank_line_size': 0.5,
'insert_metadata': False,
'isbn': None,
'italicize_common_cases': True,
'keep_ligatures': False,
'language': None,
'level1_toc': None,
'level2_toc': None,
'level3_toc': None,
'line_height': 0,
'linearize_tables': False,
'lrf': False,
'margin_bottom': 5.0,
'margin_left': 5.0,
'margin_right': 5.0,
'margin_top': 5.0,
'markup_chapter_headings': True,
'max_toc_links': 50,
'minimum_line_height': 120.0,
'mobi_file_type': 'old',
'mobi_ignore_margins': False,
'mobi_keep_original_images': False,
'mobi_toc_at_start': False,
'no_chapters_in_toc': False,
'no_inline_navbars': True,
'no_inline_toc': False,
'output_profile': <calibre.customize.profiles.KindleOutput object at 0x0385B990>,
'page_breaks_before': None,
'personal_doc': '[PDOC]',
'prefer_author_sort': False,
'prefer_metadata_cover': False,
'pretty_print': False,
'pubdate': None,
'publisher': None,
'rating': None,
'read_metadata_from_opf': None,
'remove_fake_margins': True,
'remove_first_image': False,
'remove_paragraph_spacing': False,
'remove_paragraph_spacing_indent_size': 1.5,
'renumber_headings': True,
'replace_scene_breaks': '',
'search_replace': None,
'series': None,
'series_index': None,
'share_not_sync': False,
'smarten_punctuation': False,
'sr1_replace': '',
'sr1_search': '',
'sr2_replace': '',
'sr2_search': '',
'sr3_replace': '',
'sr3_search': '',
'start_reading_at': None,
'subset_embedded_fonts': False,
'tags': None,
'test': False,
'timestamp': None,
'title': None,
'title_sort': None,
'toc_filter': None,
'toc_threshold': 6,
'toc_title': None,
'unsmarten_punctuation': False,
'unwrap_lines': True,
'use_auto_toc': False,
'verbose': 2}
InputFormatPlugin: Recipe Input running
Using custom recipe
Using proxies: {'http': '10.0.230.100:8080', 'https': '10.0.230.100:8080'}
Python function terminated unexpectedly
'NoneType' object has no attribute 'findAll' (Error Code: 1)
Traceback (most recent call last):
File "site.py", line 132, in main
File "site.py", line 109, in run_entry_point
File "site-packages\calibre\utils\ipc\worker.py", line 189, in main
File "site-packages\calibre\gui2\convert\gui_conversion.py", line 25, in gui_convert
File "site-packages\calibre\ebooks\conversion\plumber.py", line 1010, in run
File "site-packages\calibre\customize\conversion.py", line 239, in __call__
File "site-packages\calibre\ebooks\conversion\plugins\recipe_ input.py", line 114, in convert
File "site-packages\calibre\web\feeds\news.py", line 980, in download
File "site-packages\calibre\web\feeds\news.py", line 1145, in build_index
File "<string>", line 35, in parse_index
AttributeError: 'NoneType' object has no attribute 'findAll'

[Krittika Goyal]

I will look in to this some time next week. if someone else wants to fix it earlier feel free

[camiller]

First, what I don't know about Python would fill a book on Python...

it looks to me like it is dying on this line:

for x in toc.findAll(['p']):

because toc is undefined. toc is set by

 toc = main.find('td', attrs={'width':'225'})

but there is not a td element with a width of 255 to find, because it is changed to 204. also, the outer table that was previously had a width of 911 is now 944 wide.

Fixing these two things seem to let the recipe run to completion.


Edit: I forgot to set calibre to not delete news articles and have lost the first two issues, anyone have the epub saved?

[rpresser]

When the numbers are changed as camiller suggested, the latest issue downloads, but it only retrieves the first story, the serial and the three columns.