Scientific American

Steve1799 · 06-11-2021, 11:23 PM

Can anyone confirm that the Scientific American recipe is working? The last successful download was in January 2021; now I get the error below. I am able to download other magazines. This is on Windows 10, with the latest updates.

Interestingly, I get something similar when I try to update plugins:

Trying to update plugins:
calibre, version 5.21.0
ERROR: Update Check Failed: Unable to reach the plugin index page.

Traceback (most recent call last):
File "calibre\gui2\dialogs\plugin_updater.py", line 435, in __init__
File "calibre\gui2\dialogs\plugin_updater.py", line 73, in read_available_plugins
File "calibre\utils\https.py", line 195, in get_https_resource_securely
File "http\client.py", line 1417, in connect
File "http\client.py", line 921, in connect
File "socket.py", line 808, in create_connection
File "socket.py", line 796, in create_connection
ConnectionRefusedError: [WinError 10061] No connection could be made because the target machine actively refused it

Trying to download Scientific American:

calibre, version 5.21.0 (win32, embedded-python: True)
Conversion error: Failed: Fetch news from Scientific American

Fetch news from Scientific American
Conversion options changed from defaults:
output_profile: 'generic_eink'
verbose: 2
Resolved conversion options
calibre version: 5.21.0
{'asciiize': False,
'author_sort': None,
'authors': None,
'base_font_size': 0,
'book_producer': None,
'change_justification': 'original',
'chapter': None,
'chapter_mark': 'pagebreak',
'comments': None,
'cover': None,
'debug_pipeline': None,
'dehyphenate': True,
'delete_blank_paragraphs': True,
'disable_font_rescaling': False,
'dont_download_recipe': False,
'dont_split_on_page_breaks': True,
'duplicate_links_in_toc': False,
'embed_all_fonts': False,
'embed_font_family': None,
'enable_heuristics': False,
'epub_flatten': False,
'epub_inline_toc': False,
'epub_toc_at_end': False,
'epub_version': '2',
'expand_css': False,
'extra_css': None,
'extract_to': None,
'filter_css': None,
'fix_indents': True,
'flow_size': 260,
'font_size_mapping': None,
'format_scene_breaks': True,
'html_unwrap_factor': 0.4,
'input_encoding': None,
'input_profile': <calibre.customize.profiles.InputProfile object at 0x00000238132779A0>,
'insert_blank_line': False,
'insert_blank_line_size': 0.5,
'insert_metadata': False,
'isbn': None,
'italicize_common_cases': True,
'keep_ligatures': False,
'language': None,
'level1_toc': None,
'level2_toc': None,
'level3_toc': None,
'line_height': 0,
'linearize_tables': False,
'lrf': False,
'margin_bottom': 5.0,
'margin_left': 5.0,
'margin_right': 5.0,
'margin_top': 5.0,
'markup_chapter_headings': True,
'max_toc_links': 50,
'minimum_line_height': 120.0,
'no_chapters_in_toc': False,
'no_default_epub_cover': False,
'no_inline_navbars': False,
'no_svg_cover': False,
'output_profile': <calibre.customize.profiles.GenericEink object at 0x0000023813277C70>,
'page_breaks_before': None,
'prefer_metadata_cover': False,
'preserve_cover_aspect_ratio': False,
'pretty_print': True,
'pubdate': None,
'publisher': None,
'rating': None,
'read_metadata_from_opf': None,
'remove_fake_margins': True,
'remove_first_image': False,
'remove_paragraph_spacing': False,
'remove_paragraph_spacing_indent_size': 1.5,
'renumber_headings': True,
'replace_scene_breaks': '',
'search_replace': None,
'series': None,
'series_index': None,
'smarten_punctuation': False,
'sr1_replace': '',
'sr1_search': '',
'sr2_replace': '',
'sr2_search': '',
'sr3_replace': '',
'sr3_search': '',
'start_reading_at': None,
'subset_embedded_fonts': False,
'tags': None,
'test': False,
'timestamp': None,
'title': None,
'title_sort': None,
'toc_filter': None,
'toc_threshold': 6,
'toc_title': None,
'transform_css_rules': None,
'unsmarten_punctuation': False,
'unwrap_lines': True,
'use_auto_toc': False,
'verbose': 2}
InputFormatPlugin: Recipe Input running
Downloading recipe urn: builtin:scientific_american
Trying to get latest version of recipe: scientific_american
Using proxies: {'http': '127.0.0.1:8888'}
Failed to download recipe, using builtin version
Traceback (most recent call last):
File "calibre\web\feeds\recipes\collection.py", line 268, in get_builtin_recipe_by_id
File "calibre\web\feeds\recipes\collection.py", line 224, in download_builtin_recipe
File "calibre\utils\https.py", line 195, in get_https_resource_securely
File "http\client.py", line 1417, in connect
File "http\client.py", line 921, in connect
File "socket.py", line 808, in create_connection
File "socket.py", line 796, in create_connection
ConnectionRefusedError: [WinError 10061] No connection could be made because the target machine actively refused it

Using user agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:84.0) Gecko/20100101 Firefox/84.0
Traceback (most recent call last):
File "mechanize\_urllib2_fork.py", line 1229, in do_open
File "http\client.py", line 1255, in request
File "http\client.py", line 1301, in _send_request
File "http\client.py", line 1250, in endheaders
File "http\client.py", line 1010, in _send_output
File "http\client.py", line 950, in send
File "http\client.py", line 921, in connect
File "socket.py", line 808, in create_connection
File "socket.py", line 796, in create_connection
ConnectionRefusedError: [WinError 10061] No connection could be made because the target machine actively refused it

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "runpy.py", line 194, in _run_module_as_main
File "runpy.py", line 87, in _run_code
File "site.py", line 82, in <module>
File "site.py", line 77, in main
File "site.py", line 49, in run_entry_point
File "calibre\utils\ipc\worker.py", line 216, in main
File "calibre\gui2\convert\gui_conversion.py", line 34, in gui_convert_recipe
File "calibre\gui2\convert\gui_conversion.py", line 28, in gui_convert
File "calibre\ebooks\conversion\plumber.py", line 1105, in run
File "calibre\customize\conversion.py", line 245, in __call__
File "calibre\ebooks\conversion\plugins\recipe_input.py ", line 139, in convert
File "calibre\web\feeds\news.py", line 1051, in download
File "calibre\web\feeds\news.py", line 1220, in build_index
File "<string>", line 55, in parse_index
File "calibre\web\feeds\news.py", line 702, in index_to_soup
File "mechanize\_mechanize.py", line 241, in open_novisit
File "mechanize\_mechanize.py", line 287, in _mech_open
File "mechanize\_opener.py", line 204, in open
File "mechanize\_urllib2_fork.py", line 535, in http_response
File "mechanize\_opener.py", line 222, in error
File "mechanize\_urllib2_fork.py", line 414, in _call_chain
File "mechanize\_urllib2_fork.py", line 655, in http_error_302
File "mechanize\_mechanize.py", line 257, in open
File "mechanize\_mechanize.py", line 287, in _mech_open
File "mechanize\_opener.py", line 193, in open
File "mechanize\_urllib2_fork.py", line 425, in _open
File "mechanize\_urllib2_fork.py", line 414, in _call_chain
File "mechanize\_urllib2_fork.py", line 1251, in http_open
File "mechanize\_urllib2_fork.py", line 1233, in do_open
urllib.error.URLError: <urlopen error [WinError 10061] No connection could be made because the target machine actively refused it>
Using proxies: {'http': '127.0.0.1:8888'}

rasteps · 06-19-2021, 07:52 AM

Just ran the recipe and it downloaded without a problem.

Steve1799 · 06-21-2021, 08:33 AM

Quote:

Originally Posted by rasteps

Just ran the recipe and it downloaded without a problem.

Maybe it's a OS issue. What platform did you run it on?

DNSB · 06-21-2021, 12:22 PM

Another possibility is that it is a antivirus/antispyware issue or Scientific American has blacklisted your IP address.

Steve1799 · 06-21-2021, 07:38 PM

Quote:

Originally Posted by DNSB

Another possibility is that it is a antivirus/antispyware issue or Scientific American has blacklisted your IP address.

Hmm. Now that you say that and I look at the error message, that might be the case. I have a static IP so it would be easy for them to do, but I wouldn't have thought my once-a-month download to have raised any alarms.

Steve1799 · 06-25-2021, 04:19 AM

This just doesn't make sense. The Economist just downloaded successfully.

Is there a way to find out the IP address and port that Scientific American would be downloaded from? That way I can test it manually. I see a failure with a proxy at 127.0.0.1:8888. There is no proxy there, so a failure should be expected. The question is: Why would only Scientific American be using a proxy and all the other magazines not?

kovidgoyal · 06-25-2021, 04:26 AM

You have some software on your computer that is blocking calibre. reboot in safe mode and it will likely work. Or add exceptions for calibre to your firewall/antiirus/malware.

Steve1799 · 06-26-2021, 02:50 AM

I added the exception, but the error still persists. I was wondering how that might help, given that all the other news sources seem to work fine, then noticed this:

InputFormatPlugin: Recipe Input running
Downloading recipe urn: builtin:scientific_american
Trying to get latest version of recipe: scientific_american
Using proxies: {'http': '127.0.0.1:8888'}
Failed to download recipe, using builtin version

So it seems like it may be the connection to the recipe source that is, for some reason, trying to use a proxy that isn't there.

kovidgoyal · 06-26-2021, 03:01 AM

Read the error messages you posted. Pretty much every single attempt calibre makes to download anything using a secured https connection is failing. Including downloading of up-to-date recipes. And that is because something is blocking calibre. Fix that, until you do, it wont work.

Steve1799 · 06-27-2021, 09:46 PM

Why is it only this recipe? Everything else downloads fine...

kovidgoyal · 06-27-2021, 09:56 PM

Quote:

Originally Posted by Steve1799

Why is it only this recipe? Everything else downloads fine...

Its not only this recipe, read your error messages again. Anything being downloaded from https://code.calibre-ebook.com is being blocked. That is where up-to-date versions of recipes are fetched from. This recipe just happens to be one where the up-to-date version is actually required and so it fails without it.

Steve1799 · 06-28-2021, 02:22 AM

Okay. I've tracked this:

ConnectionRefusedError: [WinError 10061] No connection could be made because the target machine actively refused it

down to the proxy, or absence thereof:

Downloading recipe urn: builtin:scientific_american
Trying to get latest version of recipe: scientific_american
Using proxies: {'http': '127.0.0.1:8888'}

The Windows settings for proxy confirm that there isn't one set. I also checked MS Edge, which just points back to the system proxy page.

So, where is this proxy setting coming from?

kovidgoyal · 06-28-2021, 03:24 AM

It has nothing to do with the proxy, the proxy will apply to all downloads. And as for where it is coming from, your system obviously, calibre doesnt ship with a proxy defined. If you want to figure out where in your system the proxy is defined read the documentation for the getproxies() function in the python standard library.

06-11-2021, 11:23 PM	#1
Steve1799 Member Posts: 10 Karma: 10 Join Date: Jun 2020 Device: Kindle	Scientific American Can anyone confirm that the Scientific American recipe is working? The last successful download was in January 2021; now I get the error below. I am able to download other magazines. This is on Windows 10, with the latest updates. Interestingly, I get something similar when I try to update plugins: Trying to update plugins: calibre, version 5.21.0 ERROR: Update Check Failed: Unable to reach the plugin index page. Traceback (most recent call last): File "calibre\gui2\dialogs\plugin_updater.py", line 435, in __init__ File "calibre\gui2\dialogs\plugin_updater.py", line 73, in read_available_plugins File "calibre\utils\https.py", line 195, in get_https_resource_securely File "http\client.py", line 1417, in connect File "http\client.py", line 921, in connect File "socket.py", line 808, in create_connection File "socket.py", line 796, in create_connection ConnectionRefusedError: [WinError 10061] No connection could be made because the target machine actively refused it Trying to download Scientific American: calibre, version 5.21.0 (win32, embedded-python: True) Conversion error: Failed: Fetch news from Scientific American Fetch news from Scientific American Conversion options changed from defaults: output_profile: 'generic_eink' verbose: 2 Resolved conversion options calibre version: 5.21.0 {'asciiize': False, 'author_sort': None, 'authors': None, 'base_font_size': 0, 'book_producer': None, 'change_justification': 'original', 'chapter': None, 'chapter_mark': 'pagebreak', 'comments': None, 'cover': None, 'debug_pipeline': None, 'dehyphenate': True, 'delete_blank_paragraphs': True, 'disable_font_rescaling': False, 'dont_download_recipe': False, 'dont_split_on_page_breaks': True, 'duplicate_links_in_toc': False, 'embed_all_fonts': False, 'embed_font_family': None, 'enable_heuristics': False, 'epub_flatten': False, 'epub_inline_toc': False, 'epub_toc_at_end': False, 'epub_version': '2', 'expand_css': False, 'extra_css': None, 'extract_to': None, 'filter_css': None, 'fix_indents': True, 'flow_size': 260, 'font_size_mapping': None, 'format_scene_breaks': True, 'html_unwrap_factor': 0.4, 'input_encoding': None, 'input_profile': <calibre.customize.profiles.InputProfile object at 0x00000238132779A0>, 'insert_blank_line': False, 'insert_blank_line_size': 0.5, 'insert_metadata': False, 'isbn': None, 'italicize_common_cases': True, 'keep_ligatures': False, 'language': None, 'level1_toc': None, 'level2_toc': None, 'level3_toc': None, 'line_height': 0, 'linearize_tables': False, 'lrf': False, 'margin_bottom': 5.0, 'margin_left': 5.0, 'margin_right': 5.0, 'margin_top': 5.0, 'markup_chapter_headings': True, 'max_toc_links': 50, 'minimum_line_height': 120.0, 'no_chapters_in_toc': False, 'no_default_epub_cover': False, 'no_inline_navbars': False, 'no_svg_cover': False, 'output_profile': <calibre.customize.profiles.GenericEink object at 0x0000023813277C70>, 'page_breaks_before': None, 'prefer_metadata_cover': False, 'preserve_cover_aspect_ratio': False, 'pretty_print': True, 'pubdate': None, 'publisher': None, 'rating': None, 'read_metadata_from_opf': None, 'remove_fake_margins': True, 'remove_first_image': False, 'remove_paragraph_spacing': False, 'remove_paragraph_spacing_indent_size': 1.5, 'renumber_headings': True, 'replace_scene_breaks': '', 'search_replace': None, 'series': None, 'series_index': None, 'smarten_punctuation': False, 'sr1_replace': '', 'sr1_search': '', 'sr2_replace': '', 'sr2_search': '', 'sr3_replace': '', 'sr3_search': '', 'start_reading_at': None, 'subset_embedded_fonts': False, 'tags': None, 'test': False, 'timestamp': None, 'title': None, 'title_sort': None, 'toc_filter': None, 'toc_threshold': 6, 'toc_title': None, 'transform_css_rules': None, 'unsmarten_punctuation': False, 'unwrap_lines': True, 'use_auto_toc': False, 'verbose': 2} InputFormatPlugin: Recipe Input running Downloading recipe urn: builtin:scientific_american Trying to get latest version of recipe: scientific_american Using proxies: {'http': '127.0.0.1:8888'} Failed to download recipe, using builtin version Traceback (most recent call last): File "calibre\web\feeds\recipes\collection.py", line 268, in get_builtin_recipe_by_id File "calibre\web\feeds\recipes\collection.py", line 224, in download_builtin_recipe File "calibre\utils\https.py", line 195, in get_https_resource_securely File "http\client.py", line 1417, in connect File "http\client.py", line 921, in connect File "socket.py", line 808, in create_connection File "socket.py", line 796, in create_connection ConnectionRefusedError: [WinError 10061] No connection could be made because the target machine actively refused it Using user agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:84.0) Gecko/20100101 Firefox/84.0 Traceback (most recent call last): File "mechanize\_urllib2_fork.py", line 1229, in do_open File "http\client.py", line 1255, in request File "http\client.py", line 1301, in _send_request File "http\client.py", line 1250, in endheaders File "http\client.py", line 1010, in _send_output File "http\client.py", line 950, in send File "http\client.py", line 921, in connect File "socket.py", line 808, in create_connection File "socket.py", line 796, in create_connection ConnectionRefusedError: [WinError 10061] No connection could be made because the target machine actively refused it During handling of the above exception, another exception occurred: Traceback (most recent call last): File "runpy.py", line 194, in _run_module_as_main File "runpy.py", line 87, in _run_code File "site.py", line 82, in <module> File "site.py", line 77, in main File "site.py", line 49, in run_entry_point File "calibre\utils\ipc\worker.py", line 216, in main File "calibre\gui2\convert\gui_conversion.py", line 34, in gui_convert_recipe File "calibre\gui2\convert\gui_conversion.py", line 28, in gui_convert File "calibre\ebooks\conversion\plumber.py", line 1105, in run File "calibre\customize\conversion.py", line 245, in __call__ File "calibre\ebooks\conversion\plugins\recipe_input.py ", line 139, in convert File "calibre\web\feeds\news.py", line 1051, in download File "calibre\web\feeds\news.py", line 1220, in build_index File "<string>", line 55, in parse_index File "calibre\web\feeds\news.py", line 702, in index_to_soup File "mechanize\_mechanize.py", line 241, in open_novisit File "mechanize\_mechanize.py", line 287, in _mech_open File "mechanize\_opener.py", line 204, in open File "mechanize\_urllib2_fork.py", line 535, in http_response File "mechanize\_opener.py", line 222, in error File "mechanize\_urllib2_fork.py", line 414, in _call_chain File "mechanize\_urllib2_fork.py", line 655, in http_error_302 File "mechanize\_mechanize.py", line 257, in open File "mechanize\_mechanize.py", line 287, in _mech_open File "mechanize\_opener.py", line 193, in open File "mechanize\_urllib2_fork.py", line 425, in _open File "mechanize\_urllib2_fork.py", line 414, in _call_chain File "mechanize\_urllib2_fork.py", line 1251, in http_open File "mechanize\_urllib2_fork.py", line 1233, in do_open urllib.error.URLError: <urlopen error [WinError 10061] No connection could be made because the target machine actively refused it> Using proxies: {'http': '127.0.0.1:8888'}

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Scientific American Broken	caiocarvalho	Recipes	4	01-20-2016 01:53 PM
Scientific American broken?	NSILMike	Recipes	4	12-13-2014 11:30 AM
Pogue Article from Scientific American	toronado	News	37	12-03-2010 10:02 PM
Scientific American	Starson17	Recipes	13	09-25-2010 03:37 PM
Scientific American recipe	Stingo	Calibre	2	10-30-2009 05:42 PM

06-19-2021, 07:52 AM	#2
rasteps Zealot Posts: 118 Karma: 10 Join Date: Sep 2010 Device: Kindle, Android phone	Just ran the recipe and it downloaded without a problem.

06-21-2021, 12:22 PM	#4
DNSB Bibliophagist Posts: 35,312 Karma: 145435140 Join Date: Jul 2010 Location: Vancouver Device: Kobo Sage, Forma, Clara HD, Lenovo M8 FHD, Paperwhite 4, Tolino epos	Another possibility is that it is a antivirus/antispyware issue or Scientific American has blacklisted your IP address.

06-25-2021, 04:19 AM	#6
Steve1799 Member Posts: 10 Karma: 10 Join Date: Jun 2020 Device: Kindle	This just doesn't make sense. The Economist just downloaded successfully. Is there a way to find out the IP address and port that Scientific American would be downloaded from? That way I can test it manually. I see a failure with a proxy at 127.0.0.1:8888. There is no proxy there, so a failure should be expected. The question is: Why would only Scientific American be using a proxy and all the other magazines not?

06-25-2021, 04:26 AM	#7
kovidgoyal creator of calibre Posts: 43,845 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	You have some software on your computer that is blocking calibre. reboot in safe mode and it will likely work. Or add exceptions for calibre to your firewall/antiirus/malware.

06-26-2021, 02:50 AM	#8
Steve1799 Member Posts: 10 Karma: 10 Join Date: Jun 2020 Device: Kindle	I added the exception, but the error still persists. I was wondering how that might help, given that all the other news sources seem to work fine, then noticed this: InputFormatPlugin: Recipe Input running Downloading recipe urn: builtin:scientific_american Trying to get latest version of recipe: scientific_american Using proxies: {'http': '127.0.0.1:8888'} Failed to download recipe, using builtin version So it seems like it may be the connection to the recipe source that is, for some reason, trying to use a proxy that isn't there.

06-26-2021, 03:01 AM	#9
kovidgoyal creator of calibre Posts: 43,845 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Read the error messages you posted. Pretty much every single attempt calibre makes to download anything using a secured https connection is failing. Including downloading of up-to-date recipes. And that is because something is blocking calibre. Fix that, until you do, it wont work.

06-27-2021, 09:46 PM	#10
Steve1799 Member Posts: 10 Karma: 10 Join Date: Jun 2020 Device: Kindle	Why is it only this recipe? Everything else downloads fine...

06-28-2021, 02:22 AM	#12
Steve1799 Member Posts: 10 Karma: 10 Join Date: Jun 2020 Device: Kindle	Okay. I've tracked this: ConnectionRefusedError: [WinError 10061] No connection could be made because the target machine actively refused it down to the proxy, or absence thereof: Downloading recipe urn: builtin:scientific_american Trying to get latest version of recipe: scientific_american Using proxies: {'http': '127.0.0.1:8888'} The Windows settings for proxy confirm that there isn't one set. I also checked MS Edge, which just points back to the system proxy page. So, where is this proxy setting coming from?

06-28-2021, 03:24 AM	#13
kovidgoyal creator of calibre Posts: 43,845 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	It has nothing to do with the proxy, the proxy will apply to all downloads. And as for where it is coming from, your system obviously, calibre doesnt ship with a proxy defined. If you want to figure out where in your system the proxy is defined read the documentation for the getproxies() function in the python standard library.

Advert

Advert