[GUI Plugin] FanFicFare - Page 646

John Maverick · 06-12-2024, 01:00 PM

Quote:

Originally Posted by JimmXinu

FFF used to use the story URL without title for scribblehub, the title was added to the canonical story URL four years ago, when somebody asked for chapter titles to be accepted. I don't remember if that was also requested, but it is something that was requested for other sites around the same time.

I think I was one of those that asked for FFF accepting chapter URLs from scribblehub so I can update stories from my email.

Quote:

Originally Posted by JimmXinu

FFF has special code for finding ffnet story URLs regardless of title in the URL. I'm not really keen on trying to make it more universal.

I was hoping that the URL normalization was more easy to fix here.

I'm not in front of my PC now, but I think that with the function of getting URLs from email there is an option to ignore those of stories that aren't in the library.

I can pass the "Get URLs from Email" the first time to get only the stories already in the library. And after checking the emails not read if those are not of stories already in the library. Then get the emails checked by disable that option. Or add them manually if those are few.

I can do that to avoid what happened 2 days ago of downloading a whole story of 553 chapters that was already in may library and only needed do be updated with the last two.

A bit of a shame because I can't do things like sending myself a email with stories to download if I'm reading out of my house. Not is easy as before, but at least is usable.

Thanks for checking this JimmXinu

MorbPtact · 06-12-2024, 02:41 PM

Quote:

That output looks more than a little weird. It looks like trying to update the plugin, not trying to run the plugin. If it is, you might try downloading the plugin manually from the first post of the thread and installing it directly (Calibre Preferences > Plugins > Load Plugin from file button).

What OS are you on? And are you using the official Calibre release?

I'm on windows 11, with the official release, and that's the text that pops up when I press download new plugins. I was just using it as an example; I don't need to download the plugin as I already have it.

My main question was about using
[overrides]
[www.royalroad.com]
use_ssl_unverified_context:true

and if I wrote it correctly (I don't really understand how personal.ini is supposed to be used), and if so, why doesn't it work

Thanks again
Morb

JimmXinu · 06-12-2024, 06:21 PM

Quote:

Originally Posted by MorbPtact

I'm on windows 11, with the official release, and that's the text that pops up when I press download new plugins. I was just using it as an example; I don't need to download the plugin as I already have it.

Okay, but if you're having troubles with that, your Calibre may be broken in some fundamental way I can't help you address.

Quote:

Originally Posted by MorbPtact

My main question was about using

and if I wrote it correctly (I don't really understand how personal.ini is supposed to be used), and if so, why doesn't it work

In this example:

Code:

[overrides]
[www.royalroad.com]
use_ssl_unverified_context:true

The [overrides] section doesn't do anything because there are no lines in it before the [www.royalroad.com] section starts. It's not a modifier. See wiki page about personal.ini.

Other than that, I don't see anything wrong. Technically, the use_ssl_unverified_context setting isn't really recommended for long term use--it's more intended for temporary use when sites forget to renew certs, things like that. It's not officially supported.

I'd need to see a debug log of your failure to tell anything further. 'Restart in debug mode' is under Calibre Preferences dropdown.

MorbPtact · 06-13-2024, 02:05 PM

Apparently this is windows 10, my bad
Here's the log without adding use_ssl_unverified_context:

Spoiler:

JimmXinu · 06-13-2024, 02:15 PM

Quote:

Originally Posted by MorbPtact

Apparently this is windows 10, my bad
Here's the log without adding use_ssl_unverified_context:

Even with use_ssl_unverified_context you are apparently not getting a valid story page. FFF is failing to find the story title.

I checked and royalroad's SSL cert comes back valid for me. Considering you are getting reports of an invalid self-signed cert first, it looks like you may have a network proxy or even a man-in-the-middle malware situation.

We've seen SSL with FFF fail before with intrusive network proxy servers. Some people have had better success using a VPN.

You might try using FFF's Proxy Feature or Browser Cache Feature. However, I don't recall ever trying them with royalroad.

FYI, wrapping logs with [code] tags helps readability. And long logs with [spoiler] for people on mobile.

06-13-2024, 02:05 PM	#9679
MorbPtact Junior Member Posts: 3 Karma: 10 Join Date: Jun 2024 Device: kindle	Apparently this is windows 10, my bad Here's the log without adding use_ssl_unverified_context: Spoiler: ApplicationPaletteChange event ignored Using calibre Qt style: True ApplicationPaletteChange event received FFF: DEBUG: 2024-06-13 20:59:48,113: calibre_plugins.fanficfare_plugin.fff_plugin(217): Plugin FanFicFare macmenuhack file_path:C:\Users\ezril\AppData\Roaming\calibre\p lugins\fanficfare_macmenuhack.txt calibre Debug log calibre 7.12 embedded-python: True Windows-10-10.0.22631-SP0 Windows ('64bit', 'WindowsPE') ('Windows', '10', '10.0.22631') Python 3.11.5 Windows: ('10', '10.0.22631', 'SP0', 'Multiprocessor Free') Interface language: None EXE path: C:\Program Files\Calibre2\calibre-debug.exe Successfully initialized third party plugins: FanFicFare (4, 35, 0) calibre 7.12 embedded-python: True Windows-10-10.0.22631-SP0 Windows ('64bit', 'WindowsPE') ('Windows', '10', '10.0.22631') Python 3.11.5 Windows: ('10', '10.0.22631', 'SP0', 'Multiprocessor Free') Interface language: None EXE path: C:\Program Files\Calibre2\calibre-debug.exe Successfully initialized third party plugins: FanFicFare (4, 35, 0) QPA platform: windows devicePixelRatio: 1.0 logicalDpi: 96.0 x 96.0 physicalDpi: 100.86162790697674 x 101.07357512953367 [0.00] Starting up... [0.01] Initializing db... [0.03] db initialized [0.03] Constructing main UI... [0.80] GUI main window shown [0.83] main UI initialized... [0.83] Started up in 0.83 seconds with 248 books Failed to check for plugin update: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate (_ssl.c:1006) FFF: DEBUG: 2024-06-13 21:00:09,479: calibre_plugins.fanficfare_plugin.fff_plugin(1151) : FanFicFare v4.35.0 FFF: DEBUG: 2024-06-13 21:00:09,580: configurable.py(1080): use_browser_cache: FFF: DEBUG: 2024-06-13 21:00:09,580: configurable.py(1100): use_basic_cache:true FFF: DEBUG: 2024-06-13 21:00:09,580: adapter_royalroadcom.py(161): URL: https://www.royalroad.com/fiction/55687 FFF: DEBUG: 2024-06-13 21:00:09,580: cache_basic.py(116): ========== MISS (GET) BasicCache https://www.royalroad.com/fiction/55687 FFF: DEBUG: 2024-06-13 21:00:09,580: fetcher_requests.py(114): ---------- REQ (GET) RequestsFetcher https://www.royalroad.com/fiction/55687 FFF: ERROR: 2024-06-13 21:00:09,863: calibre_plugins.fanficfare_plugin.dialogs(726): Exception: {'title': 'All The Skills - A Deckbuilding LitRPG', 'author_sort': 'HonourRae', 'author': ['HonourRae'], 'comments': '', 'good': False, 'status': 'Error', 'showerror': True, 'calibre_id': 10, 'begin': None, 'end': None, 'comment': "HTTPSConnectionPool(host='www.royalroad.com', port=443): Max retries exceeded with url: /fiction/55687 (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1006)')))", 'url': 'https://www.royalroad.com/fiction/55687', 'site': 'www.royalroad.com', 'series': '', 'added': False, 'pubdate': None, 'publisher': 'www.royalroad.com', 'listorder': 0, 'collision': 'Update EPUB if New Chapters'}:HTTPSConnectionPool(host='www.royalroad .com', port=443): Max retries exceeded with url: /fiction/55687 (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1006)'))) Traceback (most recent call last): File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\urllib3\connectionpool.py", line 699, in urlopen File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\urllib3\connectionpool.py", line 382, in _make_request File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\urllib3\connectionpool.py", line 1010, in _validate_conn File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\urllib3\connection.py", line 411, in connect File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\urllib3\util\ssl_.py", line 449, in ssl_wrap_socket File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\urllib3\util\ssl_.py", line 493, in _ssl_wrap_socket_impl File "ssl.py", line 517, in wrap_socket File "ssl.py", line 1108, in _create File "ssl.py", line 1379, in do_handshake ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1006) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\requests\adapters.py", line 439, in send File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\urllib3\connectionpool.py", line 755, in urlopen File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\urllib3\util\retry.py", line 574, in increment urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='www.royalroad.com', port=443): Max retries exceeded with url: /fiction/55687 (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1006)'))) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "calibre_plugins.fanficfare_plugin.dialogs", line 713, in do_loop File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 1357, in prep_download_loop File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 1237, in get_story_metadata_only File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\adapters\base_adapter.py", line 325, in getStoryMetadataOnly File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\adapters\base_adapter.py", line 429, in doExtractChapterUrlsAndMetadata File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\adapters\adapter_royalroad com.py", line 163, in extractChapterUrlsAndMetadata File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\requestable.py", line 119, in get_request File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\requestable.py", line 111, in get_request_redirected File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\fetchers\base_fetcher.py", line 133, in get_request_redirected File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\fetchers\cache_basic.py", line 122, in fetcher_do_request File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\fetchers\decorators.py", line 102, in fetcher_do_request File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\fetchers\base_fetcher.py", line 106, in do_request File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\fetchers\fetcher_requests. py", line 121, in request File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\requests\sessions.py", line 542, in request File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\requests\sessions.py", line 655, in send File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\requests\adapters.py", line 514, in send requests.exceptions.SSLError: HTTPSConnectionPool(host='www.royalroad.com', port=443): Max retries exceeded with url: /fiction/55687 (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1006)'))) And here is the log with it: ApplicationPaletteChange event ignored Using calibre Qt style: True ApplicationPaletteChange event received FFF: DEBUG: 2024-06-13 21:03:59,389: calibre_plugins.fanficfare_plugin.fff_plugin(217): Plugin FanFicFare macmenuhack file_path:C:\Users\ezril\AppData\Roaming\calibre\p lugins\fanficfare_macmenuhack.txt calibre Debug log calibre 7.12 embedded-python: True Windows-10-10.0.22631-SP0 Windows ('64bit', 'WindowsPE') ('Windows', '10', '10.0.22631') Python 3.11.5 Windows: ('10', '10.0.22631', 'SP0', 'Multiprocessor Free') Interface language: None EXE path: C:\Program Files\Calibre2\calibre-debug.exe Successfully initialized third party plugins: FanFicFare (4, 35, 0) calibre 7.12 embedded-python: True Windows-10-10.0.22631-SP0 Windows ('64bit', 'WindowsPE') ('Windows', '10', '10.0.22631') Python 3.11.5 Windows: ('10', '10.0.22631', 'SP0', 'Multiprocessor Free') Interface language: None EXE path: C:\Program Files\Calibre2\calibre-debug.exe Successfully initialized third party plugins: FanFicFare (4, 35, 0) QPA platform: windows devicePixelRatio: 1.0 logicalDpi: 96.0 x 96.0 physicalDpi: 100.86162790697674 x 101.07357512953367 [0.00] Starting up... [0.02] Initializing db... [0.03] db initialized [0.03] Constructing main UI... [0.77] GUI main window shown [0.83] main UI initialized... [0.83] Started up in 0.83 seconds with 248 books Failed to check for plugin update: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate (_ssl.c:1006) FFF: DEBUG: 2024-06-13 21:04:05,764: calibre_plugins.fanficfare_plugin.fff_plugin(1151) : FanFicFare v4.35.0 FFF: DEBUG: 2024-06-13 21:04:05,865: configurable.py(1080): use_browser_cache: FFF: DEBUG: 2024-06-13 21:04:05,865: configurable.py(1100): use_basic_cache:true FFF: DEBUG: 2024-06-13 21:04:05,865: adapter_royalroadcom.py(161): URL: https://www.royalroad.com/fiction/55687 FFF: DEBUG: 2024-06-13 21:04:05,865: cache_basic.py(116): ========== MISS (GET) BasicCache https://www.royalroad.com/fiction/55687 FFF: DEBUG: 2024-06-13 21:04:05,865: fetcher_requests.py(114): ---------- REQ (GET) RequestsFetcher https://www.royalroad.com/fiction/55687 C:\Users\ezril\AppData\Roaming\calibre\plugins\Fan FicFare.zip\urllib3\connectionpool.py:1013: InsecureRequestWarning: Unverified HTTPS request is being made to host 'www.royalroad.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1....l#ssl-warnings FFF: DEBUG: 2024-06-13 21:04:05,941: fetcher_requests.py(127): response code:200 FFF: DEBUG: 2024-06-13 21:04:05,941: decorators.py(112): fromcache:False FFF: DEBUG: 2024-06-13 21:04:05,941: requestable.py(55): Encoding:utf8 FFF: ERROR: 2024-06-13 21:04:05,945: calibre_plugins.fanficfare_plugin.dialogs(726): Exception: {'title': 'All The Skills - A Deckbuilding LitRPG', 'author_sort': 'HonourRae', 'author': ['HonourRae'], 'comments': '', 'good': False, 'status': 'Error', 'showerror': True, 'calibre_id': 10, 'begin': None, 'end': None, 'comment': "'NoneType' object has no attribute 'text'", 'url': 'https://www.royalroad.com/fiction/55687', 'site': 'www.royalroad.com', 'series': '', 'added': False, 'pubdate': None, 'publisher': 'www.royalroad.com', 'listorder': 0, 'collision': 'Update EPUB if New Chapters'}:'NoneType' object has no attribute 'text' Traceback (most recent call last): File "calibre_plugins.fanficfare_plugin.dialogs", line 713, in do_loop File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 1357, in prep_download_loop File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 1237, in get_story_metadata_only File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\adapters\base_adapter.py", line 325, in getStoryMetadataOnly File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\adapters\base_adapter.py", line 429, in doExtractChapterUrlsAndMetadata File "C:\Users\ezril\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\adapters\adapter_royalroad com.py", line 175, in extractChapterUrlsAndMetadata AttributeError: 'NoneType' object has no attribute 'text' Last edited by theducks; 06-13-2024 at 04:46 PM. Reason: SPOILER LOG files

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
[GUI Plugin] KindleUnpack - The Plugin	DiapDealer	Plugins	494	05-18-2024 02:34 AM
[GUI Plugin] Open With	kiwidude	Plugins	403	04-01-2024 08:39 AM
[GUI Plugin] Marvin XD	Philantrop	Plugins	126	01-29-2017 12:48 PM
[GUI Plugin] KiNotes	-axel-	Plugins	0	07-14-2013 06:39 PM
[GUI Plugin] Plugin Updater Deprecated	kiwidude	Plugins	159	06-19-2011 12:27 PM