[GUI Plugin] FanFicFare

[vikarti]

Originally Posted by JimmXinu

This is the third report in the last few weeks about Cloudflare getting in the way. (#488, #493)
I will continue to think about this, but so far I have no good ideas.

May be it's possible to get required cookie from browser? Even manually if necessary.
I don't use VPN but IP from my home connection resolves to gw.<mydomain>.com (I configured it this way with ISP long ago).

[JimmXinu]

New Version Released

Version 3.20.0 - 01 Jun 2020
- Add more URLs to cover_exclusion_regexp for base_xenforoforum.
- Fix for is_adult needing &showRestricted URL in adapter_harrypotterfanfictioncom.
- Better auth page parsing due to own-favorite story in adapter_harrypotterfanfictioncom.
- Add characters and increased category collection for adapter_fanfiktionde.
- Suppress output_css on CLI -z
- Fix numWords parsing in adapter_fanficsme.
- Update translations, add Russian.
- Fix broken series parsing in adapter_adastrafanficcom & adapter_lotrgficcom.
- New Site: www.silmarillionwritersguild.org, thanks Alistair!
- Allow /post/ story URLs with adapter_gravitytalescom.
- Change <td> to <div> in chapter text adapter_adultfanfictionorg
- Now actually *use* translated strings in prefs.py.
- Need to include prefs.py in messages.pot for translation.
- Update Translations.
- Catch exception in exception handling for French user.
- Remove '.' from numWords in adapter_fanfiktionde
- Fix for adapter_bloodshedversecom site changes.
- Find both 'Translator' and 'TranslatorS', except in Russian. adapter_fanficsme

[blake98]

I just tried to do a bulk update but ran onto the issue below where it seem to fail fir all of them stating a SSL: CERTIFICATE_VERIFY_FAILED. if I go to the link directly, I can see that the ao3 cert expires in 2021 not 2020 so I'm not sure why it's failing?

has anyone else run into this issue?

I've pasted the log information below

Spoiler:

Download 1 FanFiction Book(s)
FFF: INFO: 2020-06-01 15:26:50,134: calibre_plugins.fanficfare_plugin.jobs(53): FanFicFare v3.20.0
FFF: INFO: 2020-06-01 15:26:50,135: calibre_plugins.fanficfare_plugin.jobs(57): Adding jobs for URLs:
FFF: INFO: 2020-06-01 15:26:50,135: calibre_plugins.fanficfare_plugin.jobs(59): https://archiveofourown.org/works/18148910
FFF: INFO: 2020-06-01 15:26:55,713: calibre_plugins.fanficfare_plugin.jobs(95): Logfile for book ID 38181 (Hero)
FFF: INFO: 2020-06-01 15:26:55,717: calibre_plugins.fanficfare_plugin.jobs(96): urlhttps://archiveofourown.org/works/18148910) id38181)
FFF: INFO: 2020-06-01 15:26:52,342: calibre_plugins.fanficfare_plugin.fanficfare.adapt ers.adapter_archiveofourownorg(164): url: https://archiveofourown.org/works/18...iew_adult=true
FFF: INFO: 2020-06-01 15:26:52,342: calibre_plugins.fanficfare_plugin.fanficfare.adapt ers.adapter_archiveofourownorg(165): metaurl: https://archiveofourown.org/works/18...iew_adult=true
FFF: DEBUG: 2020-06-01 15:26:52,342: calibre_plugins.fanficfare_plugin.fanficfare.confi gurable(1133): #####################################
pagecache(GET) MISS: https://archiveofourown.org/works/18...iew_adult=true
FFF: DEBUG: 2020-06-01 15:26:55,490: calibre_plugins.fanficfare_plugin.fanficfare.confi gurable(1223): Caught an exception reading URL: https://archiveofourown.org/works/18...iew_adult=true sleeptime(0) Exception <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:727)>.
FFF: INFO: 2020-06-01 15:26:55,490: calibre_plugins.fanficfare_plugin.jobs(346): Exception: {u'collision': u'Overwrite if Newer', u'calibre_columns': {}, u'comment': u'<urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:727)>', u'pubdate': None, u'series': u'', u'site': 'archiveofourown.org', u'calibre_id': 38181, u'is_adult': False, u'end': None, u'author': [u'ThornedRose44'], u'showerror': True, u'comments': u'', u'outfile': u'C:\\Users\\AppData\\Local\\Temp\\calibre_eg8ypt\ \fanficfare_p0w34m\\bgmeta-w55x20.html', u'fileupdated': datetime.datetime(2020, 5, 26, 1, 15, 49), u'title': u'Hero', u'password': '', u'icon': u'dialog_error.png', u'status': u'Error', u'added': False, u'begin': None, u'username': 'NoneGiven', u'good': False, u'listorder': 0, u'publisher': u'archiveofourown.org', u'url': u'https://archiveofourown.org/works/18148910', u'author_sort': u'ThornedRose44'}:<urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:727)>
Traceback (most recent call last):
File "calibre_plugins.fanficfare_plugin.jobs", line 195, in do_download_for_worker
File "calibre_plugins.fanficfare_plugin.fanficfare.adap ters.base_adapter", line 297, in getStoryMetadataOnly
File "calibre_plugins.fanficfare_plugin.fanficfare.adap ters.base_adapter", line 381, in doExtractChapterUrlsAndMetadata
File "calibre_plugins.fanficfare_plugin.fanficfare.adap ters.adapter_archiveofourownorg", line 168, in extractChapterUrlsAndMetadata
File "calibre_plugins.fanficfare_plugin.fanficfare.conf igurable", line 1338, in _fetchUrl
File "calibre_plugins.fanficfare_plugin.fanficfare.conf igurable", line 1327, in _fetchUrlOpened
File "calibre_plugins.fanficfare_plugin.fanficfare.conf igurable", line 1208, in _fetchUrlOpened
File "calibre_plugins.fanficfare_plugin.fanficfare.conf igurable", line 1167, in _fetchUrlRawOpened
File "urllib2.py", line 429, in open
File "urllib2.py", line 447, in _open
File "urllib2.py", line 407, in _call_chain
File "urllib2.py", line 1241, in https_open
File "urllib2.py", line 1198, in do_open
URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:727)>

FFF: INFO: 2020-06-01 15:26:55,719: calibre_plugins.fanficfare_plugin.jobs(100):
Download Results:
Error https://archiveofourown.org/works/18148910 <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:727)>

FFF: INFO: 2020-06-01 15:26:55,720: calibre_plugins.fanficfare_plugin.jobs(124):
Error
https://archiveofourown.org/works/18148910

[JimmXinu]

Originally Posted by blake98

I just tried to do a bulk update but ran onto the issue below where it seem to fail fir all of them stating a SSL: CERTIFICATE_VERIFY_FAILED. if I go to the link directly, I can see that the ao3 cert expires in 2021 not 2020 so I'm not sure why it's failing?
...
https://archiveofourown.org/works/18148910

Have you tried the solution suggested in the SSL cert FAQ?

[blake98]

Originally Posted by JimmXinu

Have you tried the solution suggested in the SSL cert FAQ?

Thanks a bunch! I didn't realize this was the case (never happened before)
As I don't have IE/Edge installed on my desktop anymore (by design) I did this which worked just as well:

http://woshub.com/updating-trusted-r...in-windows-10/

[vikarti]

Also, about cloudflare - is it possible to make FFF support custom proxies?

[vikarti]

Originally Posted by JimmXinu

This is the third report in the last few weeks about Cloudflare getting in the way.

I will continue to think about this, but so far I have no good ideas.

I test ficbook and sufficientvelocity again and it works again. No error messages. Same home internet connection.

btw.
Small bug report in Russian translation: if file arleady have 43 chapters - FFF shows it as "Уже содержит 43глав" which is almost correct.
2 things are wrong: space between number and "глав" and it should be "43 главы"(declension is not taken in account, not sure if it's possible to easily fix this). Not su

[JimmXinu]

Originally Posted by vikarti

I test ficbook and sufficientvelocity again and it works again. No error messages. Same home internet connection.

I'm not seeing now either. Which is good, because trying to deal with it is... problematic. At best.

Originally Posted by vikarti

btw.
Small bug report in Russian translation: if file arleady have 43 chapters - FFF shows it as "Уже содержит 43глав" which is almost correct.
2 things are wrong: space between number and "глав" and it should be "43 главы"(declension is not taken in account, not sure if it's possible to easily fix this). Not su

FFF translations are handled through Transifex, as are my other plugins and Calibre itself.

If you'd like to help with translations, you can make an account there and directly enter translations for different strings.

[ownedbycats]

Just wanted to say thanks for all the work you do

[JimmXinu]

Originally Posted by ownedbycats

Just wanted to say thanks for all the work you do

[bigwoof]

Started using this to add fanfiction to my reading list

Thank you @JimmXinu for a fantastic plugin!! :-)

Just to check that I'm using it correctly. I've noticed that retrieving stories from fanfiction.net is really slow but I believe this is correct from what I saw under issue on github (due to rate limiting by fanfiction).

However, I found that whenever I try to update a story (when a new chapter is out), it always tells me that my story is in a different format from the version online and it can't compare chapters. I have to use the "Always replace epub" option to have the story be updated. Is this correct?

Thanks and once again thank you for a fantastic plugin!! :-)

[JimmXinu]

Originally Posted by bigwoof

However, I found that whenever I try to update a story (when a new chapter is out), it always tells me that my story is in a different format from the version online and it can't compare chapters. I have to use the "Always replace epub" option to have the story be updated. Is this correct?

Can you provide the exact error message? You could be able to copy/paste it. Also a story URL it happens for. And, ideally, if it happens again, stop and post a copy of the epub that says it's "a different format"? ("Family friendly", please.)

The only thing that makes sense off hand is if you are running something else on your epubs after FFF downloads them that changes the format.

[vikarti]

Originally Posted by JimmXinu

FFF translations are handled through Transifex, as are my other plugins and Calibre itself.

If you'd like to help with translations, you can make an account there and directly enter translations for different strings.

Done. (at least partially).
Thanks for plugin.

[firefoxxy]

Hi Jimm,

I just tried downloading/updating some stories from email and get the error: Not a ZIP file

Two example links:
https://www.fanfiction.net/s/13011659/1/
https://archiveofourown.org/works/18...pters/44025364

I'm using the current version of FFF.

[JimmXinu]

Originally Posted by firefoxxy

I just tried downloading/updating some stories from email and get the error: Not a ZIP file

Two example links:
https://www.fanfiction.net/s/13011659/1/
https://archiveofourown.org/works/18...pters/44025364

I'm using the current version of FFF.

I'm able to download those two stories to epub and then update them successfully.

I believe we've seen 'Not a ZIP file' appear before when someone was trying to write to a full disk. Are you able to successfully view the epubs before update?

Without seeing the epubs in question, I don't have anything else I can do to help you.