[GUI Plugin] FanFicFare

[JimmXinu]

That site is already supported, if only with http (not https).

I'll tweak the code to allow https URLs too.

In the meantime, just use http://chosentwofanfic.com instead of https.

[grimorie]

Great! Thank you so much!

Er, one hitch, it seems I can't download multi chapters or series? I keep getting "list index out of range"

[JimmXinu]

New Test Version Posted

2022-05-31
- adapter_chosentwofanficcom: http->https

[JimmXinu]

Originally Posted by grimorie

Great! Thank you so much!

Er, one hitch, it seems I can't download multi chapters or series? I keep getting "list index out of range"

I'm not seeing that. Story URL?

[ownedbycats]

For this fanfic, I was trying to change the description so that the two links pointed to my local copies of the fic.

[https://archiveofourown.org/works/34149469]
add_to_replace_metadata:
 description=>\"https://archiveofourown\.org/works/32414443\">=>\"calibre://show-book/_hex_-4d795f426f6f6b73/3424\"

However, it resulted in the link getting deleted entirely ("and Fred's .").

Did I mess up, or is it just not possible to modify the html like this?

[JimmXinu]

Originally Posted by ownedbycats

For this fanfic, I was trying to change the description so that the two links pointed to my local copies of the fic.

[https://archiveofourown.org/works/34149469]
add_to_replace_metadata:
 description=>\"https://archiveofourown\.org/works/32414443\">=>\"calibre://show-book/_hex_-4d795f426f6f6b73/3424\"

However, it resulted in the link getting deleted entirely ("and Fred's .").

Did I mess up, or is it just not possible to modify the html like this?

Wow. Does it get lonely being that far out there?

Don't escape the " chars, it isn't needed. And you are removing the trailing > of the a tag, but not replacing it. Fix those and the substitution works; I could see the changed URL in description. But I couldn't test the link because I have no idea how to get the calibre UUID for a book.

[JimmXinu]

New Version Released

Version 4.13.0 - 2022-06-01
- Update translations.
- adapter_chosentwofanficcom: http->https
- adapter_mediaminerorg: More story URL forms. #845
- Don't set marked in Calibre when book_id is None #833
- adapter_quotevcom: Update collection of searchtags
- Add config check parsing for custom_columns_settings on personal.ini save.
- Refactor img code in story.py to fix a problem when cover image also in story.
- fastnovel.net -> fastnovels.net - Rename adapter_fastnovelsnet - Fixes for site changes
- fix storiesonline login (again) - parameter name was changed back to "email" (#840) - Thanks mvlcek!
- adapter_webnovelcom: Not all paragraphs starting with '<' are HTML. #841
- Lighten color highlighting for storyUrls sections in dark mode.
- fix storiesonline login - thanks, mvlcek!
- adapter_ficbooknet: Fix for site change.
- adapter_wwwutopiastoriescom: Fixes for site changes.
- adapter_fanficsme: Fix for changed 'words' metadata.
- Remove site tomparisdorm.com - Moved to AO3
- Remove site: bloodties-fans.com - Moved to AO3.
- Remove site wuxiaworld.com Closes #796
- Remove site wuxiaworld.site Closes #758

[ownedbycats]

Originally Posted by JimmXinu

Wow. Does it get lonely being that far out there?

Don't escape the " chars, it isn't needed. And you are removing the trailing > of the a tag, but not replacing it. Fix those and the substitution works; I could see the changed URL in description. But I couldn't test the link because I have no idea how to get the calibre UUID for a book.

Thanks. I also had to remove the trailing '\' at the end of the replacement link. It works now.

[DirCat]

Is anyone else having issues with the Get Story URLs From Email with the new version? It told me my login credentials were wrong (they haven't changed). I went ahead and re-entered my password anyway, but it still didn't work.

If it makes a difference, I am using GMail for this.

The error I am getting is:

Spoiler:

calibre, version 5.43.0
ERROR: Unhandled exception: <b>error</b>:b'[AUTHENTICATIONFAILED] Invalid credentials (Failure)'

calibre 5.43 embedded-python: True is64bit: True
Linux-5.4.0-113-generic-x86_64-with-glibc2.2.5 Linux ('64bit', 'ELF')
('Linux', '5.4.0-113-generic', '#127-Ubuntu SMP Wed May 18 14:30:56 UTC 2022')
Python 3.8.5
Interface language: None
Successfully initialized third party plugins: Count Pages (1, 11, 2) && FanFicFare (4, 13, 0) && Generate Cover (2, 1, 0) && Resize Cover (1, 1, 0) && Save Composite Custom Columns (1, 1, 1) && View Manager (1, 8, 0)
Traceback (most recent call last):
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 569, in get_urls_from_imap_menu
url_list = get_urls_from_imap(prefs['imapserver'],
File "/media/dcarwyr/64d4736b-8fcf-47aa-9afd-5cf1fa13e1aa/calibre-portable/CalibreConfig/plugins/FanFicFare.zip/fanficfare/geturls.py", line 189, in get_urls_from_imap
status = mail.login(user, passwd)
File "imaplib.py", line 603, in login
imaplib.IMAP4.error: b'[AUTHENTICATIONFAILED] Invalid credentials (Failure)'

[ownedbycats]

@JimmXinu -- Gmail recently dropped support for "less secure apps," whatever that means. OAuth 2.0 works but I don't know if FFF could use it.

[JimmXinu]

None of the IMAP code has changed in FFF. If something's different, I believe it's on the other end. You have to have your Gmail settings juuust right.

IMAP4 with user/pass is still working for me on the "Google Workspace" (formerly "Google Apps") account I use. I thought the 'dropped support for "less secure apps,"' was months ago?

Last time I looked into OAuth it was prohibitively difficult to do in FFF, but I don't remember why--possibly needing to basically launch a brower. I'll look into it again.

[ownedbycats]

It was finally dropped a few days ago. I had to fix my Thunderbird settings to use OAuth.

EDIT: Help article. Apparently it doesn't apply to Workplaces.

[JimmXinu]

OAuth continues to look very daunting from my POV.

However, the "Sign in with App Passwords" feature works for me on both my Gmail and Google Workspace accounts.

See:
https://support.google.com/accounts/answer/185833?hl=en

[DirCat]

Hmmm... It was working for a while. Maybe I need to change email providers. I created that account just for ebooks, since I didn't want access to others.

I just changed to Outlook email, moved the old emails to the account, and ran it successfully. Thanks!

[JimmXinu]

Google seems to be on a path towards requiring more security for GMail, with an apparent end point of requiring all apps accessing it:

1. To be 'verified', a process apparently very heavily tilted towards web services, not things like FFF, see link;
2. Use their RESTful APIs (instead of standard email IMAP4), preferably with their python libraries--which are some 30Mbytes vs FFF's current 1.8Mbytes; and
3. Authenticate through OAuth2, which requires a manual user interaction with Google in a browser, whether that's an instance started in FFF, or the user opening a URL in separate browser, and copying codes back and forth. No idea how often.

Gmail appears to be trying to pull into a more walled-garden kind of place in the name of security.

Which is kind of good--Email is really old and it's original security was non-existent. OTOH, it's also hilarious--you've already given all your data to Google, the largest data mining/advertising company to have ever existed.

I added Email fetching because it uses standard interfaces and was relatively easy. I have always included the warning:
It's safest if you create a separate email account that you use only for your story update notices. FanFicFare and calibre cannot guarantee that malicious code cannot get your email password once you've entered it.
Use this feature at your own risk.

For the time being, I think my official answer for GMail is going to be the "Sign in with App Passwords" feature. Bonus: It works with accounts set to two factor authentication.

If they do take away App Passwords too, GMail will probably become unsupported in FanFicFare and the answer will be 'use a different email provider for your separate fanfic notices account'.