[GUI Plugin] FanFicFare

[JimmXinu]

Originally Posted by ownedbycats

...
Do I safely assume that add_to_replace_metadata always runs after replace_metadata?

It's a bit complicated, see add_to_keyword in the wiki page.

[John Maverick]

Normally when getting urls from email, urls that are in the URL reject list are ignored and don't show in the dialog box to update stories.

But from some reason FFF don't ignore urls from fiction.live that are in the URL reject list when getting urls from email.

Curiously when I do clic in the "Accept" button of the dialog box to update stories FFF asks if those same url should be rejected because they're in the URL reject list as normally.

I have checked and somehow when adding a new url to the reject list of fiction.live, the url saved in the list has an additional slash between "stories" and the "UUID"

Example:
URL of the story:

https://fiction.live/stories/HkxT2yPDrcWt29ZGf

URL saved in URL reject list

https://fiction.live/stories//HkxT2yPDrcWt29ZGf

So maybe that is the reason because FFF didn't fint the url in the reject list when searching form email, but it found it from the update dialog box. Are the methods to search urls in the reject list different in one case or the other?

-----

Also, another peculiarity with notification emails from fiction.live. At the end of the emails there is a link to unsubscribe from all notifications. That link isn't a story link, but somehow is get as one when getting urls from emails.

Unsubscribe URL example:

https://fiction.live/api/unsubscribe/USER-NAME-HERE/SOME-LONG-STRING

My setup is the following:
OS: Linux Mint 21.1 x86_64
Calibre version: 6.11
FanFicFare version: v4.19.0

Like always thanks in advance.

[JimmXinu]

2023-01-26
- Fixes for adapter_fictionlive story URLs-normalize & skip unsub URL

Originally Posted by John Maverick

Normally when getting urls from email, urls that are in the URL reject list are ignored and don't show in the dialog box to update stories.
...

John Maverick, I didn't write the adapter for fiction.live and I've never looked at the adapter or the site in any detail. So I'm relying on you to test this with more than the one story.

FFF doesn't accept https://fiction.live/stories/HkxT2yPDrcWt29ZGf -- FFF normalizes the URL to have that extra slash because that's where the title usually is. I assume that the fiction.live used to require it.

So FFF doesn't pick up https://fiction.live/stories/HkxT2yPDrcWt29ZGf from email for me.

Assuming you actually do get URLs with a title, this version should help with reject list and skipping the unsub URL.

[John Maverick]

I have test with some urls and notification emails from that site and all works fine. Also the unsubscribe url isn't get.

Thanks for your fast response JimmXinu.

[ownedbycats]

Question: On an ffnet fic with 58 chapters (1-57 previously downloaded), is it expected behaviour for open_pages_in_browser to open a nonexistent chapter 59 several times? (The download worked.)

[JimmXinu]

Originally Posted by ownedbycats

Question: On an ffnet fic with 58 chapters (1-57 previously downloaded), is it expected behaviour for open_pages_in_browser to open a nonexistent chapter 59 several times? (The download worked.)

If you have check_next_chapter:true, yes. 'Not found' chapters return a no-cache response, so there's nothing in the cache to find.

[ownedbycats]

Regex issues again

Two fics with these cats:

<li>Mass Effect Trilogy</li>
<li>Mass Effect - All Media Types</li>
<li>Mass Effect 2 - Fandom</li>

replace_metadata:

 category=> \([0-9]+\)| \(Video Game\)| \(Video Games\)|(- Fandom)|(|- Fandom\(Movies\)|\(Movie [0-9]+\)| \(Comics\)| \(TV\))$=>
## Splitting up Mass Effect into Trilogy and Andromeda 
 category=>^(Mass Effect - (Various Authors|All Media Types)|Mass Effect: Paragon Lost|Mass Effect \d)$=>Mass Effect
 category=>^Mass Effect$=>Mass Effect: Andromeda&&characters=~Ryder
 category=>^Mass Effect$=>Mass Effect Trilogy

Expected result: Mass Effect Trilogy
Actual result: Crossover, Mass Effect 2, Mass Effect Trilogy

What went wrong? I expected Mass Effect 2 - Fandom > Mass Effect 2 > Mass Effect > Mass Effect Trilogy.

[JimmXinu]

Originally Posted by ownedbycats

Regex issues again

I suspect it's a space after the 2. You're stripping - Fandom leaving Mass Effect 2_(underscore for space) which doesn't match '^Mass Effect \d$'.

By the time it gets to final output, the trailing space has been removed, but it's still there during processing.

I haven't tested it beyond the two fics given above, but I'd try something like this as a replacement for your first line. But it does remove a few additional things you didn't before, '(Movie)' and '(Movies)' for example, not just '(Movie 5)' or '- Fandom(Movies)'

## Everything you want to remove that comes in ( ) at the end of a category
## with optional spaces around the '('  ')' characters
 category=>[ ]*\([ ]*([0-9]+|Video[ ]*Games?|Movies?[ ]*[0-9]*|Comics|TV)[ ]*\)[ ]*$=>
 category=>[ ]*-[ ]*Fandom[ ]*$=>

Or just add [ ]* in front of - Fandom. I'd use it instead of most or all of the spaces just because you never know when an AO3 author will have spaces or not.

[ownedbycats]

that works! thanks

[ownedbycats]

PSA for ffnet users using Outlook.com. Logged into my account and got this nice notice:

We have recently logged an email delivery problem to your inbox at: [redacted]@outlook.com. As result, we have DISABLED all alert features for your account. Once you have resolved your email issues, you can re-enable alert features here.

Error Time: 01/26/2023
Error Message: Email provider rejected our email.

Please follow the guidelines below to ensure our emails are safely delivered to your inbox:
Add bot@fanfiction.com to your email account's Contact List/White List/Safe List.
Do not tag our emails as spam.
Check your Spam/Trash folder to see if our email is mis-categorized. If any are found, please mark them as 'Not Spam'.
Make sure your email account is not full/over-quota.

Will try to whitelist but it might be blocking it further up.

[famewolf]

Can anyone recommend how i can use this plugin with https://wanderinginn.com/ ?

[ownedbycats]

Originally Posted by ownedbycats

PSA for ffnet users using Outlook.com. Logged into my account and got this nice notice:



Will try to whitelist but it might be blocking it further up.

Update: Added the site to my whitelist and just got an update email. Either the whitelist worked or it was just a temporary glitch.

[ownedbycats]

New question: When downloading ffnet, why does FFF check the author page (and open it if not in cache)?

[JimmXinu]

Originally Posted by famewolf

Can anyone recommend how i can use this plugin with https://wanderinginn.com/ ?

"Since it's original fiction and the author is also publishing their story via Amazon, I don't feel this is appropriate for FFF."
https://github.com/JimmXinu/FanFicFare/issues/789

Originally Posted by ownedbycats

New question: When downloading ffnet, why does FFF check the author page (and open it if not in cache)?

skip_author_cover is true by default.

## April 2015, ffnet changed their story and user pictures urls to be
## the same.  Now the only way to know if the story image is really
## the author image is to go get the author image and check.
skip_author_cover:true

[JimmXinu]

New Version Released

Version 4.20.0 - 2023-02-02
- Fixes for adapter_fictionlive story URLs-normalize & skip unsub URL
- adapter_deviantartcom date changes #910, thanks bugmaschine
- Revamp retries for browser cache with open_pages_in_browser
- Fix for & in chapter title.
- Add r_anthmax/n_anthmax options for custom_columns_settings
- Fixed the Deviantart adapter not detecting that a Deviation is Marked as needing a login, thanks bugmaschine
- Skip day of week for localization in browsercache_firefox2
- Move makeDate to dateutils to call from browsercache_firefox2
- adapter_mediaminerorg: Updates for site changes
- adapter_fastnovelsnet: Fixes for site changes -- tested with use_flaresolverr_proxy
- Update language->langcode mapping for updated AO3 list
- Browser Cache Refactor & open_pages_in_browser feature
See PR #905 and this MR post.
- Fixes for config base_xenforo options, closes #902
- Fix for adapter_quotevcom status
- Equalize ok/cancel buttons on user/pass & email pass dialogs
- adapter_ficbooknet: Site change for status + remove debug
- Tweak for adapter_storiesonlinenet description parsing