[GUI Plugin] FanFicFare

[Minotaur]

Hi all.
Wonderinf if FFF is able to retain previously downloaded chapters if they're found to be missing when a book is refreshed? An example would be where a RoyalRoad auther removes a bunch of chapters because they've been released on Kindle Unlimited.
Cheers.

[JimmXinu]

Some variation of this comes up every so often. Here's a past answer that may help.

Originally Posted by JimmXinu

FFF primarily just looks at the number of chapters. Some sites have unique chapter URLs, so if a chapter is replaced the chapter URL would change and FFF would replace it on next update (Update Always needed if no additional chapters to trigger update).

However, for sites that just number chapter URLs, you'll need to either manually delete the changed chapter from the EPUB or do Overwrite to get the new one.

FFF does not have a way to keep deleted chapters. Best option would be to rename the old one(book) and remove the story URL in Calibre, then keep a different copy as the 'proper' version.

I know it's been discussed more times, but I'm not having great look searching for it.

For detailed descriptions of how the different update modes work, see the wiki page.

[Atherton25]

With old stories, I do essentially with JimmXinu said. I add a tag to the title (old) ... sometimes with numbers IE (old2) and just remove the URL. Then redownload the book as a whole with the current chapters. I actually have another tag #FFFREM so I can remove\filter them from my current FFF list when I'm highlighting stuff to update too, just to make it easier for the rare times I update that way.

If I really need to later I can take out the chapters in conjunction with the newer book and then merge books, but I rarely do something like that. There are several newer large webfictions like He Who Fights Monsters and Defiance of the Fall that regularly remove old chapters to allow for Kindle Unlimited, and it's just a fact of life. While it'd be nice for a way around this without adding another book, that's likely too much work on the backend, and it works the way it is now.

[JimmXinu]

Keeping chapters that are no longer in the TOC list according to the site would break the paradigm too much. I know I've researched it before.

I could help a little bit by adding a feature to ignore books in the library marked with a certain tag so you don't have to remove the identifier:url. I assume users would still change the title, but they wouldn't have to.

I hesitate because a) I haven't looked through all the ramifications; and b) it's inevitable that someone will set that tag and then complain when when does it's job.

It would be nice, however, to have a one-step(ish) solution instead of: change title and remove identifier:url and remove story URL from epub (depending on settings and use).

[ownedbycats]

Theoretically, could the 'ignore specific tag' also apply to any metadata column? The few 'old versions of extensively rewritten fics' I have set to #fanficstatus: Abandoned, which is an enumerated (fixed-value text) column.

Seeing as everything else in Abandoned is dead links, it makes sense to have FFF skip those over anyways.

[JimmXinu]

That's a third reason for hesitation I thought of, but didn't mention: The fact some users would want a tag value, some a true/false cust column, some their own special value present or absent in a custom column, etc, etc.

Right now, only a standard column Tags value is on the table. However, I would allow it to be configurable for the benefit of non-English users.

Books with that tag would be ignored when looking for matching books for update/overwrite/skip with story URL or by title/author, and attempts to update such books directly would fail with a new message mentioning the tag value.

[Mandabar]

Good timezone folks. I'm having a slight issue here. A story I follow deleted themselves from Royalroad.
Master of the Loop beddedOtaku https://www.royalroad.com/fiction/46407

Ok fine right? A little research and I see there is a mirrored copy over on webnovel. Maybe they deleted for exclusivity reasons? Meh doesn't matter. I go to download the book from there, after checking to be sure the website is supported, and it doesn't work.

Not sure what the issue is, but looking over some of the version change info (for FFF) it seems likely the site may have changed in a way to mess with FFF's scraping? Regardless here is the link to the story on webnovel [https://www.webnovel.com/book/master...9424205207205]. My error shown in the log under the comments column is 'volumeItems'.

[JimmXinu]

webnovel.com has changed their site again to actually encrypt the chapter list and decrypt it javascript.

See #843; what I last said about it there:

TL;DR: Might be fixable, but I personally lack the ambition--especially since they could well just change it again.

It is reported that WebToEpub still works with it.

[Mandabar]

Originally Posted by JimmXinu

webnovel.com has changed their site again to actually encrypt the chapter list and decrypt it javascript.

I figured it was something like that. Sigh.

It is reported that WebToEpub still works with it.

It did indeed work, though of course it is not ideal. Was able to copy over the newer chapters manually at least.

Thanks Jim!

[JimmXinu]

New Test Version Posted

2022-06-05
- adapter_mcstoriescom Allow multiple authors. Closes #847

[idiom6]

Can someone walk me through how to change the settings to get gmail to still work? I've activated 2 step authentification and changed the password to the app password google generated on both the gmail account and FFF, but FFF still won't log me in.

calibre, version 4.23.0
ERROR: Unhandled exception: <b>error</b>:[ALERT] Application-specific password required: https://support.google.com/accounts/answer/185833 (Failure)

calibre 4.23 [64bit]  embedded-python: True is64bit: True
Windows-7-6.1.7601-SP1 Windows ('64bit', 'WindowsPE')
('Windows', '7', '6.1.7601')
Python 2.7.16+
Windows: ('7', '6.1.7601', 'SP1', u'Multiprocessor Free')
Interface language: None
Successfully initialized third party plugins: Gather KFX-ZIP (from KFX Input) (1, 48, 0) && DeDRM (6, 8, 0) && Package KFX (from KFX Input) (1, 48, 0) && EpubMerge (2, 13, 0) && FanFicFare (4, 13, 0) && Set KFX metadata (from KFX Output) (1, 61, 0) && KFX Output (1, 61, 0) && Reading List (1, 8, 0) && Find Duplicates (1, 8, 5) && KFX metadata reader (from KFX Input) (1, 48, 0) && KFX Input (1, 48, 0) && EpubSplit (3, 3, 0) && Goodreads (1, 5, 1) && Count Pages (1, 11, 2) && MultiColumnSearch (1, 0, 87) && Generate Cover (2, 1, 0) && View Manager (1, 8, 0)
Traceback (most recent call last):
  File "calibre_plugins.fanficfare_plugin.fff_plugin", line 573, in get_urls_from_imap_menu
  File "C:\Users\Lillian\AppData\Roaming\calibre\plugins\FanFicFare.zip\fanficfare\geturls.py", line 189, in get_urls_from_imap
  File "imaplib.py", line 523, in login
error: [ALERT] Application-specific password required: https://support.google.com/accounts/answer/185833 (Failure)

[Atherton25]

My gmail connection bombed today and kept erroring out... so I just:
1. Created a new email with GMX.
2. Set my old (singular purpose Gmail) email to forward to my new (singular purpose GMX) email.
3. Made sure my IMAP/POP3 ability was enabled (in settings) and switched over without any issue.

The whole process took about 10 minutes because I forwarded a few emails, had do deal with Gmail verifying forwarding email and things like that. Overall once I was done, FFF actually seems to be quicker to grab from GMX than my Gmail, as my Gmail retrieval seemed to lag more than occasionally sometimes taking 10+ minutes just to grab my emails.

Hopefully wont have to deal with google anymore, as they like to push the limit and make it difficult for the small people (us) whenever they feel the need to kick someone.

[ackomb]

Originally Posted by idiom6

Can someone walk me through how to change the settings to get gmail to still work? I've activated 2 step authentification and changed the password to the app password google generated on both the gmail account and FFF, but FFF still won't log me in.

I think you are looking at it the wrong way, you can keep trying to push a square into a round hole, or you can just put in the minimum effort of creating a different e-mail account just for FFF.

Gmail just kept tripping me, in the end I gave up and took the easy road of creating a non-gmail email address just for this specific purpose. At the start I just created a rule that automatically moved the e-mail from one account to the other in outlook (but oulook sucks too sometimes), so pretty soon I just changed my accounts on AO3 and FF and it's been pretty smooth sailing from there-on out.

You might find the solution but then BAM google changes things up again and you're back at square one.

[JimmXinu]

Originally Posted by idiom6

Can someone walk me through how to change the settings to get gmail to still work? I've activated 2 step authentification and changed the password to the app password google generated on both the gmail account and FFF, but FFF still won't log me in.

The 'app password's that google generates are meant to be different from your general gmail account password--and from other 'insecure' apps that you need passwords for.

It sounds like you either changed your gmail account password to the generated, or used it to log in someplace other than FFF. Generate a new 'app password' for FFF and only use it there.

[JimmXinu]

New Test Version Posted

2022-06-08
- adapter_readonlymindcom: Add include_author_notes setting - See #850, thanks FayeGray!