[GUI Plugin] FanFicFare

[JimmXinu]

I still don't understand exactly what you're trying to do--where are you getting a list of story URLs where some of them don't exist?

But I believe the answer is going to be No, there isn't a way to magically know which links are to stories that have been removed.

[Tanjamuse]

Thanks anyway.

[noirverse]

Originally Posted by JimmXinu

@noirverse - What goes in Calibre's Tags field is controlled by FFF's personal.ini settings include_subject_tags and extra_subject_tags. (This is a bit different than other metadata for historical reasons.)

In your personal.ini, you can set the value to something else:

[defaults]

## The default value is: 
## include_subject_tags: extratags, genre, category, characters, ships, status

## remove all from tags:
include_subject_tags:

Thank you for the help! I've edited the code to remove extratags from the regular tag section. This helps quite a bit, but curiously, I still have the tag "FanFiction" showing up in the main tag column and now my custom ships column blanks out when I try to update the metadata (which I've made sure was set to Relationships). My other custom columns work just fine so I'm not sure what's the deal there.

[noirverse]

Originally Posted by JimmXinu

@noirverse - What goes in Calibre's Tags field is controlled by FFF's personal.ini settings include_subject_tags and extra_subject_tags. (This is a bit different than other metadata for historical reasons.)

In your personal.ini, you can set the value to something else:

Thank you for the help! I've set the code to exclude extratags for the main tag column. However, curiously, the main tag column still inputs the "FanFiction" tag and adjusting the code so that it excludes categories doesn't seem to help. Along with that, my ships column now blanks out while the rest of the columns I've added work fine with picking up metadata. I'm not sure how to fix these things.

[JimmXinu]

Originally Posted by noirverse

Thank you for the help! I've set the code to exclude extratags for the main tag column. However, curiously, the main tag column still inputs the "FanFiction" tag and adjusting the code so that it excludes categories doesn't seem to help. Along with that, my ships column now blanks out while the rest of the columns I've added work fine with picking up metadata. I'm not sure how to fix these things.

Do you have the "Keep Existing Tags when Updating Metadata?" option checked on the FFF 'Basic' settings tab? If you do, then FFF won't remove those tags, it just won't add them again.

Changes to include_subject_tags shouldn't affect custom columns. If your other columns work and you're setting it from custom_columns_settings I would suspect a typo on that line. Or maybe replace_metadata settings that accidentally remove the ships. Or you're testing with a story that doesn't have any ships.

I'd need to see a storyURL and a copy of your personal.ini (see the 'View "Save" personal.ini' button) to help anymore than that.

[serana]

Ah, it seems the forum just ate my questions. Anyway, here I go again.

First of all, a huge THANK YOU to JimmXinu for this fantastic plugin! I've been using it for a while and I absolutely love it .

Regarding the updating feature:

Does FFF only add a new chapter or does it also replace older, modified (e.g. edited after I downloaded them initially) chapters? If a chapter gets deleted from FFN/AO3, does FFF delete that chapter from calibre, as well?

I'd also like to know if it's possible to run the updating of new chapters and the updating of metadata at the same time. As far as I figured during my fiddling with it, it's only possible to do either. Meaning, a story will get updated on the chapter and on the metadata if it has a new chapter, but it won't get a metadata update if there's no new chapter. I noticed that when I had to populate a couple of new custom columns with the last update-date. How can I tell FFF to do both?

I couldn't find anything on that, but I'll gladly read up on it, in case I missed it somewhere!

Thank you for all your hard work and constant support! I really appreciate it .

[FanFicFareFan]

Hi! First off, I'd just like to say how much I love FFF. I use it all the time!

That said, I seem to be experiencing a problem. I can no longer seem do download from index posts in SB. Tried it with the example post you showed on Github ("Silence") and in both cases, only the individual post is downloaded, like a one-shot post, but the post at the top of the page is being used for the comments/first page. Is it an issue with my settings, the latest build or a matter with SB itself? Normal threadmark downloads still seem to work.

[noirverse]

Originally Posted by JimmXinu

Do you have the "Keep Existing Tags when Updating Metadata?" option checked on the FFF 'Basic' settings tab? If you do, then FFF won't remove those tags, it just won't add them again.

Changes to include_subject_tags shouldn't affect custom columns. If your other columns work and you're setting it from custom_columns_settings I would suspect a typo on that line. Or maybe replace_metadata settings that accidentally remove the ships. Or you're testing with a story that doesn't have any ships.

I'd need to see a storyURL and a copy of your personal.ini (see the 'View "Save" personal.ini' button) to help anymore than that.

Thank you, I fiddled with the code, stripping anything that wasn't what I wanted and managed to fix the issue I was having!

[JimmXinu]

(multi-reply)

Originally Posted by serana

First of all, a huge THANK YOU to JimmXinu for this fantastic plugin! I've been using it for a while and I absolutely love it .

Originally Posted by serana

Does FFF only add a new chapter or does it also replace older, modified (e.g. edited after I downloaded them initially) chapters? If a chapter gets deleted from FFN/AO3, does FFF delete that chapter from calibre, as well?

This actually depends on number of chapters, how the site assigns chapter urls, and (possibly) what the author did.

FFF's default update, Update EPUB if New Chapters decides whether to update or not purely by chapter count. If the site has more chapters, it goes into update, if not, it doesn't. It would be more accurately named 'if MORE chapters'.

If the site has more chapters (or you invoked Update EPUB Always), FFF looks at the chapter URLs fetched from the site and the chapter URLs saved in the epub, and fetches any chapters it doesn't already have. If FFF already has a chapter downloaded for a chapter URL, it does not download it again.

So if an author deletes a chapter and adds another one on a site like ffnet that simply numbers chapters, FFF has no way to know. On a site like AO3, the same operation will have a different chapter number and be detected and downloaded.

On sites like SV/SB, if an author removes a post from the threadmarks(aka chapter list) and adds a different one, it will be detected. But if they edit the existing post, it will not.

On large fics, I personally use Calibre's Edit book feature to remove chapters I know the author has changed before running FFF update again. I don't have a better solution at this time.

Originally Posted by serana

I'd also like to know if it's possible to run the updating of new chapters and the updating of metadata at the same time. As far as I figured during my fiddling with it, it's only possible to do either. Meaning, a story will get updated on the chapter and on the metadata if it has a new chapter, but it won't get a metadata update if there's no new chapter. I noticed that when I had to populate a couple of new custom columns with the last update-date. How can I tell FFF to do both?

If I understand you correctly, Update EPUB Always will do what you want.

However, if you created and set a Saved Metadata Column, you can use Update Calibre Metadata from Saved Metadata Column to fill in new custom columns using the metadata gathered on your last download.

Originally Posted by FanFicFareFan

Hi! First off, I'd just like to say how much I love FFF. I use it all the time!

Originally Posted by FanFicFareFan

That said, I seem to be experiencing a problem. I can no longer seem do download from index posts in SB. Tried it with the example post you showed on Github ("Silence") and in both cases, only the individual post is downloaded, like a one-shot post, but the post at the top of the page is being used for the comments/first page. Is it an issue with my settings, the latest build or a matter with SB itself? Normal threadmark downloads still seem to work.

Please include story URLs when reporting issues. I assume you mean Silent.

It looks like there is a bug I introduced last month while refactoring for an upcoming SV change. I'll post a new test version once I have it figured out.

The more common cases of threadmarks and first-post index look fine.

Originally Posted by noirverse

Thank you, I fiddled with the code, stripping anything that wasn't what I wanted and managed to fix the issue I was having!

[JimmXinu]

New Test Version Posted

2018-06-22
- Fix for regression on XF not-first index post.
- Fix for a corner-case global_cache written by py2, then read by py3 bug.

[FanFicFareFan]

That seems to have done the trick, it's downloading index posts again. But it seems to have borked the message for when you try to update a fic and there are no new updates. It now results in the message of "Existing epub contains xx chapters, web site only has 1. Use Overwrite to force update." While it still functionally works at it should, I thought you'd like to know, since this is the same error message from the bug that kept me from being able to download index posts.

[JimmXinu]

@FanFicFareFan - Did you restart calibre after installing the plugin?

Because that sounds like it's only partly updated the plugin. IE, for background processes, but not the GUI in memory.

[FanFicFareFan]

Yup, turned off the whole thing then turned it on again. Will try again later and see if it's still the same. Perhaps it wasn't shut down for long enough. As I said, functionally, it works as intended and desired, with the exception of that particular warning message.

[nexusflamehart]

Hey, I just installed FanFicFare to download a certain Quest on QuestionableQuesting that I'm a big fan of, but for one reason or another the plugin hasn't been working for me.

I don't know if this is because of something wrong on my end, if the story is too long, or if there is a problem with Calibre, but I would like to get this fixed if it is at all possible.

[JimmXinu]

Please describe "hasn't been working for me".

Because I was able to download it. (I am using the most recent test version, tho.)

Note that it does have 4.5 million words, 1,003 chapters and 951 images.

Which is why it took 2 hours and 47 minutes to download.