[GUI Plugin] FanFicFare

[Ascello]

When I make an Anthology FFF adds Completed/In-Progress to my standard Tags column. I don't want it, since I have custom column for this that also gets updated. How do I stop it from adding that tag?

EDIT: Sorry for two msgs in a row, but I didn't notice that my previous post is still the very last one.

[JimmXinu]

Originally Posted by Ascello

When I make an Anthology FFF adds Completed/In-Progress to my standard Tags column. I don't want it, since I have custom column for this that also gets updated. How do I stop it from adding that tag?

EDIT: Sorry for two msgs in a row, but I didn't notice that my previous post is still the very last one.

In absence of an example URL (hint-hint), I assume you are talking about an AO3 series.

A few sites (including AO3) have a status on their series page, which FFF picks up now. FFF plugin has code to put that series status in tags, and the merged book status entry.

There currently isn't a way to remove it because it happens in the plugin after all of FFF's replace_metadata etc processing.

Unrelated FYI: ffnet word count

I'm seeing ffnet where there are chapters updates, but the metadata shown hasn't been updated. I see it express as numWords being the same. (FFF takes numChapters from the actual chapter count, not metadata.)

There isn't anything FFF can do about this. Best solution, wait a while (30m?) before updating when you get a notification.

[JimmXinu]

New Version Released

Version 3.29.0 - 20 Jan 2021
- Re-enable adapter_fanfictionnet and bump up sleep times for same.
- Update translations.
- Add better chapter error reporting, refactor proceed_question code.
- Add plugin options to mark success/failed/chapter error individually.
- Clear metadata cache after adapter metadata fetch. Cached metadata values may not be replace_metadata processed if fetched before their conditional dependencies. Revealed by AO3 one-shots using title for chapter name.
- ffnet fpcom, continue_on_chapter_error:true by default, increase sleep times.
- First rough version of reporting continue_on_chapter_error chapters.
- Report chapter_error in custom error column and marked (when configured).
- Update to cloudscraper v1.2.52
- Increase times between retries on fetch error.
- Tweek ffnet/fpcom sleep times again.
- slow_down_sleep_time: randomize between 0.5 time and 1.5 time.
- Report cloudscraper exceptions as such, plus hide the potentially misleading 'opensource' part.
- adapter_fanficsme: do an extra fetch before login for cookie(?) Closes #633
- adapter_webnovelcom: Fixes for site changes. Closes #629
- quotev.com: site change in date parse, use utf8:ignore as first encoding choice. Closes #625

[JimmXinu]

New Test Version Posted

2021-01-20
- adapter_fanfictionnet: Start keeping story title part of storyUrl.

This is for two reasons:

1. I noticed that ffnet pages with the story title in the URL appear to be updated sooner than those without.
2. Also, while working on branch ffnet-chrome-cache-fetch (see also #635), using ffnet urls with title in would be useful.

Chapter URLs as stored in epub are still 'normalized' so that this doesn't cause existing chapters to all become invalid, but story title is used when fetching chapters.

Also, I put in a bit of kludge code in the plugin so that updates that add a title to the story URL will still find the existing ebooks without tripping the 'url changed' notification.

I think I've gotten this all correct.

[ownedbycats]

Not a huge issue, but would it be too much trouble to add the version number (3.29.1) next to the date in post 2? Sometimes I lose track of which test version I have.

[JimmXinu]

Since I would have to manually type that in each time, my 'everytime' trumps your 'sometimes'.

(Especially as I have a habit of typing numbers wrong. There's a reason I do version updates with scripts....)

[icecold]

Is there a way to download images that are linked to but aren't inline? I searched the defaults .ini and couldn't find any option that would work. I assume the reason is that it's too much of a hassle to implement or just not possible.

[JimmXinu]

As in, an <a> tag link to an image (and likely an image page) instead of an <img> tag?

That level of spidering is beyond what I'm prepared to support.

[icecold]

An <a> tag link to an image page. Yeah, I thought that it wouldn't supported, just wanted to ask to be sure.

I guess I'm stuck with pasting the images into the ebook.

[ownedbycats]

Originally Posted by JimmXinu

I'm seeing ffnet where there are chapters updates, but the metadata shown hasn't been updated. I see it express as numWords being the same. (FFF takes numChapters from the actual chapter count, not metadata.)

There isn't anything FFF can do about this. Best solution, wait a while (30m?) before updating when you get a notification.

I noticed this happens with the RSS feed sometimes. It's a bit annoying because the updates still have the old date and I sort by date, so they get a bit buried.

Just curious, what exactly does FFF use to determine there's an update? The number of chapters, date (note that AO3 lets authors set arbitrary dates—I did this when crossposting my older ffnet fics), a combination of both, or it depends on the adapter?

[JimmXinu]

'Update EPUB if New Chapters' compares chapter count in epub vs collected metadata numChapters. numChapters is virtually always the count of chapters found, not the number shown.


'Overwrite if Newer' compares ebook filesystem timestamp vs collected metadata dateUpdated. dateUpdated is collected from the story metadata and its exact source can vary. Some sites report date on each chapter, but not an overall last-updated-date, for example.

And, yes, this can have issues with timezones (python2 timezone support is virtually non-existent). Or if site/authors lie about updated date. Or if your files' timestamps are touched.

[ownedbycats]

The timezone issue came up pretty recently, actually. I downloaded a oneshot in the evening, and the date (presumably using GMT time) was dated for the next day.

[jklly12]

Originally Posted by JimmXinu

New Version Released

Version 3.29.0 - 20 Jan 2021
- Re-enable adapter_fanfictionnet and bump up sleep times for same.
- Update translations.
- Add better chapter error reporting, refactor proceed_question code.
- Add plugin options to mark success/failed/chapter error individually.
- Clear metadata cache after adapter metadata fetch. Cached metadata values may not be replace_metadata processed if fetched before their conditional dependencies. Revealed by AO3 one-shots using title for chapter name.
- ffnet fpcom, continue_on_chapter_error:true by default, increase sleep times.
- First rough version of reporting continue_on_chapter_error chapters.
- Report chapter_error in custom error column and marked (when configured).
- Update to cloudscraper v1.2.52
- Increase times between retries on fetch error.
- Tweek ffnet/fpcom sleep times again.
- slow_down_sleep_time: randomize between 0.5 time and 1.5 time.
- Report cloudscraper exceptions as such, plus hide the potentially misleading 'opensource' part.
- adapter_fanficsme: do an extra fetch before login for cookie(?) Closes #633
- adapter_webnovelcom: Fixes for site changes. Closes #629
- quotev.com: site change in date parse, use utf8:ignore as first encoding choice. Closes #625

I updated and keep getting Failed as an error every story I try to updat? something blocking it?

[darth1]

Jim @ about 1pm (UTC+12:00) Auckland, Wellington
got this VVV
+-+-+-+-+-+-
Status
Title
Author
Comment
URL
Error
Echoes of the Life
Nanya
cloudscraper reports: "Detected a Cloudflare version 2 challenge, This feature is not available...."
https://www.fanfiction.net/s/13523316/1/



and
https://www.fanfiction.net/s/3766574...e-Dark-Kingdom

[ownedbycats]

I can confirm it as of the time of this post. But FictionPress is still doing their migration, so try again in a few hours. Another user had it happen, then go away.