[GUI Plugin] FanFicFare

[JimmXinu]

Originally Posted by shaybella

What's going on?

Pretty clearly royalroad.com is blocking you. I'm not seeing it, so it's not (apparently) a general problem.

You may need to wait longer (days, not hours) or change your external IP.

[JimmXinu]

It looks like ffnet has increased their Cloudflare blocking level again.

As far as I know, there isn't anything more we can do in FFF than there was the last time this happened.

I suggest reviewing these resources:

FAQ:
https://github.com/JimmXinu/FanFicFa...-fanfictionnet

Browser Cache Feature:
https://github.com/JimmXinu/FanFicFa...erCacheFeature

Browser Proxy (third party):
https://github.com/nsapa/fanfictionnet_ff_proxy

[ownedbycats]

Question: use_browser_cache:true doesn't work unless I also enable use_browser_cache_only:true.

I had cached the first chapter of a fic and then the new chapters, but it tried to fall back to the site and got an error. However, enabling use_browser_cache_only made it work.

Any idea why this would happen? It's not a big issue to toggle it back on when ffnet's having issues but it's strange.


A second question: is there a way to make FFF handle AO3 fics with custom work skins more gracefully? e.g. [url=https://archiveofourown.org/works/28934610]downloading this[/results] urls in a lot of missing formatting.

[JimmXinu]

Originally Posted by ownedbycats

Question: use_browser_cache:true doesn't work unless I also enable use_browser_cache_only:true.

I had cached the first chapter of a fic and then the new chapters, but it tried to fall back to the site and got an error. However, enabling use_browser_cache_only made it work.

Without seeing the error or debug log I can only speculate.

But if you have check_next_chapter:true or skip_author_cover:true, you also need to manually try downloading one chapter more than listed for the fic or the author page and full size story image respectively.

Or turn those options off.

Originally Posted by ownedbycats

A second question: is there a way to make FFF handle AO3 fics with custom work skins more gracefully? e.g. [url=https://archiveofourown.org/works/28934610]downloading this[/results] urls in a lot of missing formatting.

Not at the moment.

I worked on using 'creators styles' once (3 years ago according to git) but never finished it. I honestly don't recall why it was abandoned. I may have run into difficulties, or I may have just decided it wasn't important enough.

For me, one of the most important features of FFF has always been the fact that it normalizes stories to all look the same. I de-DRM my boughten books just so I can change the styles to match.

I might be persuaded to consider it again if I'm shown a substantial body of real stories that use AO3's skin feature.

[matjojo]

I have a large number of stories (over 200) that have received this error:
More than one identical book by Identifier URL or title/author(s)--can't tell which book to update/overwrite.

For some of those, when I search for the author or book name, I can't find a dupe. I suspect that these are dupe in Identifier. But selecting the one book it does find, and right-clicking on the IDs column on the right side I cannot seem to make Calibre search for this Identifier.

When I select the "Search" -> "Search calibre for the URL in Identifiers" I see the search `identifiers:"=url"` (Not the real URL, just the letters u r and l) come up in the search bar, with 0 results.

How do I search for this?

[JimmXinu]

Calibre assumes identifiers are generally unique, so it doesn't have a quick link for that.

But you can search Calibre for the story URL identifier with:

identifiers:"=url:http://test1.com?sid=2"

Replace the italicized part with your story URL.

Since you apparently have a number of them, I would suggest using the Find Duplicates plugin--it has a mode specifically for finding duplicate identifiers.

[Atherton25]

Some sites reuse old ID's for deleted stories. I recall it happening to me in the pastonce or twice on SOL... and one other, I just can't think of which right now. So, in that case it may not actually be a duplicate.

Also, depending on how the ID thing works out, you dont have to quote it. IE I've had to use just 'identifiers:url:1234' before (replacing 1234 obviously) with a general ID if for some reason it has the title in the URL. That has happened, particularly when I had very old versions of a fff download that wasn't normalized the same as it does now, so the URL was slightly different even with the same ID.

[ownedbycats]

Originally Posted by JimmXinu

Without seeing the error or debug log I can only speculate.

But if you have check_next_chapter:true or skip_author_cover:true, you also need to manually try downloading one chapter more than listed for the fic or the author page and full size story image respectively.

Or turn those options off.

check_next_chapter:true is enabled; I think I had some trouble at one point and turned it on. I'll disable it and see if it stops falling back.

[matjojo]

Not only did that search option work well.

Originally Posted by JimmXinu

identifiers:"=url:http://test1.com?sid=2"
Replace the italicized part with your story URL..

I also found with the find duplicates plugin that I have almost 800 of these pairs. Ouch.

So yeah, I'll be working on that for a while. Thanks for explaining, and thanks for notifying me via the plugin logs I suppose.

[Lyen]

The current Scribblehub adapter isn't grabbing the fandom tags when a story is fanfic.

I modified my personal adapter and got it to work but there is probably a better way to do it.

       # Fandoms
        if soup.find('div', string="Fandom"):
            fandoms = soup.find('div', string="Fandom").next_sibling.find_all('a')
            for fandom in fandoms:
                self.story.addToList('fandoms', stripHTML(fandom))

[JimmXinu]

New Test Version Posted

2021-06-03
- Collect 'fandoms' for adapter_scribblehubcom.
- PI: Only update author link (AKA authorUrl) in Calibre if changed. Only
really affects older versions of Calibre. Calibre does the same
starting around Sept 2020.

[Arkeus]

Oh nice, didn't know scribblehub worked now.

Also, damn. FFnet is perma gone?

[ownedbycats]

Originally Posted by Arkeus

Also, damn. FFnet is perma gone?

No. But as of present, you need to use the cache feature.

https://github.com/JimmXinu/FanFicFa...erCacheFeature

[Ascello]

Is there another way to make case insensitive regex in replace_metadata other than typing something like [tT][hH][iI][sS]?

[shaybella]

Originally Posted by JimmXinu

Pretty clearly royalroad.com is blocking you. I'm not seeing it, so it's not (apparently) a general problem.

The followup question then: why is FFF blocked but not my browser?