[GUI Plugin] FanFicFare

[JimmXinu]

New Test Version Posted

2023-05-21
- wuxiaworld.co -> wuxiaworld.xyz changes most data collection #953

Also fixes www.novelupdates.cc which shares code.

[internetkeno]

Hi,

if i try to download or updaate my fiction collection

it gives me this 403 error:

Status Title Author Comment URL Error Unknown Unknown HTTP Error in FFF '403 Client Error: Forbidden for url: https://www.fanfiction.net/s/13833982/1/Fixing-the-Wizarding-World'(403) https://www.fanfiction.net/s/13833982/1/Fixing-the-Wizarding-World

[theducks]

Originally Posted by internetkeno

Hi,

if i try to download or updaate my fiction collection

it gives me this 403 error:

Status Title Author Comment URL Error Unknown Unknown HTTP Error in FFF '403 Client Error: Forbidden for url: https://www.fanfiction.net/s/13833982/1/Fixing-the-Wizarding-World'(403) https://www.fanfiction.net/s/13833982/1/Fixing-the-Wizarding-World

403 means Forbidden ((a standard response type code)
Has it (the plugin) ever worked for you?

Possibly, you made too many attempts (quickly or in a row) and got locked out
Did you login?

The link works for me in a browser (I am not a FFF user)

[ownedbycats]

Originally Posted by internetkeno

Hi,

if i try to download or updaate my fiction collection

it gives me this 403 error:

Status Title Author Comment URL Error Unknown Unknown HTTP Error in FFF '403 Client Error: Forbidden for url: https://www.fanfiction.net/s/13833982/1/Fixing-the-Wizarding-World'(403) https://www.fanfiction.net/s/13833982/1/Fixing-the-Wizarding-World

https://github.com/JimmXinu/FanFicFa...-fanfictionnet

[ownedbycats]

Originally Posted by theducks

403 means Forbidden ((a standard response type code)
Has it (the plugin) ever worked for you?

Possibly, you made too many attempts (quickly or in a row) and got locked out
Did you login?

The link works for me in a browser (I am not a FFF user)

ffnet blocks FFF. You have to use certain methods to get around it (e.g. loading the story to the browser cache).

[JimmXinu]

That FAQ is: Why am I having errors downloading from fanfiction.net? / Why am I getting 'Cloudflare' errors downloading from fanfiction.net?

It's been happening for years now, unfortunately.

[Betelgeuse]

Hi guys! I was just wondering if anyone has had problems with downloading from AO3 or other sites? It works for the most part, but some of my books get downloaded without a URL seemingly at random. When I tried to redownload them Calibre said that I should try to Overwrite them, but I'm not sure how to do that. Any help in figuring out how to do so, or in finding an alternative, would be very much appreciated. Thank you!

[JimmXinu]

That's weird. Are you running out of disk space maybe?

What messages exactly are you seeing? Can you run in debug mode (under the Calibre Preferences dropdown) and collect a debug log?

[arpeggioaccele]

I just finished using the fanficfare plugin to get the url identifier for all my AO3 epub downloads— it took all night to finish but it worked great!

I really only needed to update the url and author link and turned off all the metadata and story updating (I think) though.

So I was wondering, is there a way to just get the two urls from the epub locally without having to fetch metadata from AO3?

Extraneous info:
I don't use fanficfare to import fics, since I prefer the formatting of epubs generated by AO3, so all the files did not have url identifers or author links to begin with. I used the Extract People and Other plugin to get the series url into a custom column too for merged anthologies. I quickly checked the FAQ and saw https://github.com/JimmXinu/FanFicFa...-existing-book which suggests the search internet plugin, which I will try next time.

[ownedbycats]

Try the 'get story URLs from selected book' option. I'm not sure that it'll work for non-FFF stories though.

EDIT: I found an AO3-downloaded fic in my library (which was deleted before I could re-download). Seems to work.

[arpeggioaccele]

I think I tried that, it returned a popup with the correct url but did not update the metadata automatically— it could just be my settings/preferences though. It would be a great way to get a list of links to share/export though. Thanks for the advice!

I assume that author link might rely on fetching metadata too— but I'm rather just do that instead of learning how to make author usernames into an identifier to build an author link then somehow put it wherever its supposed to go.

[ownedbycats]

Yeah, you'll need to copy it manually unfortunately.

If the story still exists on the website, running an update metadata from site (or column, if you have it set up) is the simplest way to put URL back (and author/series URL too). But it'll also update other metadata unless you set it 'new only.'

@JimmXinu - If the author/series is set to 'new only', does it update the URL?

[JimmXinu]

Originally Posted by arpeggioaccele

So I was wondering, is there a way to just get the two urls from the epub locally without having to fetch metadata from AO3?

tl;dr: No.

FFF has a lot of code dedicated to identifying story URLs that is leveraged by the Get Story URLs from Selected Books feature.

FFF does not have the ability to identify author URLs except as part of a story download.

I could add a feature to put the found story URL into Calibre's Identifiers. But it seems very niche, and we already have Update Calibre Metadata from Web Site mode. I'd have to see interest from more users or a more compelling use case.

(A downloaded epub from AO3 has <meta> tags specifically for "calibre:series". I would have expected the more standard <dc:identifier opf:scheme="URL"> tag with the story URL before that.)

Originally Posted by ownedbycats

@JimmXinu - If the author/series is set to 'new only', does it update the URL?

Set Calibre Author URL and Set Calibre Series URL checkboxes control whether those links are set or not--the 'New Only' checkboxes are only for the values, not the links.

[arpeggioaccele]

Yeah even I wouldn't need that exact feature more than once for my entire library so it would be useless the other 99% of the time— and it's literally only to put the link in the identifiers slot, I already figured out a way to extract stuff into a custom column.

It would definitely be nice if the AO3 generated epubs came with identifiers, but it's functional so I probably won't investigate further.

Thanks for the explanation!

[ownedbycats]

Originally Posted by JimmXinu

I could add a feature to put the found story URL into Calibre's Identifiers. But it seems very niche, and we already have Update Calibre Metadata from Web Site mode. I'd have to see interest from more users or a more compelling use case.

A while ago, I thought of something similar in scope: the option to only update specific columns without needing to set everything else to 'new only'. Never really thought it out enough to actually suggest it, but something like that could be used to only update the ids column.