[GUI Plugin] FanFicFare

[JimmXinu]

Originally Posted by ownedbycats

Curious: What is the intended use of the "add books back to 'send to device' list when marked 'read'" option? Is it to remove the '(NEW)' bits on the reader itself?

Yes. I use a column set by Reading List and a metadata plug board to prepend '000' to the title of my 'unread' books. They need to be sent to the device again to remove the prefix.

See wiki page PluginWithReadingList--it's a bit dated, but I believe still valid.

[dailyalice]

This is not at all urgent or a big deal, it's just really weird and has me puzzled.

I change some category names via replace_metadata to normalize fandom names in my library and the items that should be changed to "Man from UNCLE" are being changed to "Man from Uncle" which has me stumped.

I've searched this thread for info on "case sensitive" and "capitalization" and similar but didn't find anything that seemed to apply.

Here's what I have under replace_metadata:

 category=>^([Tt]he )?[Mm]an [Ff]rom [Uu](.)?[Nn](.)?[Cc](.)?[Ll](.)?[Ee].*$=>Man from UNCLE

A bit ugly, but it seems to capture instances of "The Man from U.N.C.L.E. (2015)" as well as "The Man from U.N.C.L.E. (TV)" and "The Man from U.N.C.L.E." and "Man from UNCLE - fandom" and so on and so forth. (I've decided to let both the TV show and the movie all be the same category here so this should work for the movie and TV show.)

I know it's possible to have a new category that is all caps because I switch lots of categories to be simply "MCU" and that works fine. Unless for some weird reason all-caps only works if it's the first/only item . . .

And alright, I just went and changed a line in my personal.ini that changes Agents of S.H.I.E.L.D. to MCU to have it change that to Agents of SHIELD instead and when I updated a single story from Saved Metadata, it changed it to Agents of SHIELD just fine. So a fandom with that format is possible, clearly. I'm really stumped now.

 category=>^[Aa]gents [Oo]f [Ss](\.)?[Hh](\.)?[Ii](\.)?[Ee](\.)?[Ll](\.)?[Dd].*$=>Agents of SHIELD

The Agents of SHIELD line is a bit different because I escape most of the periods; I had UNCLE like that but changed it when I came across the fandom name of "Man from UNCLE - fandom" or something like that. (But none of this should matter, since the regex line checks out and is working and the change is happening, it's just giving me Uncle instead of UNCLE.)

I've also tried making the Man from UNCLE line the very first line under replace_metadata. I haven't yet made it the only thing under replace_metadata in a stripped down personal.ini, but I suppose I could try that.

I can live with it, it's not the end of the world if the fandom name is Man from Uncle versus Man from UNCLE, but it's puzzling and I thought I'd see if anyone had any ideas of what might be going on here.

I just tried another change. And this line does work:

 category=>^([Tt]he )?[Mm]an [Ff]rom [Uu](.)?[Nn](.)?[Cc](.)?[Ll](.)?[Ee].*$=>Man from U.N.C.L.E.

So I suppose I could go with that if I like the look of "Man from U.N.C.L.E." more than "Man from Uncle."

(But why isn't "Man from UNCLE" possible? So freaking weird.)

If anyone wants to see if they can replicate the issue in their own personal.ini, so far I've only been downloading UNCLE works from AO3. Here's the AO3 category for the UNCLE movie: https://archiveofourown.org/tags/The...20(2015)/works and for the TV show: https://archiveofourown.org/tags/The...*%20(TV)/works

[JimmXinu]

Calibre has a feature where it makes incoming tags (from FFF*) matches existing tags, case-wise.

This is a bit of data-normalization to save space, plus a way to help users keep matching tags.

So I believe, if you search your library, you'll find "Man from Uncle" is an existing tag on an existing book.

* It also used to work that way when manually editing tags. It looks like Calibre now (v6.7.1) updates the tags on all books when you change the case on one.

So if you change that 'Man from Uncle' in your library to 'Man from UNCLE' on one book, it should change for all books. If it doesn't, use the Tag browser or search and replace to do that and then try it with FFF again.

[dailyalice]

Originally Posted by JimmXinu

Calibre has a feature where it makes incoming tags (from FFF*) matches existing tags, case-wise.

This is a bit of data-normalization to save space, plus a way to help users keep matching tags.

So I believe, if you search your library, you'll find "Man from Uncle" is an existing tag on an existing book.

Thanks for the quick response!

Huh. Since I have two columns for Fandoms in my library and I'm only changing one of them, the column with fandoms as they are on AO3 still had "Man from Uncle - Fandom" as tags for two works. (Basically I change category tags using replace_metadata in personal.ini to populate my main fandoms column, but I also put AO3's "fandoms" into a separate column "Fandoms (AO3)" so I have both my cleaner list and AO3's full list.)

So I'm guessing that Man from Uncle - Fandom was the hangup, even though it was in a different column. I changed that to Man from UNCLE - Fandom and also manually changed the category to Man from UNCLE.

Originally Posted by JimmXinu

* It also used to work that way when manually editing tags. It looks like Calibre now (v6.7.1) updates the tags on all books when you change the case on one.

So if you change that 'Man from Uncle' in your library to 'Man from UNCLE' on one book, it should change for all books. If it doesn't, use the Tag browser or search and replace to do that and then try it with FFF again.

I like that changing case on one tag in your library now fixes them all. That's handy (and good to know.)

I was able to update the rest of my Man from UNCLE works from Saved Metadata and they're now all Man from UNCLE.

Going forward, I'm guessing this will work. I should think any future instances of "Man from Uncle - Fandom" will be changed thanks to personal.ini, but i'm only changing them in category not fandoms. But i'm guessing the preferred capitalization will be what is in the library.

. . . And I just tested this by finding a really old work on AO3 that still had "Man from Uncle - Fandom" as the fandom. Downloaded it and the category change worked (to Man from UNCLE) and the data downloaded to the AO3 fandoms column reads "Man from UNCLE - fandom" instead of "Man from Uncle - fandom" as it is on AO3. Huh.

So I guess whatever capitalization that is in the tags that are in my library first wins? (But then if I change tags in my library, going forward they'll show up consistently in my library the way I like them. Though the point of the few AO3 specific custom columns I have is to retain the data as it exists on AO3; I guess I'll have to assume capitalization won't necessarily match the archive, which is fine. The AO3 data is still in Saved Metadata.)

Huh. This might explain why so many character names have had the correct cases; I've been adding lines to my personal.ini as I come across names that are misspelled or aren't capitalized correctly and have been surprised I haven't had to do that as much as I did in older libraries. Neat. I guess that's something I don't have to bother with using replace_metadata if I get the names capitalized correctly in my library initially.

[ownedbycats]

Another bit of data-normalization that caught me before: Calibre will delete trailing spaces in taglike columns (not sure about regular text ones). If you're sloppy with the regexes you may end up with "Fandom , Other Fandom" on the title page but the extra space won't show up in the Calibre column.

[EhrinCB]

Hello!
This is my first time popping into the forum.

I'm having a bit of trouble with FanFicFare, but I assume I'm also using the plugin in a more unorthodox way?

I've been on a bit of an archival kick lately, and decided to download the FimFicArchive, which is a (mostly) full archive of Fimfiction.net.

This is all well and good so far. The epubs are clean and even have some basic metadata (mostly just the fact that they have the url, I'm assuming) that allows FFF to pull the correct tags, publish date, author, etc.

The only problem I'm having is that FFF isn't updating the file with a cover image from Fimfiction.net.
If I download the file directly through FFF, it works as expected, with cover art. But not with already existing books.

Any help would be greatly appreciated!

[cyber21tan]

Originally Posted by EhrinCB

Hello!
This is my first time popping into the forum.

I'm having a bit of trouble with FanFicFare, but I assume I'm also using the plugin in a more unorthodox way?

I've been on a bit of an archival kick lately, and decided to download the FimFicArchive, which is a (mostly) full archive of Fimfiction.net.

This is all well and good so far. The epubs are clean and even have some basic metadata (mostly just the fact that they have the url, I'm assuming) that allows FFF to pull the correct tags, publish date, author, etc.

The only problem I'm having is that FFF isn't updating the file with a cover image from Fimfiction.net.
If I download the file directly through FFF, it works as expected, with cover art. But not with already existing books.

Any help would be greatly appreciated!

FimFicArchive isnt supported check this Link for the supported sites

[EhrinCB]

I should clarify, FimFicArchive isn't a website, rather a downloadable archive of Fimfiction.net

So I have a folder that's ~7.5gb of epubs pulled from the site with very basic metadata. Seems to mostly be Author, Title, and URL.

FFF has no problem updating the metadata with tags, publish date from the URL provided by the epubs.

[JimmXinu]

Originally Posted by EhrinCB

The only problem I'm having is that FFF isn't updating the file with a cover image from Fimfiction.net.
If I download the file directly through FFF, it works as expected, with cover art. But not with already existing books.

FFF doesn't download the cover when only updating metadata. And FFF only knows how to set Calibre's cover from the EPUB cover.

But if you do 'Update EPUB Always' on an epub from a different site, it's (probably) going download the story again and overwrite what's there.

Further, as a moral stand, I decline to support efforts to download entire sites and tend to view that as abuse of the tool and the site.

Google doesn't find anything named FimFicArchive for me. But if you mean Fimfarchive, while not official, that does appear to be at least tolerated by fimfiction.net. So that makes it a gray area, I suppose.

I would suggest that you use Generate Cover to create covers (for many books at once), and/or drag & drop individual story covers.

[Aliandry]

Hello!
This is my first time here, so please let me know if I'm doing something wrong.

I have used Calibre since the beginning of the year and had no problems so far! But I've recently had to start using a VPN to access AO3 and I find myself unable to download any fics from there using Calibre. I always get an "None of the URLs/stories given can be/need to be downloaded" and when I open this log it says this:

Status Error
check_hostname requires server_hostname

Unfortunately I cannot currently access AO3 without a VPN, so turning it off is out of the question.

Is there some way around this? I have downloaded the EPUBs instead and added them manually, but that created a new entry for the fic in question and it's much slower/inconvenient.

[EhrinCB]

Originally Posted by JimmXinu

FFF doesn't download the cover when only updating metadata. And FFF only knows how to set Calibre's cover from the EPUB cover.

But if you do 'Update EPUB Always' on an epub from a different site, it's (probably) going download the story again and overwrite what's there.

Further, as a moral stand, I decline to support efforts to download entire sites and tend to view that as abuse of the tool and the site.

Google doesn't find anything named FimFicArchive for me. But if you mean Fimfarchive, while not official, that does appear to be at least tolerated by fimfiction.net. So that makes it a gray area, I suppose.

I would suggest that you use Generate Cover to create covers (for many books at once), and/or drag & drop individual story covers.

Understandable. And yes, I mean Fimfarchive.
I'm not intending to pull the metadata for the entire 205k story archive. that would be insane. But would like to be able to curate my archive to say, top 500 or 1k. Properly having cover art would be nice for that.

thanks for the clarification either way. Great little tool you've got here.

[JimmXinu]

Originally Posted by Aliandry

I have used Calibre since the beginning of the year and had no problems so far! But I've recently had to start using a VPN to access AO3 and I find myself unable to download any fics from there using Calibre. I always get an "None of the URLs/stories given can be/need to be downloaded" and when I open this log it says this:

Status Error
check_hostname requires server_hostname

Unfortunately I cannot currently access AO3 without a VPN, so turning it off is out of the question.

Are you using a VPN, or a proxy? The only time I've seen that error before was with a proxy and we never did get it to work. Search this thread for check_hostname to see the discussion.

It may work better for you, if you are using a proxy, to set the proxy value(s) explicitly in FFF, you have to know your proxy IP & port number, tho:

[archiveofourown.org]
https_proxy:http://X.X.X.X:YYYY

[DisturbedDragon]

When trying to download [redacted], I get the error "I/O Operation on Closed File." Any idea why/how I can get around this?

[JimmXinu]

Originally Posted by DisturbedDragon

When trying to download [redected], I get the error "I/O Operation on Closed File." Any idea why/how I can get around this?

I didn't get that error. For 28 chapters, 524 images seems like a lot, btw.

FYI, I removed the link from your post, MR doesn't like links to NSFW content and at least one of the images in the download was NSFW.

A full debug log of it happening (run calibre in debug, under the Preferences drop down) might help, but I would suspect it was error that happened on the server and bubbled up.

If can get such a log and PM me a link to it, I'll look at it.

[DisturbedDragon]

I'll do that ASAP. On my phone atm, but it should be up within an hour.

Here is the pastebin debug log:
https://pastebin.com/md7yzfi4

From my admittedly limited understanding, it's running into "memoryerror" which I assume means I don't have enough free space? Which is weird, since I'm at 10.6 GB on my computer. I've never posted a debug log before, so I admit I'm not sure if I did it right.

Upon trying the Fiction.live Downloader Firefox addon, I got a 346MB file (with images) that Calibre refused to open, saying to "Try a more forgiving zip parser." Upon attempting with Adobe, I was able to open the file correctly.
Notably I am using Calibre 5.44, since I have a Windows 8 OS on my old-as-hell PC, if that matters.

Double edit: Upon restarting my computer for the 2nd time, it worked. I changed no settings, already restarted once, and have done absolutely nothing to fix it. God, technology sometimes baffles me.