[GUI Plugin] FanFicFare

[spiceyhot]

I have recently gotten this Error: KeyError: u'tags'
It happens when I try to update an Anthology, That was made using fff make an anthology from webpage, when updating I click the update anthology epub button. I have gotten the same error every time I try to update. The link is https://archiveofourown.org/series/229952

This is what it says

calibre, version 4.20.0
ERROR: Unhandled exception: <b>KeyError</b>:u'tags'

calibre 4.20 [64bit] embedded-python: True is64bit: True
Windows-10-10.0.19041-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.19041')
Python 2.7.16+
Windows: ('10', '10.0.19041', 'SP0', u'Multiprocessor Free')
Interface language: None
Successfully initialized third party plugins: DeDRM (6, 0, 8) && Fantastic Fiction (1, 3, 0) && EpubMerge (2, 10, 0) && Generate Cover (1, 5, 25) && Reading List (1, 6, 9) && Goodreads (1, 4, 0) && Fantastic Fiction Adults (1, 1, 0) && FanFicFare (3, 22, 1) && EpubSplit (2, 9, 0) && Goodreads Sync (1, 14, 3)
Traceback (most recent call last):
File "site-packages\calibre\gui2\proceed.py", line 209, in do_ask_question
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 1809, in do_download_merge_update
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 2620, in merge_meta_books
KeyError: u'tags'

[JimmXinu]

Originally Posted by spiceyhot

I have recently gotten this Error: KeyError: u'tags'
It happens when I try to update an Anthology, That was made using fff make an anthology from webpage, when updating I click the update anthology epub button. I have gotten the same error every time I try to update. The link is https://archiveofourown.org/series/229952

690 individual stories, virtually all less than 1000 words. Good grief. Keeping in mind that I don't recommend trying to download more than maybe 30-ish stories at a time...

I tried it, but I started getting 'urllib.error.HTTPError: HTTP Error 429: Too Many Requests' before it even finished collecting metadata.

So I'll put some code in the next test version to get around that specific error, I suspect it's a symptom of a more general failure when AO3 starts rejecting so many download requests in a row.

The obvious solution is don't download them all at once.

If you still insist on trying to do this as one big download, you can trying setting slow_down_sleep_time in personal.ini to a higher value than 2 (the default for AO3).

[Kminari]

Hello, has somebody managed to make a config that function the majority of the time to maintain the color when downloading from spacebattles or sufficient velocity? there are some stories that I really like the use of text color but I don't know how to do it (like https://forums.sufficientvelocity.co...s-doomed.58654 or https://forums.sufficientvelocity.co...ctioned.61266/ or https://forums.sufficientvelocity.co...ed-worm.59498/).
Has someone managed to do that with With This Ring by Mr Zoat (and the many threads of this story)?

[marshie250]

Recently, when I try to read an anthology on my reader, I run into an odd problem. Only the first chapter is listed in the TOC and the entire text of the book is in that chapter. I played around with a few settings, but the only thing that seems to fix this is using Calibre to convert the file to the epub2 format, after which the TOC works as intended. However, doing this means I can no longer check the anthology for updates; I get the message "Book isn't an FanFicFare anthology or contains books without valid Story URLs. Is there a way to fix this issue?

[JimmXinu]

Multi-reply

Originally Posted by Kminari

Hello, has somebody managed to make a config that function the majority of the time to maintain the color when downloading from spacebattles or sufficient velocity? ...

To normalize story appearance, FFF strips style attributes by default. You can save them for individual stories by story URL in personal.ini like so:

[https://forums.sufficientvelocity.com/threads/taylor-is-doomed.58654]
add_to_keep_html_attrs:,style

... or for for all xenforo forum(SV/SB/QQ/AH) sites stories:

[base_xenforoforum]
add_to_keep_html_attrs:,style

Originally Posted by marshie250

Recently, when I try to read an anthology on my reader, I run into an odd problem. ...

Without seeing the epub exhibiting the problem--or at least knowing what it was generated from, I can't help you.

[marshie250]

I should have been more specific--it's actually happening with every anthology, not just one.

[JimmXinu]

You can try the latest test version of EpubMerge (and the latest test version of FFF) and see if that helps.

But otherwise, I stand by my previous statement--without seeing the problem for myself, I can't help you.

[drea]

Hi again
I was just wondering, is there a way to extract Last Updated Date from existing epub files to a Calibre column. I was testing a custom column and I could capture it for new download/updates but not if the files already exist. Or is the only way is via Update Metadata for all existing entries?

THe files were also downloaded by FFF but done earlier before the custom column for Last Updated Date created,

Thank you

[ownedbycats]

Originally Posted by drea

Hi again
I was just wondering, is there a way to extract Last Updated Date from existing epub files to a Calibre column. I was testing a custom column and I could capture it for new download/updates but not if the files already exist. Or is the only way is via Update Metadata for all existing entries?

THe files were also downloaded by FFF but done earlier before the custom column for Last Updated Date created,

Thank you

If you do "Update metadata from saved column..." but it doesn't have that column filled yet, it should fetch it for you. Unfortunately if the story doesn't exist anymore you have to enter it manually.

[JimmXinu]

FFF does not have an ability to extract metadata from existing epubs.

It's something I've explored, but between the user customization of epub output and other tools (Calibre's Convert & Edit Book, etc) discarding 'hidden' metadata, it didn't work out.

[drea]

Thanks for pointing out the option. I took a look at it and unfortunately last updated date is not part of the Saved Metadata column.

Probably as it is a date field and I managed a search inside the thread to this post

Near the bottom of the Custom Column tab in FanFicFare config, look for Saved Metadata Column. Can only be used with 'Long Text' custom columns.

*italic inside quote is mine

Originally Posted by JimmXinu

FFF does not have an ability to extract metadata from existing epubs.

It's something I've explored, but between the user customization of epub output and other tools (Calibre's Convert & Edit Book, etc) discarding 'hidden' metadata, it didn't work out.

Thanks for the confirmation

[drea]

Originally Posted by JimmXinu

FFF does not have an ability to extract metadata from existing epubs.

It's something I've explored, but between the user customization of epub output and other tools (Calibre's Convert & Edit Book, etc) discarding 'hidden' metadata, it didn't work out.

Hmm my first reply missing, but anyway thank you for the confirmation

[JimmXinu]

FFF records the 'Updated' date metadata from the site(for most sites), indicating when the story was last updated by the author.

'Saved Metadata Column' records all available metadata that FFF has collected in the one column in an HTML format of our own devising.

(FYI, Calibre has since changed such that it irrevocably breaks FFF's saved metadata if you edit that column as html. I recommend using a Long Text custom column, Interpreted as Text now.)

If you mean Calibre's Modified datetime, no, FFF doesn't record that anywhere.

[Kminari]

Originally Posted by JimmXinu

To normalize story appearance, FFF strips style attributes by default. You can save them for individual stories by story URL in personal.ini like so:

[https://forums.sufficientvelocity.com/threads/taylor-is-doomed.58654]
add_to_keep_html_attrs:,style

... or for for all xenforo forum(SV/SB/QQ/AH) sites stories:

[base_xenforoforum]
add_to_keep_html_attrs:,style

Is this

[base_xenforoforum]
add_to_keep_html_attrs:,style

correct? The comma has me confused, because the examples I have seen are

keep_style_attr:true

that is code : value
... T-T I need to download everything again, because I have a problem and my pc was formatted, I have to download the 700 fanfics that I had downloaded.

[JimmXinu]

Originally Posted by Kminari

Is this

[base_xenforoforum]
add_to_keep_html_attrs:,style

correct?

Yes, that is correct. The other will also work, but can other issues by changing the default value of keep_html_attrs.

There's a wiki page about the FFF INI file with a section about add_to_.

Originally Posted by Kminari

... T-T I need to download everything again, because I have a problem and my pc was formatted, I have to download the 700 fanfics that I had downloaded.

I suggest that you also setup an FFF 'Saved Metadata Custom Column' before doing your downloads and spread out your downloads over time.