[GUI Plugin] FanFicFare

[JimmXinu]

The downloaded ebook will still be in a temp directory until you quit Calibre.

Each time you run Calibre, it makes a unique directory named calibre_<random letters> in your temp dir. Each FFF download session in turn creates a unique directory named fanficfare_<random letters> inside the calibre temp dir. And inside the FFF temp dir, is a temp copy of each downloaded book for that session.

FFF cleans up its temp dir when the download session successfully ends, but not when aborted.

Calibre cleans up its temp dir (including FFF's temp dir) on exit, except on crash.

I don't know where different OS's keep your temp files. FFF's debug output will show you where FFF is writing temp files, but you'd have to open the debug log while Calibre is still running, or just remember/save the temp dir area for next time.

[Kminari]

Originally Posted by JimmXinu

Multi-reply



A debug log of it working successfully isn't all that useful--at least, it looks like it worked. I tested and was able to download that without issue.

Errors that come and go like that are likely to be network errors or the site blocking you if you're doing too much on it. I have seen SB/SV start giving errors if I browse the site at the same time as I'm downloading from it...



That's a bug. Fixed in the latest test version. See the link in my sig.

New Test Version Posted

2020-08-30
- Fix for Anthology bug when no story has a series.
- Added a string for translation.

It worked the second time, this is the first time (it is in the log)

FFF: DEBUG: 2020-08-30 01:34:08,546: calibre_plugins.fanficfare_plugin.fff_plugin(970): add_tag:None
FFF: DEBUG: 2020-08-30 01:34:08,562: calibre_plugins.fanficfare_plugin.fff_plugin(980): FanFicFare v3.22.1
FFF: DEBUG: 2020-08-30 01:34:08,591: calibre_plugins.fanficfare_plugin.fff_plugin(1094): url:https://forums.spacebattles.com/threads/hope-through-overwhelming-firepower-worm-diebuster-thread-4-boom-goes-the-endbringer.289048/
FFF: INFO: 2020-08-30 01:34:08,592: calibre_plugins.fanficfare_plugin.prefs(215): Attempting to read settings from predecessor--FFDL
FFF: INFO: 2020-08-30 01:34:08,592: calibre_plugins.fanficfare_plugin.prefs(220): Using default settings
FFF: INFO: 2020-08-30 01:34:08,680: calibre_plugins.fanficfare_plugin.fanficfare.adapters.base_xenforoforum_adapter(426): url: https://forums.spacebattles.com/threads/hope-through-overwhelming-firepower-worm-diebuster-thread-4-boom-goes-the-endbringer.289048/
FFF: DEBUG: 2020-08-30 01:34:08,680: calibre_plugins.fanficfare_plugin.fanficfare.configurable(1141): #####################################
pagecache(GET) MISS: https://forums.spacebattles.com/threads/hope-through-overwhelming-firepower-worm-diebuster-thread-4-boom-goes-the-endbringer.289048/
FFF: ERROR: 2020-08-30 01:34:24,101: calibre_plugins.fanficfare_plugin.dialogs(711): Exception: {u'url': u'https://forums.spacebattles.com/threads/hope-through-overwhelming-firepower-worm-diebuster-thread-4-boom-goes-the-endbringer.289048/', u'author_sort': [u'Unknown'], u'collision': u'Actualizar EPUB si hay nuevos cap\xedtulos', u'end': None, u'showerror': True, u'listorder': 0, u'author': [u'Unknown'], u'added': False, u'title': u'Unknown', u'begin': None, u'status': u'Error', u'publisher': None, u'series': u'', u'calibre_id': None, u'uniqueurl': u'https://forums.spacebattles.com/threads/hope-through-overwhelming-firepower-worm-diebuster-thread-4-boom-goes-the-endbringer.289048/[None-None]', u'pubdate': None, u'good': False, u'comments': u'', u'site': 'forums.spacebattles.com', u'comment': u"'utf8' codec can't decode byte 0xf3 in position 56: invalid continuation byte"}:'utf8' codec can't decode byte 0xf3 in position 56: invalid continuation byte
Traceback (most recent call last):
  File "calibre_plugins.fanficfare_plugin.dialogs", line 698, in do_loop
  File "calibre_plugins.fanficfare_plugin.fff_plugin", line 1179, in prep_download_loop
  File "calibre_plugins.fanficfare_plugin.fff_plugin", line 1061, in get_story_metadata_only
  File "calibre_plugins.fanficfare_plugin.fanficfare.adapters.base_adapter", line 297, in getStoryMetadataOnly
  File "calibre_plugins.fanficfare_plugin.fanficfare.adapters.base_adapter", line 381, in doExtractChapterUrlsAndMetadata
  File "calibre_plugins.fanficfare_plugin.fanficfare.adapters.base_xenforoforum_adapter", line 429, in extractChapterUrlsAndMetadata
  File "calibre_plugins.fanficfare_plugin.fanficfare.adapters.base_xenforoforum_adapter", line 103, in _fetchUrlOpened
  File "calibre_plugins.fanficfare_plugin.fanficfare.configurable", line 1335, in _fetchUrlOpened
  File "calibre_plugins.fanficfare_plugin.fanficfare.configurable", line 1231, in _fetchUrlOpened
UnicodeDecodeError: 'utf8' codec can't decode byte 0xf3 in position 56: invalid continuation byte
FFF: DEBUG: 2020-08-30 01:49:54,757: calibre_plugins.fanficfare_plugin.fff_plugin(1668): Finalizada la adición o actualización de 0 libros.
FFF: DEBUG: 2020-08-30 01:49:54,759: calibre_plugins.fanficfare_plugin.fff_plugin(1671): removed tdir
FFF: DEBUG: 2020-08-30 01:50:11,436: calibre_plugins.fanficfare_plugin.fff_plugin(970): add_tag:None

[JimmXinu]

Originally Posted by Kminari

It worked the second time, this is the first time (it is in the log)

An encoding error that only shows up sometimes on the same story, I have to attribute to something outside of FFF--it's not like our code changed between the two attempts.

[JimmXinu]

New Test Version Posted

2020-08-31
- New site fiction.live, thanks HazelSh!

[ownedbycats]

Originally Posted by JimmXinu

The downloaded ebook will still be in a temp directory until you quit Calibre.

Each time you run Calibre, it makes a unique directory named calibre_<random letters> in your temp dir. Each FFF download session in turn creates a unique directory named fanficfare_<random letters> inside the calibre temp dir. And inside the FFF temp dir, is a temp copy of each downloaded book for that session.

FFF cleans up its temp dir when the download session successfully ends, but not when aborted.

Calibre cleans up its temp dir (including FFF's temp dir) on exit, except on crash.

I don't know where different OS's keep your temp files. FFF's debug output will show you where FFF is writing temp files, but you'd have to open the debug log while Calibre is still running, or just remember/save the temp dir area for next time.

Thank you

[drea]

Hi me again.
Also another query on AO3 series.

This is a more of nice to have features but also checking in case it is already there and (again) just need to be enabled or something from my end.

Is the number of works in the AO3 series also captured anywhere at the moment? I just realized if an author, has a link to a different fic in the fic description, it got included as part of the anthologies.

I can guess at the reason as FFF is parsing for supported URL but at least if I can validate the numbers of works that supposed to be in the series vs number of works that actually included, that would be nice .

And on that note another nice to have item on the wishlist when downloading anthologies,

• show the no# of story URLs in the window that have the "Story URLs for anthology, one per line"

Currently I believe, the no# of story (URLs) are only shown after the next window appear, as then we would be able to see the message downloading metadata for x/y .

But since it might be niche since there is a workaround by counting the URLs, would understand if not really important to be considered.

for reading

[JimmXinu]

New Test Version Posted

2020-09-02
- Display number of URLs found for an anthology.


FFF doesn't technically have a 'series' collecting feature.

It has the 'Get Story URLs from web Page' feature that collects all valid story URLs from a page.

So, no, FFF doesn't know how many stories are in a series.

Adding a small display to show number of URLs collected for a merged (anthology) is something relatively easy, however. It will appear in the label above the URL box.

[drea]

Originally Posted by JimmXinu

New Test Version Posted

2020-09-02
- Display number of URLs found for an anthology.


FFF doesn't technically have a 'series' collecting feature.

It has the 'Get Story URLs from web Page' feature that collects all valid story URLs from a page.

So, no, FFF doesn't know how many stories are in a series.

Adding a small display to show number of URLs collected for a merged (anthology) is something relatively easy, however. It will appear in the label above the URL box.

Appreciate your response on this

[ownedbycats]

Since it got buried in the thread (and I think was asked around the time of those big storms), re-asking this question:

Is there replace_metadata conditional for anthologies? I was trying to adapt this to set the fanfic status column as 'anthology' (though I suspect I'm probably going about this the wrong way):

custom_columns_settings: 
 oneshot=>#fanficstatus

replace_metadata:
## Sets one-chapter fics to oneshot
 oneshot=>Completed=>Oneshot&&numChapters=>^1$

# 'add_to_' concats on to existing param, thus the leading comma
add_to_extra_valid_entries:,oneshot,

# oneshot is a copy of status because status itself isn't a list.
include_in_oneshot:status

[JimmXinu]

Originally Posted by ownedbycats

Is there replace_metadata conditional for anthologies? I was trying to adapt this to set the fanfic status column as 'anthology' (though I suspect I'm probably going about this the wrong way)

Yes, the metadata entry anthology is set to "true" for an anthology book.

[ownedbycats]

Thanks. I'll see if I can get it working.

[ownedbycats]

When there is a cover image for a fic in an anthology, FFF adds a TOC entry for the cover page of that fic. It doesn't seem to do it any other time. Is this intended?

[JimmXinu]

Originally Posted by ownedbycats

When there is a cover image for a fic in an anthology, FFF adds a TOC entry for the cover page of that fic. It doesn't seem to do it any other time. Is this intended?

Are you using the posted EpubMerge test version? There are some issues it resolves with anthologies.

If you are using that version, I'm going to need to see an example.

[ownedbycats]

I'll update the EpubMerge version. Thank you.

[aehli]

Hi -, how can I fix this error? It used to work perfectly for wuxiaworld.co
I also tried updating previously downloaded stories but the same issue

Status
Title
Author
Comment
URL
Error
Unknown
Unknown
'NoneType' object has no attribute 'h1'
https://www.wuxiaworld.co/Elixir-Supplier/