11-19-2021, 11:43 AM
|
#6706 |
|
Plugin Developer
  
Posts: 6,993
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
|
New Test Version Posted
2021-11-19 - Set default slow_down_sleep_time:2 for [www.asianfanfics.com] - Deviantart date fix (closes #768), also storyId and extratags changes, thanks jcotton42 - New site: www.patreon.com ONLY accessible using Browser Cache, thanks jcotton42 |
|
|
|
11-19-2021, 04:26 PM
|
#6707 |
|
Member
Posts: 20
Karma: 10
Join Date: May 2020
Device: Kobo
|
Yeah, it was always "slower" but never realized *HOW* slow... For comparison, after using ENV VAR to point global Library DB to local drive, doing FFF metadata update from stored metadata column on 5000 books took ~50 mins? vs prev 2000 books in 20hours... Guessing Calibre might do something with file locking workaround, like try to file lock, if you can't, sleep XX seconds and verify nothing changed then go ahead and do something... This could explain Calibre just "hanging" with no network, disk or CPU usage when DB is on NAS. It was "tolerable" when updating handfuls of books, but adding a new Column that must be populated from stored metadata did a *lot* of DB access, so the problem was no longer "tolerable"...
I have not tried changing Libraries yet, but I did load up Calibre without the ENV var and it loaded with an empty DB (NAS copy is renamed as a backup) but closing, removing empty DB file and setting ENV had things working again... just annoying... Would be nice if Calibre could do a pointer or something for DB setting, so you could have a minimal DB file wherever and store a setting for pointing to "real" DB somewhere else... again, not a FFF issue at all but something users might run across... |
|
|
|
| Advert | |
|
|
|
11-19-2021, 05:11 PM
|
#6708 |
|
Member
Posts: 20
Karma: 10
Join Date: May 2020
Device: Kobo
|
So, looked at a bunch of threads on file locking, sqlite, samba, etc... found a setting for Samba to disable oplocks on per file basis - e.g. for metadata.db - and found when doing FFF metadata from stored column on update on 20 existing books (on NAS share):
using local disk DB took ~20 secs using NAS for DB with "veto oplock" took ~24 secs using NAS for DB without "veto oplocks" took ~26 secs So, only "major" change was purging the recycle bin on NAS for the metadata DB journal files (there were many 1000s-10,000s). So, in the end, it wasn't actually having DB on NAS but having too many recycle bin files on the NAS for the DB journal files (1 for every DB update going back 18+ months I think...) - which would be created on local disk when DB was local... So, moved DB back on NAS, no complicated ENV swapping scripts, multi Library should be happy again! 
|
|
|
|
|
11-19-2021, 05:56 PM
|
#6709 |
|
Enthusiast
Posts: 45
Karma: 10
Join Date: Mar 2020
Device: Android,
|
Spoiler:
This isn't my first time having this issue. I'm using the latest version of Calibre that I downloaded via the binary install here https://calibre-ebook.com/download_linux. Though when I first downloaded Calibre it was through a repo |
|
|
|
|
11-19-2021, 07:20 PM
|
#6710 | |
|
Plugin Developer
Posts: 6,993
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
|
Quote:
The error message suggests might be an image processing issue for https://www.mathsisfun.com/algebra/i...plex-plane.svg -- which is weird because FFF is supposed to not attempt processing SVGs on Calibre. I was about to suggest you try again with include_images:false or no_image_processing:true when I decided to try them myself just in case. And then I saw the same error with no_image_processing:true (include_images:false worked fine). What's happening is FFF is still trying to determine an image size for cover_min_size, even if no_image_processing:true. And SVG images crash Calibre's image processing hard. The BG job fails outright rather than raising an exception that can be caught. I can fix this, but I need to spend more time than I have right now to consider the best approach. |
|
|
|
|
| Advert | |
|
|
|
11-19-2021, 09:23 PM
|
#6711 |
|
Plugin Developer
Posts: 6,993
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
|
New Test Version Posted
2021-11-19 2nd - Fix for cover_min_size causing failures with SVG images when no_image_processing:true. |
|
|
|
|
11-19-2021, 11:40 PM
|
#6712 | |
|
Member
Posts: 22
Karma: 10
Join Date: May 2016
Device: Kindle paperwhite
|
So I've got an odd bug. I was updating some stories from QQ, and got the message "the file is not a zip file" for several entries. Here's the log:
Quote:
|
|
|
|
|
|
11-20-2021, 10:49 AM
|
#6713 | |
|
Plugin Developer
Posts: 6,993
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
|
Quote:
I know that can happen between different programs, because I've seen it before with an android app. Have you used other tools to do anything to your ebooks? EDIT: If you can upload somewhere and PM me a link to one of the failing epubs, I might be able to figure out more. |
|
|
|
|
|
11-20-2021, 03:40 PM
|
#6714 |
|
Member
Posts: 20
Karma: 10
Join Date: Oct 2021
Device: kobo libra 2
|
Hi JimmXinu
Is there a way to retrieve the rating (user vote's) of a novel and populate in a custom column? example: https://readnovelfull.com/12-prince-v1.html , rating of 8.8/10 |
|
|
|
|
11-20-2021, 03:54 PM
|
#6715 | ||
|
Plugin Developer
Posts: 6,993
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
|
Quote:
Quote:
|
||
|
|
|
|
11-20-2021, 04:11 PM
|
#6716 |
|
Member
Posts: 20
Karma: 10
Join Date: Oct 2021
Device: kobo libra 2
|
Then, can you please add for https://novelfull.com/ since it's supported? It's basically the same
|
|
|
|
|
11-20-2021, 04:30 PM
|
#6717 | |
|
Plugin Developer
Posts: 6,993
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
|
New Test Version Posted
2021-11-20 - Add averrating metadata to adapter_novelfull. - Disable patreon downloads, decided I didn't want to add new site behind pay wall *and* only works with browser cache. Developer discussion here. Quote:
(Are you sure it's actually useful? I looked at like a dozen stories and every single one had a rating of 8.X. Looks a bit sus...) |
|
|
|
|
|
11-20-2021, 04:57 PM
|
#6718 | |
|
Member
Posts: 20
Karma: 10
Join Date: Oct 2021
Device: kobo libra 2
|
Quote:
I actually tested on some novels with low number of votes, and it actually updates the rating. Last edited by junni; 11-20-2021 at 05:01 PM. |
|
|
|
|
|
11-27-2021, 08:15 PM
|
#6719 | |
|
Grand Sorcerer
Posts: 11,310
Karma: 43993832
Join Date: Feb 2010
Location: Monroe Wisconsin
Device: K3, Kindle Paperwhite, Calibre, and Mobipocket for Pc (netbook)
|
Not sure what I'm doing wrong. As far as I know I have the most up to date copy of Calibre and the plug in but when I try to use it I get this:
Quote:
|
|
|
|
|
|
11-27-2021, 09:00 PM
|
#6720 |
|
Custom User Title
Posts: 11,036
Karma: 75555555
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
|
Did you read the error message?
|
|
|
|
 |
| Tags |
| fanfiction |
«
Previous Thread
|
Next Thread
»
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| [GUI Plugin] KindleUnpack - The Plugin | DiapDealer | Plugins | 523 | 07-15-2025 06:45 PM |
| [GUI Plugin] Open With | kiwidude | Plugins | 404 | 02-21-2025 05:42 AM |
| [GUI Plugin] Marvin XD | Philantrop | Plugins | 126 | 01-29-2017 12:48 PM |
| [GUI Plugin] KiNotes | -axel- | Plugins | 0 | 07-14-2013 06:39 PM |
| [GUI Plugin] Plugin Updater **Deprecated** | kiwidude | Plugins | 159 | 06-19-2011 12:27 PM |
All times are GMT -4. The time now is 12:08 PM.