03-06-2024, 11:33 AM | #16 |
creator of calibre
Posts: 43,860
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
IIRC but dont quote me on this libprs500 was renamed to calibre around 2008 version 0.6
|
03-06-2024, 12:24 PM | #17 |
want to learn what I want
Posts: 1,002
Karma: 6422750
Join Date: Sep 2020
Device: Calibre E-book viewer
|
https://web.archive.org/web/20091128....com/whats-new
a while ago this got me curious, then I found this early 0.6 changelog |
Advert | |
|
03-06-2024, 12:31 PM | #18 |
Custom User Title
Posts: 8,639
Karma: 61234567
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
|
Surprised how little the site design has changed. (And it's not even that dated-looking.)
|
03-06-2024, 01:03 PM | #19 |
the rook, bossing Never.
Posts: 11,164
Karma: 85874891
Join Date: Jun 2017
Location: Ireland
Device: All 4 Kinds: epub eink, Kindle, android eink, NxtPaper11
|
Decent designs never look dated, but fads and fashion is quickly dated.
|
03-06-2024, 01:08 PM | #20 |
Resident Curmudgeon
Posts: 74,015
Karma: 129333114
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
|
|
Advert | |
|
03-06-2024, 08:20 PM | #21 |
Custom User Title
Posts: 8,639
Karma: 61234567
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
|
Can anyone else replicate this bug?
This saved search indefinitely freezes Calibre when running from source (eventually I kill process), but not on stable: Code:
template:"""program: has_extra_files()#@#:b:yes""" |
03-06-2024, 08:32 PM | #22 |
Bibliophagist
Posts: 35,464
Karma: 145525534
Join Date: Jul 2010
Location: Vancouver
Device: Kobo Sage, Forma, Clara HD, Lenovo M8 FHD, Paperwhite 4, Tolino epos
|
It doesn't hang on my computer but since no extra files, it also returns no results.
|
03-06-2024, 08:48 PM | #23 | |
want to learn what I want
Posts: 1,002
Karma: 6422750
Join Date: Sep 2020
Device: Calibre E-book viewer
|
Quote:
edit: takes more like 15 to 17 seconds. On the other hand, I have a "has author notes" python search kindly provided by C.haley, that runs very fast, returning 4600 titles almost instantly: Spoiler:
Last edited by Comfy.n; 03-06-2024 at 09:15 PM. Reason: add more precise timing |
|
03-06-2024, 09:24 PM | #24 |
Custom User Title
Posts: 8,639
Karma: 61234567
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
|
I have about 60 books with data files (mostly alternative covers, or backups of the covers for fanfics). It takes about 5-7 seconds to load the search on stable Calibre, less if I'm in a VL.
Further tests I noticed on source the indefinite freeze is less likely to occur if I'm in a VL. Last edited by ownedbycats; 03-06-2024 at 09:28 PM. |
03-07-2024, 12:16 AM | #25 |
Grand Sorcerer
Posts: 11,742
Karma: 6997045
Join Date: Jan 2010
Location: Notts, England
Device: Kobo Libra 2
|
It doesn't freeze for me, using current source and in debug mode.
The only library I have with extra files is small, 100 books. The search is near instantaneous. On a large library with 77,000 books but no extra files the search takes a few seconds. The function will take a while to run. It must look in every book folder to see if there is a non-empty data subfolder. The answer is cached so the future runs will be faster. The cache is cleared whenever an operation changes the contents of one of the folders. Of note: has_extra_files() is not affected by the changes I made to get_metadata(). It doesn't use it. Questions:
|
03-07-2024, 07:50 AM | #26 |
Grand Sorcerer
Posts: 11,742
Karma: 6997045
Join Date: Jan 2010
Location: Notts, England
Device: Kobo Libra 2
|
I did some tests on my 77,500-book library.
With no data files at all, repeated runs took an average of 18.5 seconds. There was one outlier that took 30 seconds, which I think happened because my cloud auto-backup daemon kicked in. With 40, 50, and 60 data files it took an average of 18.7 seconds, with no significant outliers. I tried this python template that marks matched books instead of using search. It is slower, taking around 1.5 seconds longer than the search. I am sure that the difference is in the GUI refresh to show the marks, but I didn't do the work to verify it. Code:
python: def evaluate(book, context): from calibre.db.constants import DATA_FILE_PATTERN from time import monotonic start = monotonic() count = 0; db = context.db db.data.set_marked_ids(set()) db = db.new_api found = set() for id_ in db.all_book_ids(): files = tuple(f.relpath.partition('/')[-1] for f in db.list_extra_files(id_, use_cache=True, pattern=DATA_FILE_PATTERN)) if len(files) > 0: #print(f'{id_}: {files}') count += 1 found.add(id_) context.db.data.set_marked_ids(found) return (f'template search time: {monotonic() - start:.2f}, {count}') Bottom line: I can't reproduce a hang. The process can take several seconds. I think the process will slow down significantly if the computer is memory-challenged or if there are other processes competing for the CPU. In particular, an anti-virus that monitors file accesses could greatly affect performance because multiple accesses are required to check each book. |
03-07-2024, 08:22 AM | #27 | |
want to learn what I want
Posts: 1,002
Karma: 6422750
Join Date: Sep 2020
Device: Calibre E-book viewer
|
Quote:
I wanted to compare timings to the GPM mode, but I get an error while trying this search. I mean, the search bar gets red. :\ Spoiler:
|
|
03-07-2024, 08:25 AM | #28 |
Grand Sorcerer
Posts: 11,742
Karma: 6997045
Join Date: Jan 2010
Location: Notts, England
Device: Kobo Libra 2
|
That template can't be used as a template search. It returns the wrong things. To run it, use the template tester.
|
03-07-2024, 10:43 AM | #29 |
Custom User Title
Posts: 8,639
Karma: 61234567
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
|
My steps:
1. Restarted in debug mode. 2. Switched to 'all books.' 3. Opened the task manager and put the window on top. 4. Clicked my 'has extra files' saved search. Observations: 1. Disk usage on my library disk went to 100%. 2. No noticable increase of CPU usage. 3. The search completed after about 10-15 seconds. The debug log didn't show anything really, just all the usual startup messages. I repeated the steps except not in debug mode. Same results. I did reboot overnight, so maybe something else was interfering and causing the freeze. Last edited by ownedbycats; 03-07-2024 at 11:18 AM. |
03-08-2024, 02:20 AM | #30 |
Bibliophagist
Posts: 35,464
Karma: 145525534
Join Date: Jul 2010
Location: Vancouver
Device: Kobo Sage, Forma, Clara HD, Lenovo M8 FHD, Paperwhite 4, Tolino epos
|
Something I really hated when I worked in IT was telling someone to reboot their computer. Very often it "fixed" the problem so was pretty much the first thing we had the user try but no help in figuring out what the root issue was.
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
How to debug or run Sigil's source code in VS2017 | darencainiao | Sigil | 9 | 05-10-2023 05:19 AM |
Request if you run from source and use hierarchical columns | chaley | Library Management | 0 | 05-28-2020 12:16 PM |
To CC users who run calibre from source ... | chaley | Calibre Companion | 2 | 12-09-2014 09:24 AM |
Run from Source on Windows? | itimpi | Calibre | 12 | 01-22-2009 04:34 AM |