Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Library Management

Notices

Reply
 
Thread Tools Search this Thread
Old 02-02-2022, 05:24 AM   #16
glenm
Member
glenm began at the beginning.
 
glenm's Avatar
 
Posts: 19
Karma: 10
Join Date: Jul 2011
Location: Adelaide Australia
Device: Windows
Finding Missing EBook files

I've written a small utility in C# that will analyze a Caliber Library and list all the books that are in the Caliber metadata database but do not exist on disc.

The source can be found here - https://github.com/glenm80/CaliberMissing

It's written in C# using Visual Studio 2022 Community and the only dependency is on SQLite Core which is obtained from NuGet

The list of books can be exported to a text/csv by Right Clicking the list and exporting the data.

I will put a more comprehensive post in the Related Tools area of this forum.

Edit: Corrected spelling

Last edited by glenm; 02-02-2022 at 05:26 AM.
glenm is offline   Reply With Quote
Old 02-13-2022, 08:12 AM   #17
desbutes
Junior Member
desbutes began at the beginning.
 
Posts: 1
Karma: 10
Join Date: May 2014
Device: asus memopad 102a
hi,
Thanks for work but error 404 even with identification.
desbutes is offline   Reply With Quote
Old 02-13-2022, 03:39 PM   #18
DNSB
Bibliophagist
DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.
 
DNSB's Avatar
 
Posts: 46,191
Karma: 168983734
Join Date: Jul 2010
Location: Vancouver
Device: Kobo Sage, Libra Colour, Lenovo M8 FHD, Paperwhite 4, Tolino epos
The only repository I see at https://github.com/glenm80/ is IconInfo.
DNSB is offline   Reply With Quote
Old 02-14-2022, 04:24 AM   #19
glenm
Member
glenm began at the beginning.
 
glenm's Avatar
 
Posts: 19
Karma: 10
Join Date: Jul 2011
Location: Adelaide Australia
Device: Windows
Quote:
Originally Posted by DNSB View Post
The only repository I see at https://github.com/glenm80/ is IconInfo.
My error, the repository was private - it's now public and you should be able to see it
glenm is offline   Reply With Quote
Old 02-14-2022, 07:37 AM   #20
PeterT
Grand Sorcerer
PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.
 
Posts: 13,511
Karma: 78910202
Join Date: Nov 2007
Location: Toronto
Device: Libra H2O, Libra Colour
Quote:
Originally Posted by glenm View Post
I've written a small utility in C# that will analyze a Caliber Library and list all the books that are in the Caliber metadata database but do not exist on disc.

The source can be found here - https://github.com/glenm80/CaliberMissing

It's written in C# using Visual Studio 2022 Community and the only dependency is on SQLite Core which is obtained from NuGet

The list of books can be exported to a text/csv by Right Clicking the list and exporting the data.

I will put a more comprehensive post in the Related Tools area of this forum.

Edit: Corrected spelling
FYI. It's calibre NOT caliber
PeterT is offline   Reply With Quote
Old 09-23-2022, 08:54 AM   #21
matmp
Junior Member
matmp began at the beginning.
 
Posts: 1
Karma: 10
Join Date: Sep 2022
Device: Nook
Missing epub : solution in Calibre

Create a custom column
(find in : [URL=https://www.reddit.com/r/Calibre/comments/s48dzy/how_to_find_entries_that_dont_have_actual_files/[/URL])

Open "Preference" in Calibre, then "create custom column"
Choose "quick start" then "format"

Rename title like "Have Book" (as you want !)
Column type : let by default
Show checkmarks
Description : "Epub exist or miss"
Template model : {#formats:test(yes,no)}
Replace "Text" by "Yes/No"

Ok
Apply
Restart Calibre

You'll see in that new column if the book (epub) exist or miss !
matmp is offline   Reply With Quote
Old 09-23-2022, 10:38 AM   #22
Sirtel
Grand Sorcerer
Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.
 
Sirtel's Avatar
 
Posts: 13,471
Karma: 239219543
Join Date: Jan 2014
Location: Estonia
Device: Kobo Sage & Libra 2
Quote:
Originally Posted by matmp View Post
Create a custom column
(find in : [URL=https://www.reddit.com/r/Calibre/comments/s48dzy/how_to_find_entries_that_dont_have_actual_files/[/URL])

Open "Preference" in Calibre, then "create custom column"
Choose "quick start" then "format"

Rename title like "Have Book" (as you want !)
Column type : let by default
Show checkmarks
Description : "Epub exist or miss"
Template model : {#formats:test(yes,no)}
Replace "Text" by "Yes/No"

Ok
Apply
Restart Calibre

You'll see in that new column if the book (epub) exist or miss !
This does not find the missing formats Calibre doesn't know about, e.g. in the case of database corruption or errors in the library.
Sirtel is offline   Reply With Quote
Old 09-23-2022, 11:05 AM   #23
chaley
Grand Sorcerer
chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.
 
Posts: 12,447
Karma: 8012886
Join Date: Jan 2010
Location: Notts, England
Device: Kobo Libra 2
Quote:
Originally Posted by matmp View Post
Create a custom column
(find in : [URL=https://www.reddit.com/r/Calibre/comments/s48dzy/how_to_find_entries_that_dont_have_actual_files/[/URL])
Quote:
Originally Posted by Sirtel View Post
This does not find the missing formats Calibre doesn't know about, e.g. in the case of database corruption or errors in the library.
Although I can't see why one would want such a column, this template does tell you if formats exist in the database but not on the disk and is appropriate for a custom column. Its performance isn't ideal.
Code:
program:
	on_disk = list_re(formats_sizes(), ',', '^(.*):.*$', '\1');
	in_db = approximate_formats();
	list_equals(in_db, ',', on_disk, ',', 'OK', 'Missing some of ' & in_db)
Assuming for some reason I don't want to use Check library, I would use a variant of the above template in a template search. That way I pay the performance penalty only when I want to. This template would work:
Code:
program:
	on_disk = list_re(formats_sizes(), ',', '^(.*):.*$', '\1');
	in_db = approximate_formats();
	list_equals(in_db, ',', on_disk, ',', 'OK', 'BAD')
with this template search:
Attached Thumbnails
Click image for larger version

Name:	Clipboard01.jpg
Views:	122
Size:	69.1 KB
ID:	196734  
chaley is offline   Reply With Quote
Old 11-02-2023, 01:45 PM   #24
dwilliamhouston
Junior Member
dwilliamhouston began at the beginning.
 
Posts: 5
Karma: 10
Join Date: Oct 2023
Device: Kindle Paperwhite
There is another way this can happen and now trying to figure out how/why. If you click on a book and then do a Remove book of specific format you can delete all books and it leaves the book with no actual book in it. So is there a way to find out all book records that don't have any book formats associated with it? Also, is this a bug or by design? Thanks.
dwilliamhouston is offline   Reply With Quote
Old 11-02-2023, 01:53 PM   #25
Sirtel
Grand Sorcerer
Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.
 
Sirtel's Avatar
 
Posts: 13,471
Karma: 239219543
Join Date: Jan 2014
Location: Estonia
Device: Kobo Sage & Libra 2
Quote:
Originally Posted by dwilliamhouston View Post
There is another way this can happen and now trying to figure out how/why. If you click on a book and then do a Remove book of specific format you can delete all books and it leaves the book with no actual book in it. So is there a way to find out all book records that don't have any book formats associated with it? Also, is this a bug or by design? Thanks.
Type formats:false in the search bar. And yes, this is by design.
Sirtel is offline   Reply With Quote
Old 11-02-2023, 02:00 PM   #26
theducks
Well trained by Cats
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 31,055
Karma: 60358908
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
Remove book: specific format does not check (nor is it supposed to) if it is the ONLY format for that book

I cringe when I hear folk who use some of the built in tools IN BULK without considering all the possibilities.

formats: false will find books that have none (that are registered in the DB). This may be valid depending... I use 'empty book' as a wish list and to document my paperback collection.
theducks is offline   Reply With Quote
Old 11-02-2023, 02:06 PM   #27
dwilliamhouston
Junior Member
dwilliamhouston began at the beginning.
 
Posts: 5
Karma: 10
Join Date: Oct 2023
Device: Kindle Paperwhite
Thanks.
dwilliamhouston is offline   Reply With Quote
Old 11-02-2023, 02:15 PM   #28
Sirtel
Grand Sorcerer
Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.
 
Sirtel's Avatar
 
Posts: 13,471
Karma: 239219543
Join Date: Jan 2014
Location: Estonia
Device: Kobo Sage & Libra 2
Quote:
Originally Posted by theducks View Post
formats: false will find books that have none (that are registered in the DB). This may be valid depending... I use 'empty book' as a wish list and to document my paperback collection.
I have a few old ebooks where formatting was so bad that I just deleted the formats, but left the book record. As fixing them would have taken several hours or even days, I just couldn't be bothered, and I would never have read such a mess. Some were later released in newer, properly formatted editions, but not all, and presumably will never be (usually because their publisher has since ceased to exist).
Sirtel is offline   Reply With Quote
Reply


Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
find missing classes kcarscadden Editor 4 12-10-2019 08:16 PM
Find and remove un-indexed files from library folder eater Library Management 2 06-20-2019 11:31 AM
Library now missing all .mobi, pdf, epub files ChipAHoy Library Management 2 06-27-2017 06:36 PM
Can't Find Calibre News Files in Kindle Library Bobomo Devices 3 05-21-2016 12:04 AM
How to find books with missing metadata? kaufman Library Management 1 01-04-2014 12:32 AM


All times are GMT -4. The time now is 02:14 PM.


MobileRead.com is a privately owned, operated and funded community.