Cancel Metadata Backup?

Phil_in_HHHI · 12-11-2019, 08:14 AM

Ignorantly I queued all my books for metadata backup - without it being necessary - all my books have correct opf files and the library checks out ok. Unfortunately this process is moving at a glacial pace and after 5% of the catalog are done I expect the process to take about 8 full days. Is there any way to stop this process?

Thx

kovidgoyal · 12-11-2019, 08:15 AM

click the close button

Phil_in_HHHI · 12-11-2019, 11:07 AM

Kovid, well that's what I did first. Whenever I re-open the Metadata Backup Status, it shows the process is still going merrily on, at about a book every 3 seconds. This wouldn't be a major issue if the library wasn't sitting in a Dropbox folder (so I can use the Calibre Companion app from my iPad).

BTW, thank you for your great work on Calibre, a piece of really useful and well designed software.

kovidgoyal · 12-11-2019, 11:23 AM

No there's no way to cancel it, but if you want to speed it up, run

calibredb backup_metadata

in a command prompt

ilovejedd · 12-11-2019, 11:37 AM

The Job Spy plugin has an option to clear the metadata (OPF) backup queue.

Phil_in_HHHI · 12-11-2019, 01:58 PM

Thank you!

manixdk · 02-23-2020, 05:02 PM

I tried that, and it's still happening

BetterRed · 02-23-2020, 06:19 PM

@manixdk - Tried what -- JobSpy or the calibredb command?

Some metadata changes will cascade into many books, e.g. if you deleted a tag that was used by thousands of books then thousands of metadata.opfs would be updated.

BR

manixdk · 02-24-2020, 07:34 AM

@BetterRed Both. The queue was cleared nicely with job spy, but when I tried the calibredb command, the result was
Failed to initialize plugin: u'C:\\Users\\xxxxx\\AppData\\Roaming\\calibre\\plu gins\\Job Spy.zip'
Sometimes it works well after a reboot, and I can read books in at a good pace. Then I close it down, start it up, and it's excruciatingly slow again.

BetterRed · 02-24-2020, 08:10 AM

@manixdk - you should report that error in the JS thread. Optional plugins shouldn't prevent core command line programs from working.

But I suspect you have some 'deeper' problem with the library database. After taking a backup of the library it might be worth doing a database restore.

BR

manixdk · 02-24-2020, 02:21 PM

@BR
I defragged my library drive, which took around 6 hours on and NTFS (!) and now it's humming along sweetly. I'll see for how long. Thanks for the help.

theducks · 02-24-2020, 03:21 PM

Quote:

Originally Posted by manixdk

@BR
I defragged my library drive, which took around 6 hours on and NTFS (!) and now it's humming along sweetly. I'll see for how long. Thanks for the help.

How big is that partition?
Or were you doing other drive intensive stuff at the time?

manixdk · 02-24-2020, 03:53 PM

1Gig with thousands of files.

manixdk · 02-24-2020, 04:05 PM

Quote:

Originally Posted by manixdk

1Gig with thousands of files.

That should be 1TB with hundreds of thousands of files

theducks · 02-24-2020, 04:09 PM

Quote:

Originally Posted by manixdk

1Gig with thousands of files.

Something is seriously wrong with your system.
I just ran a test on the 2G drive in my sad old Core Duo.
Defrag took 30 Min ,many 100K's of files on the drive. The Library is 54K files by itself

12-11-2019, 08:14 AM	#1
Phil_in_HHHI Junior Member Posts: 3 Karma: 10 Join Date: Dec 2019 Device: Kobo Aura	Cancel Metadata Backup? Ignorantly I queued all my books for metadata backup - without it being necessary - all my books have correct opf files and the library checks out ok. Unfortunately this process is moving at a glacial pace and after 5% of the catalog are done I expect the process to take about 8 full days. Is there any way to stop this process? Thx

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Metadata backup runs without prompting	sobi	Library Management	3	10-02-2013 04:24 AM
speed up metadata backup	ilovejedd	Library Management	7	08-29-2013 11:27 PM
Custom metadata in archived/backup books?	PatNY	Library Management	14	03-29-2012 07:50 PM
metadata backup	silverraven	Calibre	3	03-06-2012 08:56 PM
Metadata Backup?	Mountainjack	Calibre	2	07-17-2011 05:42 PM

12-11-2019, 08:15 AM	#2
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	click the close button

12-11-2019, 11:07 AM	#3
Phil_in_HHHI Junior Member Posts: 3 Karma: 10 Join Date: Dec 2019 Device: Kobo Aura	Kovid, well that's what I did first. Whenever I re-open the Metadata Backup Status, it shows the process is still going merrily on, at about a book every 3 seconds. This wouldn't be a major issue if the library wasn't sitting in a Dropbox folder (so I can use the Calibre Companion app from my iPad). BTW, thank you for your great work on Calibre, a piece of really useful and well designed software.

12-11-2019, 11:23 AM	#4
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	No there's no way to cancel it, but if you want to speed it up, run calibredb backup_metadata in a command prompt

12-11-2019, 11:37 AM	#5
ilovejedd hopeless n00b Posts: 5,126 Karma: 19597086 Join Date: Jan 2009 Location: in the middle of nowhere Device: PW4, PW3, Libra H2O, iPad 10.5, iPad 11, iPad 12.9	The Job Spy plugin has an option to clear the metadata (OPF) backup queue.

12-11-2019, 01:58 PM	#6
Phil_in_HHHI Junior Member Posts: 3 Karma: 10 Join Date: Dec 2019 Device: Kobo Aura	Thank you!

02-23-2020, 05:02 PM	#7
manixdk Junior Member Posts: 8 Karma: 10 Join Date: Feb 2020 Device: none	I tried that, and it's still happening

02-23-2020, 06:19 PM	#8
BetterRed null operator (he/him) Posts: 22,018 Karma: 30277294 Join Date: Mar 2012 Location: Sydney Australia Device: none	@manixdk - Tried what -- JobSpy or the calibredb command? Some metadata changes will cascade into many books, e.g. if you deleted a tag that was used by thousands of books then thousands of metadata.opfs would be updated. BR

02-24-2020, 07:34 AM	#9
manixdk Junior Member Posts: 8 Karma: 10 Join Date: Feb 2020 Device: none	@BetterRed Both. The queue was cleared nicely with job spy, but when I tried the calibredb command, the result was Failed to initialize plugin: u'C:\\Users\\xxxxx\\AppData\\Roaming\\calibre\\plu gins\\Job Spy.zip' Sometimes it works well after a reboot, and I can read books in at a good pace. Then I close it down, start it up, and it's excruciatingly slow again.

02-24-2020, 08:10 AM	#10
BetterRed null operator (he/him) Posts: 22,018 Karma: 30277294 Join Date: Mar 2012 Location: Sydney Australia Device: none	@manixdk - you should report that error in the JS thread. Optional plugins shouldn't prevent core command line programs from working. But I suspect you have some 'deeper' problem with the library database. After taking a backup of the library it might be worth doing a database restore. BR

02-24-2020, 02:21 PM	#11
manixdk Junior Member Posts: 8 Karma: 10 Join Date: Feb 2020 Device: none	@BR I defragged my library drive, which took around 6 hours on and NTFS (!) and now it's humming along sweetly. I'll see for how long. Thanks for the help.

02-24-2020, 03:53 PM	#13
manixdk Junior Member Posts: 8 Karma: 10 Join Date: Feb 2020 Device: none	1Gig with thousands of files.