.bak files after compressing images

Rand Brittain · 12-21-2015, 06:13 PM

Is the bug that got fixed in the most previous release the one that left tiny .bak files in books that got compressed?

If so, were the .bak files replacing images? I got the impression that they were just there alongside images since I didn't notice missing stuff. If they were replacing images in the book I probably need to check through my library more carefully.

JSWolf · 12-21-2015, 06:50 PM

I too found I got .bak files left behind in the ePub. This is a bug. I hope this is fixed in 2.47.

JSWolf · 12-21-2015, 07:38 PM

I still get .bak files in the ePub with Calibre 2.47 64-bit Windows.

eschwartz · 12-21-2015, 08:07 PM

The fix related to files being accidentally "compressed" into zero-byte files.

But I don't see any references in the source code to *.bak files, the temporary files which ARE created are deleted, and I cannot find any *.bak files appearing in my newly-polished books.

Arch Linux latest, calibre v2.47.0.r13.gc98dc66

Rand Brittain · 12-21-2015, 11:34 PM

I tried the tool on my 800-book library and got about 50 books with .bak files in them. Nothing seemed to be missing, so I just used the modify tool to delete any files that weren't in the manifest from them.

(There seemed to be a correlation between jobs that took a long time to process in the queue and files that left .bak after processing, but I can't really say with any exactitude.)

kovidgoyal · 12-21-2015, 11:44 PM

I think it only happens for for some .png files -- the tool calibre uses, optipng creates them. However, it is supposed to only create them when the -backup or -keep options are provided, which calibre does not do. So it looks like a bug in some versions of optipng. I can add a check to calibre to look for and delete these files after optipng runs. They are harmless, being zero bytes in size, (apart from causing epubcheck to complain) so you can just delete them from the epub files, or leave them in there -- it does not matter.

kovidgoyal · 12-22-2015, 12:05 AM

@Rand: Yes indeed, compressing PNG files is much slower than JPEG files (PNG compression happens by trial and error of compression parameters to zlib).

kovidgoyal · 12-22-2015, 12:11 AM

https://github.com/kovidgoyal/calibr...4963a5eba1360a

Rand Brittain · 12-22-2015, 11:36 AM

Looks like there's no meaningful harm, done, then, but it's good to know that it wasn't just me.

12-21-2015, 06:13 PM	#1
Rand Brittain Bookmaker Posts: 434 Karma: 2143650 Join Date: Sep 2010 Device: Cybook Opus	.bak files after compressing images Is the bug that got fixed in the most previous release the one that left tiny .bak files in books that got compressed? If so, were the .bak files replacing images? I got the impression that they were just there alongside images since I didn't notice missing stuff. If they were replacing images in the book I probably need to check through my library more carefully.

12-21-2015, 08:07 PM	#4
eschwartz Ex-Helpdesk Junkie Posts: 19,421 Karma: 85400180 Join Date: Nov 2012 Location: The Beaten Path, USA, Roundworld, This Side of Infinity Device: Kindle Touch fw5.3.7 (Wifi only)	The fix related to files being accidentally "compressed" into zero-byte files. But I don't see any references in the source code to .bak files, the temporary files which ARE created are deleted, and I cannot find any .bak files appearing in my newly-polished books. Arch Linux latest, calibre v2.47.0.r13.gc98dc66 Last edited by eschwartz; 12-21-2015 at 08:09 PM.

12-21-2015, 11:44 PM	#6
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	I think it only happens for for some .png files -- the tool calibre uses, optipng creates them. However, it is supposed to only create them when the -backup or -keep options are provided, which calibre does not do. So it looks like a bug in some versions of optipng. I can add a check to calibre to look for and delete these files after optipng runs. They are harmless, being zero bytes in size, (apart from causing epubcheck to complain) so you can just delete them from the epub files, or leave them in there -- it does not matter. Last edited by kovidgoyal; 12-22-2015 at 12:06 AM.

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Mangas batch compressing (Windows only)	farfeduc	Kindle Developer's Corner	7	07-04-2013 06:37 PM
Stop epub conversion compressing images -please	rrand123	Conversion	3	12-28-2012 05:47 AM
Compressing large PDFs	Artha	PDF	7	12-18-2011 07:32 PM
Html files with images, is it possible?	megaman	Bookeen	4	10-27-2008 07:28 AM
RTF-Files, but then WITH images...	maxvoltar	Workshop	8	06-02-2007 06:10 PM

12-21-2015, 06:50 PM	#2
JSWolf Resident Curmudgeon Posts: 80,782 Karma: 150249619 Join Date: Nov 2006 Location: Roslindale, Massachusetts Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3	I too found I got .bak files left behind in the ePub. This is a bug. I hope this is fixed in 2.47.

12-21-2015, 07:38 PM	#3
JSWolf Resident Curmudgeon Posts: 80,782 Karma: 150249619 Join Date: Nov 2006 Location: Roslindale, Massachusetts Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3	I still get .bak files in the ePub with Calibre 2.47 64-bit Windows.

12-21-2015, 11:34 PM	#5
Rand Brittain Bookmaker Posts: 434 Karma: 2143650 Join Date: Sep 2010 Device: Cybook Opus	I tried the tool on my 800-book library and got about 50 books with .bak files in them. Nothing seemed to be missing, so I just used the modify tool to delete any files that weren't in the manifest from them. (There seemed to be a correlation between jobs that took a long time to process in the queue and files that left .bak after processing, but I can't really say with any exactitude.)

12-22-2015, 12:05 AM	#7
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	@Rand: Yes indeed, compressing PNG files is much slower than JPEG files (PNG compression happens by trial and error of compression parameters to zlib).

12-22-2015, 12:11 AM	#8
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	https://github.com/kovidgoyal/calibr...4963a5eba1360a

12-22-2015, 11:36 AM	#9
Rand Brittain Bookmaker Posts: 434 Karma: 2143650 Join Date: Sep 2010 Device: Cybook Opus	Looks like there's no meaningful harm, done, then, but it's good to know that it wasn't just me.