Calibre Temp folders, yet again

The QCC · 03-04-2011, 08:45 AM

I know this question was asked in 2009, but the problem still exists.
Calibre leaves dozens of temporary folders in the Windows 7 Temp folder.
Calibre NEVER clears these folders.
The folders are of this type:
calibre_0.7.47_tmp_nxydob

I can reduce the number of folders created by reducing the number of active worker processes to 2, but this does not solve the problem. If the worker processes are crashing and not cleaning up, then there is a problem with Calibre.

The previous recommended solution, close Calibre properly.
HOW?
There is no proper Exit or Close button. The only exit method is Alt F4.
Using the Calibre Restart option only creates more temporary folders.

If nothing else, Calibre should offer a manual Purge Temp Files option.

Carl.

itimpi · 03-04-2011, 09:10 AM

I get around this by starting Calibre with a batch file that (amongst other things) contains the following:

Code:

SET CALIBRE_TEMP_DIR=%TEMP%\CALIBRE_TEMP
ECHO TEMPORARY FILES: %CALIBRE_TEMP_DIR%

IF EXIST "%CALIBRE_TEMP_DIR%" RMDIR /s /q "%CALIBRE_TEMP_DIR%"
MKDIR "%CALIBRE_TEMP_DIR%"
REM set the following for any components that do
REM not obey the CALIBRE_TEMP_DIR setting
SET TMP=%CALIBRE_TEMP_DIR%
SET TEMP=%CALIBRE_TEMP_DIR%

This does not mean that calibre cannot leave temporary files behind in any particular run, but it does mean that any calibre temporary files left from previous runs are removed before starting up calibre again.

This technique is also used in the "Calibre Portable.bat" file that is included with Calibre.

I hope this helps.

user_none · 03-04-2011, 10:18 AM

Part of the problem with the temp file issue is Windows. I have never run into left over temp files in Linux or OS X during normal use.

Closing the main window or choosing quit in the status icon (if you have it enabled) will properly close caibre and cause it to lean up any temp files.

jackie_w · 03-04-2011, 10:35 AM

In Windows you get leftover temp files no matter how cleanly you exit calibre. I don't know of any way to keep them under control other than using itimpi's method.

Edit: At least in Windows XP SP3. I can't speak for other Windows versions.

Manichean · 03-04-2011, 10:55 AM

I'm seeing the same thing on XP SP3. Since I somewhat regularly clean out my temporary files, however, it's not that big of a deal. And Calibre doesn't leave any huge files behind, from what I can tell.

kovidgoyal · 03-04-2011, 11:16 AM

On windows calibre leaves behind a few zero byte files. It's because of windows file locking. Either I have calibre wait for all worker process to shutdown and release the locks on their log files, which can take a while, making shutdown/restart times slow or I leave behind some zero byte files. I choose the latter.

jackie_w · 03-04-2011, 11:23 AM

Thank you for explaining.

kovidgoyal · 03-04-2011, 11:47 AM

I have added some code that tries harder to clear the worker log files, by explicitly closing them when killing workers. It should make it less likely that they are left behind.

Manichean · 03-04-2011, 01:12 PM

That sounds good.

DoctorOhh · 03-05-2011, 12:07 AM

Quote:

Originally Posted by The QCC

The previous recommended solution, close Calibre properly.

HOW?

There are two methods to exit out of calibre cleanly, Ctrl Q or right click on the icon in the system tray and selecting quit.

theducks · 03-05-2011, 09:54 AM

I use the Task tray icon Quit.
But not having a 'traditional' (text) Menu 'File:Quit' or Exit door Icon has always seemed odd to me considering the 'x' in the corner is only a close (the GUI, leave main in background)

kovidgoyal · 03-05-2011, 09:56 AM

The X in the corner does quit calibre, unless you have the system tray enabled (it is disabled by default).

The QCC · 03-05-2011, 01:15 PM

Thanks for the explanations.
My biggest concern about the left over Temp folders is for the non-tech savvy user of Calibre and Windows.

When I looked at a friend's computer, there were in excess of 250 temporary Calibre folders.

Most Windows users use their computers as appliances and do not know of the Temp folder or even where their ebooks are stored by Calibre.

Thanks Kovid for a great programme.

user_none · 03-05-2011, 01:46 PM

Quote:

Originally Posted by The QCC

My biggest concern about the left over Temp folders is for the non-tech savvy user of Calibre and Windows.
...
Most Windows users use their computers as appliances and do not know of the Temp folder

Which is why we only here complaints from technical users

theducks · 03-05-2011, 04:37 PM

Quote:

Originally Posted by The QCC

Most Windows users use their computers as appliances and do not know of the Temp folder or even where their ebooks are stored by Calibre.

Which is also why Windows provides a 'Clean-up Wizard'.

03-04-2011, 08:45 AM	#1
The QCC Junior Member Posts: 9 Karma: 10 Join Date: Dec 2010 Location: Kitchener, ON Canada Device: Augen EBA701 and Kindle Wi-Fi	Calibre Temp folders, yet again I know this question was asked in 2009, but the problem still exists. Calibre leaves dozens of temporary folders in the Windows 7 Temp folder. Calibre NEVER clears these folders. The folders are of this type: calibre_0.7.47_tmp_nxydob I can reduce the number of folders created by reducing the number of active worker processes to 2, but this does not solve the problem. If the worker processes are crashing and not cleaning up, then there is a problem with Calibre. The previous recommended solution, close Calibre properly. HOW? There is no proper Exit or Close button. The only exit method is Alt F4. Using the Calibre Restart option only creates more temporary folders. If nothing else, Calibre should offer a manual Purge Temp Files option. Carl.

03-04-2011, 09:10 AM	#2
itimpi Wizard Posts: 4,553 Karma: 950151 Join Date: Nov 2008 Device: Sony PRS-950, iphone/ipad (Marvin/iBooks/QuickReader)	I get around this by starting Calibre with a batch file that (amongst other things) contains the following: Code: SET CALIBRE_TEMP_DIR=%TEMP%\CALIBRE_TEMP ECHO TEMPORARY FILES: %CALIBRE_TEMP_DIR% IF EXIST "%CALIBRE_TEMP_DIR%" RMDIR /s /q "%CALIBRE_TEMP_DIR%" MKDIR "%CALIBRE_TEMP_DIR%" REM set the following for any components that do REM not obey the CALIBRE_TEMP_DIR setting SET TMP=%CALIBRE_TEMP_DIR% SET TEMP=%CALIBRE_TEMP_DIR% This does not mean that calibre cannot leave temporary files behind in any particular run, but it does mean that any calibre temporary files left from previous runs are removed before starting up calibre again. This technique is also used in the "Calibre Portable.bat" file that is included with Calibre. I hope this helps.

03-04-2011, 10:35 AM	#4
jackie_w Grand Sorcerer Posts: 6,267 Karma: 16544702 Join Date: Sep 2009 Location: UK Device: ClaraHD, Forma, Libra2, Clara2E, LibraCol, PBTouchHD3	In Windows you get leftover temp files no matter how cleanly you exit calibre. I don't know of any way to keep them under control other than using itimpi's method. Edit: At least in Windows XP SP3. I can't speak for other Windows versions. Last edited by jackie_w; 03-04-2011 at 10:37 AM. Reason: clarification

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Getting Calibre To See Folders on IQ	MmavisO	Calibre	6	12-19-2010 03:28 PM
Instapaper folders and Calibre	flyash	Calibre	4	08-13-2010 02:01 AM
Deleting temp calibre files sometimes takes forever	Takeshi_12	Calibre	6	07-29-2010 05:13 PM
Win Temp file mess w/ Calibre?	Spiffy	Calibre	1	06-01-2010 06:34 AM
Calibre files left in Temp folder	itimpi	Calibre	8	05-06-2009 06:15 AM

03-04-2011, 10:18 AM	#3
user_none Sigil & calibre developer Posts: 2,487 Karma: 1063785 Join Date: Jan 2009 Location: Florida, USA Device: Nook STR	Part of the problem with the temp file issue is Windows. I have never run into left over temp files in Linux or OS X during normal use. Closing the main window or choosing quit in the status icon (if you have it enabled) will properly close caibre and cause it to lean up any temp files.

03-04-2011, 10:55 AM	#5
Manichean Wizard Posts: 3,130 Karma: 91256 Join Date: Feb 2008 Location: Germany Device: Cybook Gen3	I'm seeing the same thing on XP SP3. Since I somewhat regularly clean out my temporary files, however, it's not that big of a deal. And Calibre doesn't leave any huge files behind, from what I can tell.

03-04-2011, 11:16 AM	#6
kovidgoyal creator of calibre Posts: 45,604 Karma: 28548974 Join Date: Oct 2006 Location: Mumbai, India Device: Various	On windows calibre leaves behind a few zero byte files. It's because of windows file locking. Either I have calibre wait for all worker process to shutdown and release the locks on their log files, which can take a while, making shutdown/restart times slow or I leave behind some zero byte files. I choose the latter.

03-04-2011, 11:23 AM	#7
jackie_w Grand Sorcerer Posts: 6,267 Karma: 16544702 Join Date: Sep 2009 Location: UK Device: ClaraHD, Forma, Libra2, Clara2E, LibraCol, PBTouchHD3	Thank you for explaining.

03-04-2011, 11:47 AM	#8
kovidgoyal creator of calibre Posts: 45,604 Karma: 28548974 Join Date: Oct 2006 Location: Mumbai, India Device: Various	I have added some code that tries harder to clear the worker log files, by explicitly closing them when killing workers. It should make it less likely that they are left behind.

03-04-2011, 01:12 PM	#9
Manichean Wizard Posts: 3,130 Karma: 91256 Join Date: Feb 2008 Location: Germany Device: Cybook Gen3	That sounds good.

03-05-2011, 09:54 AM	#11
theducks Well trained by Cats Posts: 31,249 Karma: 61360164 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	I use the Task tray icon Quit. But not having a 'traditional' (text) Menu 'File:Quit' or Exit door Icon has always seemed odd to me considering the 'x' in the corner is only a close (the GUI, leave main in background)

03-05-2011, 09:56 AM	#12
kovidgoyal creator of calibre Posts: 45,604 Karma: 28548974 Join Date: Oct 2006 Location: Mumbai, India Device: Various	The X in the corner does quit calibre, unless you have the system tray enabled (it is disabled by default).

03-05-2011, 01:15 PM	#13
The QCC Junior Member Posts: 9 Karma: 10 Join Date: Dec 2010 Location: Kitchener, ON Canada Device: Augen EBA701 and Kindle Wi-Fi	Thanks for the explanations. My biggest concern about the left over Temp folders is for the non-tech savvy user of Calibre and Windows. When I looked at a friend's computer, there were in excess of 250 temporary Calibre folders. Most Windows users use their computers as appliances and do not know of the Temp folder or even where their ebooks are stored by Calibre. Thanks Kovid for a great programme.

Advert

Advert