Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre

Notices

Reply
 
Thread Tools Search this Thread
Old 08-17-2009, 09:05 AM   #1
bthoven
Evangelist
bthoven will become famous soon enoughbthoven will become famous soon enoughbthoven will become famous soon enoughbthoven will become famous soon enoughbthoven will become famous soon enoughbthoven will become famous soon enough
 
bthoven's Avatar
 
Posts: 452
Karma: 544
Join Date: Aug 2009
Location: Bangkok, Thailand
Device: Kindle'r 3, iPhone 3Gs, iPad 2, Galaxy Tab Wifi
eNews - How to auto replace old files

I used to use Mobipocket on Nokia. I think it is an excellent ebooks and enews reader. The desktop version to manage the ebooks/enews are also easy and effortless to use. Unfortunately, it seems no hope to use it on iPhone.

I usually subscribe for quite a number of full feeds and it automatically download the latest news, replacing the old ones and install into my phone without my intervention.

Calibre is the only option I have for iPhone to allow me to read offline news feed.

Using Calibre, I also subscribe to the same feeds; however:

1. it is much slower to fetch the feeds
2. it always create new files, instead of replacing. So I have to delete the old files manually
3. During fetching my scheduled news feeds, my PC is very slow to response. Most of the time, it comes to the point where I cannot do other tasks during the fetching.

How can I resolve the issue 2 and 3?

Thanks in advance.
bthoven is offline   Reply With Quote
Old 08-17-2009, 11:48 AM   #2
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 26,338
Karma: 5382313
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
2. There is an option at the bottom of the fetch news dialog that says

"Delete news older than x days" use it

3. In the Preferences set the process priority to Low
kovidgoyal is offline   Reply With Quote
Old 08-17-2009, 01:29 PM   #3
itimpi
Wizard
itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.
 
Posts: 4,094
Karma: 780247
Join Date: Nov 2008
Device: Sony PRS-950, iphone/ipad (Marvin/iBooks/QuickReader)
Quote:
Originally Posted by bthoven View Post
3. During fetching my scheduled news feeds, my PC is very slow to response. Most of the time, it comes to the point where I cannot do other tasks during the fetching.
I have the priority for calibre background tasks set to Low in the Calibre preferences.

I also start Calibre itself via a batch file containing
START /BELOWNORMAL Calibre.exe

The combination of these two seem to keep the PC reasonably responsive when Calibre is running.
itimpi is offline   Reply With Quote
Old 08-18-2009, 01:20 AM   #4
bthoven
Evangelist
bthoven will become famous soon enoughbthoven will become famous soon enoughbthoven will become famous soon enoughbthoven will become famous soon enoughbthoven will become famous soon enoughbthoven will become famous soon enough
 
bthoven's Avatar
 
Posts: 452
Karma: 544
Join Date: Aug 2009
Location: Bangkok, Thailand
Device: Kindle'r 3, iPhone 3Gs, iPad 2, Galaxy Tab Wifi
Thanks for the tips

I try setting priority to low. The result was the same..it still drag my PC to almost halt.

A few months back, I never experienced this..I'm not sure it happened just with the newer version I installed?

Any further suggestion?
bthoven is offline   Reply With Quote
Old 08-18-2009, 03:36 AM   #5
itimpi
Wizard
itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.
 
Posts: 4,094
Karma: 780247
Join Date: Nov 2008
Device: Sony PRS-950, iphone/ipad (Marvin/iBooks/QuickReader)
Did you also use the tip for setting the main Calibre process to BelowNormal priority?

If not, you can test the effect by doing it manually using Task Manager.
itimpi is offline   Reply With Quote
Old 08-18-2009, 05:09 AM   #6
acidzebra
Liseuse Lover
acidzebra ought to be getting tired of karma fortunes by now.acidzebra ought to be getting tired of karma fortunes by now.acidzebra ought to be getting tired of karma fortunes by now.acidzebra ought to be getting tired of karma fortunes by now.acidzebra ought to be getting tired of karma fortunes by now.acidzebra ought to be getting tired of karma fortunes by now.acidzebra ought to be getting tired of karma fortunes by now.acidzebra ought to be getting tired of karma fortunes by now.acidzebra ought to be getting tired of karma fortunes by now.acidzebra ought to be getting tired of karma fortunes by now.acidzebra ought to be getting tired of karma fortunes by now.
 
acidzebra's Avatar
 
Posts: 869
Karma: 1035404
Join Date: Jul 2008
Location: Netherlands
Device: PRS-505
Quote:
Originally Posted by kovidgoyal View Post
2. There is an option at the bottom of the fetch news dialog that says "Delete news older than x days" use it
I've set this to 1 day, and it faithfully deletes news from my library, but not from my reader?

Also, regarding CPU usage, I've noticed that on my work machine (windows) Calibre does tend to hog the CPU (the machine is a HP 2510p laptop which rather poor CPU cooling and fetching the BBC feed sometimes causes the CPU to overheat so badly the BIOS kicks in and shuts the thing down), this is not nearly as noticeable on my main linux box. I'll try setting the prefs on windows, see if that helps.
acidzebra is offline   Reply With Quote
Old 08-18-2009, 06:12 AM   #7
bthoven
Evangelist
bthoven will become famous soon enoughbthoven will become famous soon enoughbthoven will become famous soon enoughbthoven will become famous soon enoughbthoven will become famous soon enoughbthoven will become famous soon enough
 
bthoven's Avatar
 
Posts: 452
Karma: 544
Join Date: Aug 2009
Location: Bangkok, Thailand
Device: Kindle'r 3, iPhone 3Gs, iPad 2, Galaxy Tab Wifi
Thanks a lot for all your tips.

My notebook is Pentium Dual Core 1.66ghz. I've never noticed about the overheat of CPU; now your experience really frighten me!
bthoven is offline   Reply With Quote
Old 08-18-2009, 06:16 AM   #8
acidzebra
Liseuse Lover
acidzebra ought to be getting tired of karma fortunes by now.acidzebra ought to be getting tired of karma fortunes by now.acidzebra ought to be getting tired of karma fortunes by now.acidzebra ought to be getting tired of karma fortunes by now.acidzebra ought to be getting tired of karma fortunes by now.acidzebra ought to be getting tired of karma fortunes by now.acidzebra ought to be getting tired of karma fortunes by now.acidzebra ought to be getting tired of karma fortunes by now.acidzebra ought to be getting tired of karma fortunes by now.acidzebra ought to be getting tired of karma fortunes by now.acidzebra ought to be getting tired of karma fortunes by now.
 
acidzebra's Avatar
 
Posts: 869
Karma: 1035404
Join Date: Jul 2008
Location: Netherlands
Device: PRS-505
I wouldn't worry about it too much; as I've said the cooling on my HP is pretty poor.

Also, Itimpi's suggestion of running Calibre from a batch file with "START /BELOWNORMAL Calibre.exe" and Kovid's suggestion of setting the job priority to low has helped a lot.
acidzebra is offline   Reply With Quote
Old 08-18-2009, 11:45 AM   #9
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 26,338
Karma: 5382313
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Delete news doesn't delete from the reader. It wont until I implement syncing between library and reader. Right now calibre has no way to know which files on the reader were created by it and which not.
kovidgoyal is offline   Reply With Quote
Old 08-18-2009, 02:22 PM   #10
bthoven
Evangelist
bthoven will become famous soon enoughbthoven will become famous soon enoughbthoven will become famous soon enoughbthoven will become famous soon enoughbthoven will become famous soon enoughbthoven will become famous soon enough
 
bthoven's Avatar
 
Posts: 452
Karma: 544
Join Date: Aug 2009
Location: Bangkok, Thailand
Device: Kindle'r 3, iPhone 3Gs, iPad 2, Galaxy Tab Wifi
Quote:
Originally Posted by itimpi View Post
Did you also use the tip for setting the main Calibre process to BelowNormal priority?

If not, you can test the effect by doing it manually using Task Manager.
I try setting priority of all processes (Calibre, Calibre-parallel) to low; but it does not help.

During fetching enews (6 enews), I see a lot of Calibre-parallel processes running. Some of it takes up so high memory, almost 1gb. I believe this is the main reason why it slow down my PC because it perform page-in/out all the time due to insufficient memory (I have 1.5gb).

Even I kill the Calibre process, all those Calibre-parallel processes are still running in the background. I have to kill them manually one by one before I can use my PC for other tasks.

Any reason why it took so high memory?

Thanks

Last edited by bthoven; 08-18-2009 at 02:25 PM.
bthoven is offline   Reply With Quote
Old 08-19-2009, 09:12 AM   #11
bthoven
Evangelist
bthoven will become famous soon enoughbthoven will become famous soon enoughbthoven will become famous soon enoughbthoven will become famous soon enoughbthoven will become famous soon enoughbthoven will become famous soon enough
 
bthoven's Avatar
 
Posts: 452
Karma: 544
Join Date: Aug 2009
Location: Bangkok, Thailand
Device: Kindle'r 3, iPhone 3Gs, iPad 2, Galaxy Tab Wifi
What I notice is the Calibre-parallel.exe memory usage is growing as we continue fetching the enews. Even when the fetching finished, the Calibre-parallel.exe process is still there and its memory usage remains that high.

I'm not sure why the memory usage of the process needs to grow and is still hanging there even it has completed the fetching.
bthoven is offline   Reply With Quote
Old 08-19-2009, 12:09 PM   #12
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 26,338
Karma: 5382313
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
what version of calibre are you using? Each calibre-parallel process dies after it completes its task.
kovidgoyal is offline   Reply With Quote
Old 08-19-2009, 01:53 PM   #13
bthoven
Evangelist
bthoven will become famous soon enoughbthoven will become famous soon enoughbthoven will become famous soon enoughbthoven will become famous soon enoughbthoven will become famous soon enoughbthoven will become famous soon enough
 
bthoven's Avatar
 
Posts: 452
Karma: 544
Join Date: Aug 2009
Location: Bangkok, Thailand
Device: Kindle'r 3, iPhone 3Gs, iPad 2, Galaxy Tab Wifi
I use both the 0.6.5 and 0.5.14. It has the same issue but 0.5.14 still let me do other task without problem.
bthoven is offline   Reply With Quote
Old 08-19-2009, 02:03 PM   #14
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 26,338
Karma: 5382313
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Upgrade to 0.6.7 there have been various fixes since 0.6.5
kovidgoyal is offline   Reply With Quote
Old 08-20-2009, 04:38 AM   #15
JvdW
Zealot
JvdW doesn't litterJvdW doesn't litter
 
Posts: 115
Karma: 146
Join Date: Jul 2008
Location: Netherlands Veenendaal
Device: Palm T5, Sony PRS-505, Nook Color
Quote:
Originally Posted by bthoven View Post
What I notice is the Calibre-parallel.exe memory usage is growing as we continue fetching the enews. Even when the fetching finished, the Calibre-parallel.exe process is still there and its memory usage remains that high.

I'm not sure why the memory usage of the process needs to grow and is still hanging there even it has completed the fetching.
Goto www.sysinternals.com and download atleast Process Explorer, there are lots of goodies there, and run that. Browse through the menus and select a few extra columns to view (the ones from Process Memory are probably most interesting). Watch the memory usage when downloading news items.

I just did that and Calibre starts 4 calibre-parallel.exe processes (though that should be 2, 1 per cpu, this is a 1 cpu hyperthreaded P4). When news downloading is complete the parallel.exe responsible for the download dies and a new one is created to replace it. Keeping 4 of them available at all times.
Total memory usage doesn't seem alot to me, around 200Mb and thats on the high side.

Keep us posted of your findings,

Joop
JvdW is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Automatic replace old enews files, how? bthoven Calibre 4 11-08-2009 11:33 AM
eNews of the MobiPocket. llwwss Bookeen 21 10-22-2009 11:52 AM
Possible to replace some 500 files with 505 firmware? TadW Sony Reader 8 08-03-2008 09:49 AM
Auto correcting RTF files in Open Office jckatz Sony Reader 1 01-30-2008 03:55 PM


All times are GMT -4. The time now is 12:43 PM.


MobileRead.com is a privately owned, operated and funded community.