Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Recipes

Notices

Reply
 
Thread Tools Search this Thread
Old 10-15-2010, 04:36 AM   #1
sukru
Junior Member
sukru began at the beginning.
 
Posts: 6
Karma: 10
Join Date: Oct 2010
Device: kindle
Q: Memory Error trying to download EuroGamer RSS Feed

(I was asked to move this here)

My previous attempts with feed setups were either straightforward, or required only trivial coding, however I have no idea to get the following feed:

Quote:
class AdvancedUserRecipe1287115920(BasicNewsRecipe):
title = u'Digital Foundry'
oldest_article = 10
max_articles_per_feed = 100

feeds = [(u'Digital Foundry', u'http://www.eurogamer.net/rss/eurogam...undry_feed.rss')]
Why I try to run it, it fails with a Memory Error, while working on CSS.

Quote:
Merging user specified metadata...
Detecting structure...
Flattening CSS and remapping font sizes...
Python function terminated unexpectedly
(Error Code: 1)
Traceback (most recent call last):
File "site.py", line 103, in main
File "site.py", line 85, in run_entry_point
File "site-packages\calibre\utils\ipc\worker.py", line 107, in main
File "site-packages\calibre\gui2\convert\gui_conversion.py", line 24, in gui_convert
File "site-packages\calibre\ebooks\conversion\plumber.py", line 915, in run
File "site-packages\calibre\ebooks\oeb\transforms\flatcss.py" , line 122, in __call__
File "site-packages\calibre\ebooks\oeb\transforms\flatcss.py" , line 147, in stylize_spine
File "site-packages\calibre\ebooks\oeb\stylizer.py", line 203, in __init__
File "site-packages\calibre\ebooks\oeb\stylizer.py", line 103, in __init__
File "site-packages\lxml\cssselect.py", line 523, in css_to_xpath
File "site-packages\lxml\cssselect.py", line 648, in parse
File "site-packages\lxml\cssselect.py", line 663, in parse_selector_group
File "site-packages\lxml\cssselect.py", line 685, in parse_selector
File "site-packages\lxml\cssselect.py", line 697, in parse_simple_selector
File "site-packages\lxml\cssselect.py", line 969, in next
MemoryError
Is there a way to fix this?

(Also some of the articles are multi-page, it will be another source of issue, after I get this initial step running).

Original at: http://www.mobileread.com/forums/sho...d.php?t=102658
sukru is offline   Reply With Quote
Old 10-15-2010, 08:09 AM   #2
Starson17
Wizard
Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.
 
Posts: 4,004
Karma: 177841
Join Date: Dec 2009
Device: WinMo: IPAQ; Android: HTC HD2, Archos 7o; Java:Gravity T
Quote:
Originally Posted by sukru View Post
Why I try to run it, it fails with a Memory Error, while working on CSS.
Is there a way to fix this?
It doesn't fail for me. You can try adding:
Code:
    no_stylesheets = True
    remove_javascript = True
but perhaps your memory is really limited.
Quote:
(Also some of the articles are multi-page, it will be another source of issue, after I get this initial step running).
Search "multipage" in the sticky recipe thread above.
Starson17 is offline   Reply With Quote
 
Enthusiast
Old 10-15-2010, 03:15 PM   #3
sukru
Junior Member
sukru began at the beginning.
 
Posts: 6
Karma: 10
Join Date: Oct 2010
Device: kindle
Thanks disabling those helped download the pages, but of course the styles are gone...

I do have a moderate 4GB of RAM. It's not much, but shouldn't this be enough to download an RSS feed?

Anyways I'll try to learn more about the multipage thing now.
sukru is offline   Reply With Quote
Old 10-15-2010, 04:20 PM   #4
Starson17
Wizard
Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.
 
Posts: 4,004
Karma: 177841
Join Date: Dec 2009
Device: WinMo: IPAQ; Android: HTC HD2, Archos 7o; Java:Gravity T
Quote:
Originally Posted by sukru View Post
Thanks disabling those helped download the pages, but of course the styles are gone...
You can replace styles with extra_css.
Quote:
I do have a moderate 4GB of RAM. It's not much, but shouldn't this be enough to download an RSS feed?
Yes, that should be sufficient. What is your output format? I tested with EPUB.
Starson17 is offline   Reply With Quote
Old 10-19-2010, 11:11 PM   #5
sukru
Junior Member
sukru began at the beginning.
 
Posts: 6
Karma: 10
Join Date: Oct 2010
Device: kindle
Thanks for the pointers. I let go of the CSS for now, but I clean up most of the junk and the results looks OK for an initial version.

Now have the basic multipage EuroGamer recipe ready, how can I share it? -- if people would be interested of course.
sukru is offline   Reply With Quote
Old 10-20-2010, 09:30 AM   #6
Starson17
Wizard
Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.
 
Posts: 4,004
Karma: 177841
Join Date: Dec 2009
Device: WinMo: IPAQ; Android: HTC HD2, Archos 7o; Java:Gravity T
Quote:
Originally Posted by sukru View Post
Thanks for the pointers. I let go of the CSS for now, but I clean up most of the junk and the results looks OK for an initial version.

Now have the basic multipage EuroGamer recipe ready, how can I share it? -- if people would be interested of course.
You should always post it here. Kovid usually will get it here, but if you really want to make sure he knows about it, post it in the bug tracker http://bugs.calibre-ebook.com
Starson17 is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Memory Error trying to download EuroGamer RSS Feed sukru Calibre 3 10-15-2010 06:32 AM
RSS Feed timezone Feedback 8 01-02-2010 06:55 PM
RSS Feed Question PGP_Protector Sony Reader 1 01-26-2009 12:12 AM
RSS Feed questions rambling Calibre 2 11-20-2008 05:35 AM
RSS Feed Prob... AKninja04 Calibre 6 08-25-2008 07:51 PM


All times are GMT -4. The time now is 02:47 AM.


MobileRead.com is a privately owned, operated and funded community.