Q: Memory Error trying to download EuroGamer RSS Feed

[sukru]

(I was asked to move this here)

My previous attempts with feed setups were either straightforward, or required only trivial coding, however I have no idea to get the following feed:

class AdvancedUserRecipe1287115920(BasicNewsRecipe):
title = u'Digital Foundry'
oldest_article = 10
max_articles_per_feed = 100

feeds = [(u'Digital Foundry', u'http://www.eurogamer.net/rss/eurogam...undry_feed.rss')]

Why I try to run it, it fails with a Memory Error, while working on CSS.

Merging user specified metadata...
Detecting structure...
Flattening CSS and remapping font sizes...
Python function terminated unexpectedly
(Error Code: 1)
Traceback (most recent call last):
File "site.py", line 103, in main
File "site.py", line 85, in run_entry_point
File "site-packages\calibre\utils\ipc\worker.py", line 107, in main
File "site-packages\calibre\gui2\convert\gui_conversion.py", line 24, in gui_convert
File "site-packages\calibre\ebooks\conversion\plumber.py", line 915, in run
File "site-packages\calibre\ebooks\oeb\transforms\flatcss.py" , line 122, in __call__
File "site-packages\calibre\ebooks\oeb\transforms\flatcss.py" , line 147, in stylize_spine
File "site-packages\calibre\ebooks\oeb\stylizer.py", line 203, in __init__
File "site-packages\calibre\ebooks\oeb\stylizer.py", line 103, in __init__
File "site-packages\lxml\cssselect.py", line 523, in css_to_xpath
File "site-packages\lxml\cssselect.py", line 648, in parse
File "site-packages\lxml\cssselect.py", line 663, in parse_selector_group
File "site-packages\lxml\cssselect.py", line 685, in parse_selector
File "site-packages\lxml\cssselect.py", line 697, in parse_simple_selector
File "site-packages\lxml\cssselect.py", line 969, in next
MemoryError

Is there a way to fix this?

(Also some of the articles are multi-page, it will be another source of issue, after I get this initial step running).

Original at: https://www.mobileread.com/forums/sho...d.php?t=102658

[Starson17]

Originally Posted by sukru

Why I try to run it, it fails with a Memory Error, while working on CSS.
Is there a way to fix this?

It doesn't fail for me. You can try adding:

    no_stylesheets = True
    remove_javascript = True

but perhaps your memory is really limited.

(Also some of the articles are multi-page, it will be another source of issue, after I get this initial step running).

Search "multipage" in the sticky recipe thread above.

[sukru]

Thanks disabling those helped download the pages, but of course the styles are gone...

I do have a moderate 4GB of RAM. It's not much, but shouldn't this be enough to download an RSS feed?

Anyways I'll try to learn more about the multipage thing now.

[Starson17]

Originally Posted by sukru

Thanks disabling those helped download the pages, but of course the styles are gone...

You can replace styles with extra_css.

I do have a moderate 4GB of RAM. It's not much, but shouldn't this be enough to download an RSS feed?

Yes, that should be sufficient. What is your output format? I tested with EPUB.

[sukru]

Thanks for the pointers. I let go of the CSS for now, but I clean up most of the junk and the results looks OK for an initial version.

Now have the basic multipage EuroGamer recipe ready, how can I share it? -- if people would be interested of course.

[Starson17]

Originally Posted by sukru

Thanks for the pointers. I let go of the CSS for now, but I clean up most of the junk and the results looks OK for an initial version.

Now have the basic multipage EuroGamer recipe ready, how can I share it? -- if people would be interested of course.

You should always post it here. Kovid usually will get it here, but if you really want to make sure he knows about it, post it in the bug tracker http://bugs.calibre-ebook.com