Custom recipes (archive, read-only)

[pghaworth]

Does anyone have a recipe for The Seattle Times? I did as much as I could but then got confused. Any and all help appreciated.

http://seattletimes.nwsource.com/html/home/index.html

[kiklop74]

New recipe for Seattle Times:

[laborg]

Learned a thing or two from kiklop74 and updated derstandard recipe:

[pghaworth]

Originally Posted by kiklop74

New recipe for Seattle Times:

You rock! TY

[pghaworth]

Originally Posted by kiklop74

New recipe for Seattle Times:

It is abundantly clear that I have no idea how to use this file. I opened it and copied the recipe into Calibre, saved it and asked it to download. The only thing that happened is a big error screen. Am I supposed to move or copy the files somewhere. I am a real noob with this stuff. Apologies.


Job: **Fetch news from Seattle Times**
**tuple**: ('NotImplementedError', u'')
**Traceback**:
Traceback (most recent call last):
File "parallel.py", line 958, in worker
File "parallel.py", line 916, in work
File "C:\Calibre\library.zip\calibre\ebooks\mobi\from_f eeds.py", line 69, in main
File "C:\Calibre\library.zip\calibre\ebooks\mobi\from_f eeds.py", line 42, in convert
File "C:\Calibre\library.zip\calibre\web\feeds\main.py" , line 152, in run_recipe
File "calibre\web\feeds\news.pyo", line 567, in download
File "calibre\web\feeds\news.pyo", line 695, in build_index
File "calibre\web\feeds\news.pyo", line 979, in parse_feeds
File "calibre\web\feeds\news.pyo", line 275, in get_feeds
NotImplementedError

**Log**:
('NotImplementedError', u'')
Traceback (most recent call last):
File "parallel.py", line 958, in worker
File "parallel.py", line 916, in work
File "C:\Calibre\library.zip\calibre\ebooks\mobi\from_f eeds.py", line 69, in main
File "C:\Calibre\library.zip\calibre\ebooks\mobi\from_f eeds.py", line 42, in convert
File "C:\Calibre\library.zip\calibre\web\feeds\main.py" , line 152, in run_recipe
File "calibre\web\feeds\news.pyo", line 567, in download
File "calibre\web\feeds\news.pyo", line 695, in build_index
File "calibre\web\feeds\news.pyo", line 979, in parse_feeds
File "calibre\web\feeds\news.pyo", line 275, in get_feeds
NotImplementedError

[pghaworth]

No worries, I think I figured it out. I'll be back if there's still a problem.

[kiklop74]

See images:

[pghaworth]

Thank you. It's a beautiful thing. Once I figured out what to do with the file it worked perfectly. I'm still learning Calibre and all the things it can do but wow! Your help was a blessing. Thanks again.

[pghaworth]

Sorry, one question. What, if anything, do I do with the icon that came with the py file? I couldn't figure out where to load it. It's really unimportant in the scheme of things but you included it so there must be a reason.

[Derry]

Hi,
I'm trying to create a custom NYTimes global edition to replace the old IHT recipe. I've adapted as much formatting as I could from the NY Times recipe, but I can't get it to fetch multipage articles. Any help would be great.

I've only added a single feed so far, will add more once I can do multipage,

Thanks in advance,
Derry

Recipe is as follows:

class AdvancedUserRecipe1239810597(BasicNewsRecipe):
    title          = u'iht test'
    oldest_article = 7
    max_articles_per_feed = 100
    remove_tags_before = dict(id='article')
    remove_tags_after  = dict(id='article')
    remove_tags = [dict(attrs={'class':['articleTools', 'post-tools', 'side_tool', 'nextArticleLink clearfix']}), 
                   dict(id=['footer', 'toolsRight', 'articleInline', 'navigation', 'archive', 'side_search', 'blog_sidebar', 'side_tool', 'side_index']), 
                   dict(name=['script', 'noscript', 'style'])]
    encoding = 'cp1252'
    no_stylesheets = True
    extra_css = 'h1 {font: sans-serif large;}\n.byline {font:monospace;}'

    feeds          = [(u'iht front', u'http://www.nytimes.com/services/xml/rss/nyt/GlobalHome.xml')]

[kovidgoyal]

try using the print version of the articles, since those will be single page

[kiklop74]

Originally Posted by pghaworth

Sorry, one question. What, if anything, do I do with the icon that came with the py file? I couldn't figure out where to load it. It's really unimportant in the scheme of things but you included it so there must be a reason.

Icon is not for you. It is for Kovid, so when he includes new recipe into calibre he can assign it appropriate icon.

[laborg]

Updated the "die_presse" recipe (+icon).

btw.: thank you, kovidgoyal, for your extraordinary work!

[kovidgoyal]

Originally Posted by laborg

Updated the "die_presse" recipe (+icon).

btw.: thank you, kovidgoyal, for your extraordinary work!

You're most welcome

[redp]

Dear All,

I am new to the forum but I think I searched pretty good for anything related and found nothing close to the answer, so please do not humiliate me if I missed something obvious.

I would like the news articles to be fetched from RSS and stored in txt format, all in one file. I am playing with Calibre for some time now, and appreciate the flexibility of the tool very much, but I am ground zero in python unfortunately.

Below is how far I got so far on the subject, if anyone could advance, or give any suggestions, or tell me if I am going in the wrong direction, please do.
The best option is ofcourse a sample recipe, but I think it is too much to ask for...

Thanks a lot in advance,
Redp

how far I got:
1. So I understand that I need to find a tag name identifying the main body of text in a specific newspaper. For one newspaper, it is div class="text", for example.
2. Then I shall use the keep_only_tags thing to have only that text in the html stored.
3. Then I suspect I need to redefine the preprocess_html and inside it somehow make use of tag_to_string to have only plain text stored.
4. Finally, I have to concat all the kind-of "html" into one file -- the txt file having all news in plain txt inside.

Huh, I managed to write a very simple recipe to account for items 1 and 2, but I have no idea if items 3 and 4 are a good plan. Even if it is a good plan, I feel so miserable because I do not understand python...