Custom recipes (archive, read-only) - Page 8

kiklop74 · 01-05-2009, 04:40 PM

Quote:

Originally Posted by micks_address

Hi guys,

This thread is great, i only got my 505 for christmas so havent installed calibre yet but its on the list of things to do asap

if i download an existing recipe is it easy enough to edit them to suit other sites?

I'm interested in http://www.irishtimes.com/feeds/rss/

That recipe already exists. It ships with calibre.

micks_address · 01-06-2009, 04:23 AM

thats so cool,

cheers,
mick

Quote:

Originally Posted by kiklop74

That recipe already exists. It ships with calibre.

Overlord44 · 01-06-2009, 06:04 AM

OK, this seems to work for Slashdot, it just takes an hour and a half on my PC...

Code:

class AdvancedUserRecipe1230335014(BasicNewsRecipe):
    title          = u'Slashdot'
    oldest_article = 7
    max_articles_per_feed = 100
    
    feeds          = [(u'Slashdot', u'http://rss.slashdot.org/Slashdot/slashdot')]

    def get_article_url(self, article):
        return article.get('feedburner_origlink', None)

EDIT: The second run of this took a shade under 2 hours. Again, it does work, just VERY slowly. I dunno if it's my PC or the website or what, but I will note it occasionally cuts the ends off comments. Might be the site.

kiklop74 · 01-06-2009, 07:46 PM

New recipe for famous joelonsoftware.com blog.

sn123py · 01-07-2009, 06:44 AM

Hi,
i'm trying to create an recipe for german heise telepolis. I use this recipe:

Code:

#!/usr/bin/env  python
__license__   = 'GPL v3'
__copyright__ = '2008, Friedhelm Buescher'
'''
www.heise.de/tp/
'''

from calibre.web.feeds.news import BasicNewsRecipe

class HeiseTelepolis(BasicNewsRecipe):
    title                 = u'heise-tp'
    __author__            = 'Friedhelm Buescher'
    description           = 'Heise Telepolis'    
    oldest_article        = 7
    max_articles_per_feed = 50
    no_stylesheets        = False
    use_embedded_content  = False

    keep_only_tags = [
                        dict(name='table'  , attrs={'class':'blogtable' }),
                        dict(id='HEISETEXT')
                     ]

    feeds          = [
                        (u'tp', u'http://www.heise.de/tp/news-atom.xml')
                     ]

    def print_version(self, url):
        return url + '?printable=true'

it works for the blogged entries (the ones with an colored icon in front), but it does not work for the original heise news ( for example: Die "Moral" von der Geschichte). my approach was, that all original heise news are between <HEISETEXT> and </HEISETEXT> ..
can someone help, please?

regards,
Friedhelm.

kiklop74 · 01-07-2009, 07:49 AM

Quote:

Originally Posted by sn123py

Hi,
i'm trying to create an recipe for german heise telepolis. I use this recipe:

The problem is that there are several types of pages and you can not apply the print page rule to all of them. Blog pages do not have print version while news pages do. This implies that more complex script is needed.

I'll take a look during weekend if I find time.

Spectrum · 01-08-2009, 11:21 PM

I like to get The Times Literary Supplement

www.timesonline.co.uk/tol/newspapers/tls/

TIA

sn123py · 01-09-2009, 09:55 AM

Quote:

Originally Posted by kiklop74

The problem is that there are several types of pages and you can not apply the print page rule to all of them. Blog pages do not have print version while news pages do. This implies that more complex script is needed.

I'll take a look during weekend if I find time.

hi kiklop74. Maybe, http://www.heise.de/tp/pdanews/default.html would then be a good place to start? I have no idea, how to parse an html-page as an index-page.

kiklop74 · 01-09-2009, 01:03 PM

Quote:

Originally Posted by Spectrum

I like to get The Times Literary Supplement

www.timesonline.co.uk/tol/newspapers/tls/

TIA

Customize the builtin recipe by adding times literary suplement feed to the list of existing feeds. Meaning:

This :

Code:

    feeds          = [
                        (u'Top stories from Times Online', u'http://www.timesonline.co.uk/tol/feeds/rss/topstories.xml'     ),
                        ('Latest Business News', 'http://www.timesonline.co.uk/tol/feeds/rss/business.xml'),
                        ('Economics', 'http://www.timesonline.co.uk/tol/feeds/rss/economics.xml'),
                        ('World News', 'http://www.timesonline.co.uk/tol/feeds/rss/worldnews.xml'),
                        ('UK News', 'http://www.timesonline.co.uk/tol/feeds/rss/uknews.xml'),
                        ('Travel News', 'http://www.timesonline.co.uk/tol/feeds/rss/travel.xml'),
                        ('Sports News', 'http://www.timesonline.co.uk/tol/feeds/rss/sport.xml'),
                        ('Film News', 'http://www.timesonline.co.uk/tol/feeds/rss/film.xml'),
                        ('Tech news', 'http://www.timesonline.co.uk/tol/feeds/rss/tech.xml'),
                     ]

Becomes this:

Code:

    feeds          = [
                        (u'Top stories from Times Online', u'http://www.timesonline.co.uk/tol/feeds/rss/topstories.xml'     ),
                        ('Latest Business News', 'http://www.timesonline.co.uk/tol/feeds/rss/business.xml'),
                        ('Economics', 'http://www.timesonline.co.uk/tol/feeds/rss/economics.xml'),
                        ('World News', 'http://www.timesonline.co.uk/tol/feeds/rss/worldnews.xml'),
                        ('UK News', 'http://www.timesonline.co.uk/tol/feeds/rss/uknews.xml'),
                        ('Travel News', 'http://www.timesonline.co.uk/tol/feeds/rss/travel.xml'),
                        ('Sports News', 'http://www.timesonline.co.uk/tol/feeds/rss/sport.xml'),
                        ('Film News', 'http://www.timesonline.co.uk/tol/feeds/rss/film.xml'),
                        ('Tech news', 'http://www.timesonline.co.uk/tol/feeds/rss/tech.xml'),
                        ('Times literary suplement', 'http://www.timesonline.co.uk/tol/feeds/rss/thetls.xml'),
                     ]

kiklop74 · 01-09-2009, 01:31 PM

Here is the recipe for Heise Telepolis

Spectrum · 01-09-2009, 10:13 PM

thanks kiklop74!

XanthanGum · 01-10-2009, 01:03 PM

Hi,

I'm attaching a recipe (calibre_0.4.127__pr7nl.py) for Common Dreams (http://www.commondreams.org/). Common Dreams is a Web site that presents progressive news and views.

Enjoy...

Xanthan Gum

zelda_pinwheel · 01-16-2009, 10:29 AM

hm, i tried to add the feeds from my google reader using the integrated recipe, and i got this error message (and no ebook) :

Spoiler:

anybody know what's wrong ?

kovidgoyal · 01-16-2009, 01:07 PM

Looks like a forbidden error, did you provide the correct username and password?

zelda_pinwheel · 01-16-2009, 11:12 PM

Quote:

Originally Posted by kovidgoyal

Looks like a forbidden error, did you provide the correct username and password?

heh. oops.

works better when you include the ".com" of google.com. thanks. sorry for the stupidity.

01-06-2009, 06:04 AM	#108
Overlord44 Junior Member Posts: 7 Karma: 10 Join Date: Dec 2008 Device: Sony PRS-505	OK, this seems to work for Slashdot, it just takes an hour and a half on my PC... Code: class AdvancedUserRecipe1230335014(BasicNewsRecipe): title = u'Slashdot' oldest_article = 7 max_articles_per_feed = 100 feeds = [(u'Slashdot', u'http://rss.slashdot.org/Slashdot/slashdot')] def get_article_url(self, article): return article.get('feedburner_origlink', None) EDIT: The second run of this took a shade under 2 hours. Again, it does work, just VERY slowly. I dunno if it's my PC or the website or what, but I will note it occasionally cuts the ends off comments. Might be the site. Last edited by Overlord44; 01-06-2009 at 08:33 PM.

01-16-2009, 10:29 AM	#118
zelda_pinwheel zeldinha zippy zeldissima Posts: 27,827 Karma: 921169 Join Date: Dec 2007 Location: Paris, France Device: eb1150 & is that a nook in her pocket, or she just happy to see you?	hm, i tried to add the feeds from my google reader using the integrated recipe, and i got this error message (and no ebook) : Spoiler: Job: Fetch news from Google Reader tuple: ('httperror_seek_wrapper', u'HTTP Error 403: Forbidden') Traceback: Traceback (most recent call last): File "parallel.py", line 937, in worker File "parallel.py", line 895, in work File "C:\Program Files\calibre\library.zip\calibre\ebooks\epub\from _feeds.py", line 64, in main File "C:\Program Files\calibre\library.zip\calibre\ebooks\epub\from _feeds.py", line 37, in convert File "C:\Program Files\calibre\library.zip\calibre\web\feeds\main.p y", line 146, in run_recipe File "calibre\web\feeds\news.pyo", line 476, in __init__ File "calibre\web\feeds\recipes\recipe_greader.pyo" , line 21, in get_browser File "mechanize\_mechanize.pyo", line 209, in open File "mechanize\_mechanize.pyo", line 261, in _mech_open httperror_seek_wrapper: HTTP Error 403: Forbidden Log: ('httperror_seek_wrapper', u'HTTP Error 403: Forbidden') Traceback (most recent call last): File "parallel.py", line 937, in worker File "parallel.py", line 895, in work File "C:\Program Files\calibre\library.zip\calibre\ebooks\epub\from _feeds.py", line 64, in main File "C:\Program Files\calibre\library.zip\calibre\ebooks\epub\from _feeds.py", line 37, in convert File "C:\Program Files\calibre\library.zip\calibre\web\feeds\main.p y", line 146, in run_recipe File "calibre\web\feeds\news.pyo", line 476, in __init__ File "calibre\web\feeds\recipes\recipe_greader.pyo" , line 21, in get_browser File "mechanize\_mechanize.pyo", line 209, in open File "mechanize\_mechanize.pyo", line 261, in _mech_open httperror_seek_wrapper: HTTP Error 403: Forbidden anybody know what's wrong ?

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Custom column read ?	pchrist7	Calibre	2	10-04-2010 03:52 AM
Archive for custom screensavers	sleeplessdave	Amazon Kindle	1	07-07-2010 01:33 PM
How to back up preferences and custom recipes?	greenapple	Calibre	3	03-29-2010 06:08 AM
Donations for Custom Recipes	ddavtian	Calibre	5	01-23-2010 05:54 PM
Help understanding custom recipes	andersent	Calibre	0	12-17-2009 03:37 PM

01-08-2009, 11:21 PM	#112
Spectrum Zealot Posts: 126 Karma: 570 Join Date: Nov 2008 Device: iPad 1 and iPad 4, KF HD 8.9"	I like to get The Times Literary Supplement www.timesonline.co.uk/tol/newspapers/tls/ TIA

01-09-2009, 10:13 PM	#116
Spectrum Zealot Posts: 126 Karma: 570 Join Date: Nov 2008 Device: iPad 1 and iPad 4, KF HD 8.9"	thanks kiklop74!

01-16-2009, 01:07 PM	#119
kovidgoyal creator of calibre Posts: 45,616 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Looks like a forbidden error, did you provide the correct username and password?

Advert

Advert