01-20-2013, 04:25 PM | #1 |
Junior Member
Posts: 2
Karma: 10
Join Date: Jan 2011
Device: Kindle
|
xkcd recipe
Hi,
I've tried modifying the following line of the builtin XKCD recipe: Code:
oldest_article = 60 Code:
oldest_article = 500 Is there anything obvious I'm doing wrong? The recipe in full is: Code:
__license__ = 'GPL v3' __copyright__ = '2008, Kovid Goyal <kovid at kovidgoyal.net>' ''' Changelog: 2012-04-06 Fixed empty articles, added masthead img (NiLuJe) 2011-09-24 Changed cover (drMerry) ''' ''' Fetch xkcd. ''' import time, re from calibre.web.feeds.news import BasicNewsRecipe class XkcdCom(BasicNewsRecipe): cover_url = 'http://imgs.xkcd.com/static/terrible_small_logo.png' masthead_url = 'http://imgs.xkcd.com/static/terrible_small_logo.png' title = 'xkcd' description = 'A webcomic of romance and math humor.' __author__ = 'Martin Pitt updated by DrMerry.' language = 'en' use_embedded_content = False oldest_article = 500 #keep_only_tags = [dict(id='middleContainer')] #remove_tags = [dict(name='ul'), dict(name='h3'), dict(name='br')] keep_only_tags = [dict(id='comic')] no_stylesheets = True # turn image bubblehelp into a paragraph, and put alt in a heading preprocess_regexps = [ (re.compile(r'(<img.*title=")([^"]+)(".alt=")([^"]+)(".*>)'), lambda m: '<h1>%s</h1>%s%s%s<p>%s</p>' % (m.group(4), m.group(1), m.group(3), m.group(5), m.group(2))) ] def parse_index(self): INDEX = 'http://xkcd.com/archive/' soup = self.index_to_soup(INDEX) articles = [] for item in soup.findAll('a', title=True): articles.append({ 'date': item['title'], 'timestamp': time.mktime(time.strptime(item['title'], '%Y-%m-%d'))+1, 'url': 'http://xkcd.com' + item['href'], 'title': self.tag_to_string(item), 'description': '', 'content': '', }) return [('xkcd', articles)] |
01-20-2013, 06:41 PM | #2 |
Junior Member
Posts: 2
Karma: 10
Join Date: Jan 2011
Device: Kindle
|
Nevermind... I've read all the comics online now, what a geek I am
Will just be updating my version to only fetch 5 strips at a time now... |
02-21-2013, 12:31 AM | #3 |
Member
Posts: 24
Karma: 10
Join Date: Feb 2013
Location: Berlin, Germany
Device: Kindle Paperwhite 3G
|
There appears to be a hard-coded limit as to how many days you can download backwards. I modified to script to have all comics to appear to come from today and downloaded them by year. That works.
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
xkcd: The Giving Tree | kennyc | General Discussions | 5 | 11-22-2011 06:07 PM |
xkcd recipe broken | elementz | Recipes | 3 | 12-16-2010 06:27 PM |
xkcd recipe error | sonyreaderuser | Calibre | 3 | 09-18-2010 05:00 PM |
xkcd Commentary | Arapito | News | 11 | 08-24-2009 10:28 AM |
Why you should buy a Kindle (according to xkcd) | freecia | Amazon Kindle | 4 | 02-25-2009 11:40 PM |