10-16-2010, 03:09 PM | #1 |
o hai.
Posts: 13
Karma: 10
Join Date: Jun 2010
Device: Kindle Keyboard 3G
|
Calibre + Instapaper Limits
Sometimes when I use calibre to fetch my instapaper articles, I find that not all of my articles are fetched. Lately, it has been fetching my 10 or so most recent articles only.
Anyone else experiencing this or have a possible fix? note: when i download the articles straight from instapaper, ALL articles are downloaded. |
11-26-2010, 08:44 AM | #2 |
Junior Member
Posts: 3
Karma: 10
Join Date: Nov 2010
Device: Kindle 3
|
Same problem sadly
Hi!
Firstly can I say what a fabulous bit of software Calibre is! Well done to Kovid for what has made life so much easier.. I'm in the same boat as the OP when trying to download articles from Instapaper. It varies how many articles are actually downloaded. For instance, the first time I downloaded a bunch of articles the filesize was 4.3MB - a few minutes later when I tried again the size was 0.8MB and only a handful! I tried this a few days later and the same 0.8mb file was downloaded. Do you think this is a Calibre issue or an Instapaper one? The recipe is as follows: Code:
__license__ = 'GPL v3' __copyright__ = '2009-2010, Darko Miletic <darko.miletic at gmail.com>' ''' www.instapaper.com ''' import urllib from calibre import strftime from calibre.web.feeds.news import BasicNewsRecipe class Instapaper(BasicNewsRecipe): title = 'The KindleMagic Daily' __author__ = 'Unknown' description = '''Personalized news feeds. Go to instapaper.com to setup up your news. Fill in your instapaper username, and leave the password field below blank.''' publisher = 'Instapaper.com' category = 'news, custom' oldest_article = 50 max_articles_per_feed = 100 no_stylesheets = True use_embedded_content = False needs_subscription = True INDEX = u'http://www.instapaper.com' LOGIN = INDEX + u'/user/login' conversion_options = { 'comment' : description , 'tags' : category , 'publisher' : publisher } feeds = [ (u'Uncategorised articles' , INDEX + u'/u') ,(u'Starred articles', INDEX + u'/starred') ,(u'News', INDEX + u'/u/folder/number_removed/news') ,(u'Sport', INDEX + u'/u/folder/number_removed/sport') ,(u'Technology', INDEX + u'/u/folder/number_removed/technology') ,(u'Gaming', INDEX + u'/u/folder/number_removed/gaming') ,(u'Comment', INDEX + u'/u/folder/number_removed/comment') ,(u'Gossip/Rubbish', INDEX + u'/u/folder/number_removed/gossip-rubbish') ] def get_browser(self): br = BasicNewsRecipe.get_browser() if self.username is not None: br.open(self.LOGIN) br.select_form(nr=0) br['username'] = self.username if self.password is not None: br['password'] = self.password br.submit() return br def parse_index(self): totalfeeds = [] lfeeds = self.get_feeds() for feedobj in lfeeds: feedtitle, feedurl = feedobj self.report_progress(0, _('Fetching feed')+' %s...'%(feedtitle if feedtitle else feedurl)) articles = [] soup = self.index_to_soup(feedurl) for item in soup.findAll('div', attrs={'class':'titleRow'}): description = self.tag_to_string(item.div) atag = item.a if atag and atag.has_key('href'): url = atag['href'] title = self.tag_to_string(atag) date = strftime(self.timefmt) articles.append({ 'title' :title ,'date' :date ,'url' :url ,'description':description }) totalfeeds.append((feedtitle, articles)) return totalfeeds def print_version(self, url): return self.INDEX + '/text?u=' + urllib.quote(url) Really hoping someone can help here folks! Thanks in advance for your time Cheers Maxi (UK) PS, not sure if this is relevant, but on my work's box I am running Ubuntu 10.04 - every time I download I get all the articles (i.e. 4.3mb) so it's working fine there. An Ubuntu 10.10 thing?? ----------- |
Advert | |
|
11-26-2010, 03:15 PM | #3 |
Addict
Posts: 219
Karma: 404
Join Date: Nov 2010
Device: Kindle 3G, Samsung SIII
|
I would try to download from command line using the -vv option, if I remember correctly the usage would be:
Code:
ebook-convert path_to_instapaper_recipe download_filename --username your_username --password your_password -vv |
11-27-2010, 02:40 AM | #4 | |
US Navy, Retired
Posts: 9,864
Karma: 13806776
Join Date: Feb 2009
Location: North Carolina
Device: Icarus Illumina XL HD, Nexus 7
|
Quote:
|
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Instapaper + Calibre + Kobo = great | dantaipan | Kobo Reader | 10 | 10-15-2010 10:03 PM |
Instapaper folders and Calibre | flyash | Calibre | 4 | 08-13-2010 02:01 AM |
AZW Limits | 6charlong | Amazon Kindle | 14 | 08-01-2010 11:23 AM |
Calibre, Instapaper, multipage articles and ordering | flyash | Calibre | 1 | 06-10-2010 07:03 PM |
Calibre not working with Instapaper fetch | angelsdan | Calibre | 3 | 05-22-2010 01:34 PM |