Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre

Notices

Reply
 
Thread Tools Search this Thread
Old 08-23-2009, 05:09 PM   #1
Bookworm88
Junior Member
Bookworm88 began at the beginning.
 
Posts: 7
Karma: 10
Join Date: Aug 2009
Device: Kindle 2
Kindle 2 and News Feeds

I'm trying to read the Observer on my Kindle 2 using Calibre to download the RSS feeds. When I use Calibre's viewer I can see all the articles from the paper in the approx. 600mb book it creates. When I upload it to my Kindle either by emailing it or directly through the USB cable I only get less than twenty articles in only two sections of the paper. If I look at the Jobs List after the upload it shows 4 jobs:
1)Get device info.
2)Get list of books on device
3)Upload 1 books to device: Charlotte Observer
4)Send metadata to device

All of these jobs take 0m 0s each and say they're 100% complete. I'm attaching a text file of the news fetching job in case it's helpful.
Any help with this would be appreciated.
Attached Files
File Type: txt Fetch News From Charlotte Observer.txt (74.1 KB, 79 views)

Last edited by Bookworm88; 08-26-2009 at 11:27 AM.
Bookworm88 is offline   Reply With Quote
Old 08-26-2009, 11:28 AM   #2
Bookworm88
Junior Member
Bookworm88 began at the beginning.
 
Posts: 7
Karma: 10
Join Date: Aug 2009
Device: Kindle 2
Unhappy

Hmmmm, 74 views and no one has any idea what the problem is here?
Bookworm88 is offline   Reply With Quote
 
Enthusiast
Old 08-27-2009, 09:20 AM   #3
GRiker
Comparer of the Ephemeris
GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.
 
Posts: 1,497
Karma: 424627
Join Date: Mar 2009
Device: iPad
Try posting your recipe, that might be a better starting place.

G
GRiker is offline   Reply With Quote
Old 08-27-2009, 10:58 AM   #4
Bookworm88
Junior Member
Bookworm88 began at the beginning.
 
Posts: 7
Karma: 10
Join Date: Aug 2009
Device: Kindle 2
Thanks for the reply. I didn't post the recipe because it was downloading correctly to the Calibre reader but not transferring everything to my Kindle. At any rate if I'm looking in the right place here is the recipe I created for the Observer.

class AdvancedUserRecipe1251384835(BasicNewsRecipe):
title = u'Charlotte Observer'
oldest_article = 7
max_articles_per_feed = 100

feeds = [(u'Local News', u'http://www.charlotteobserver.com/531/index.rss'), (u'Breaking Local News', u'http://www.charlotteobserver.com/breaking/index.rss'), (u'Politics', u'http://www.charlotteobserver.com/143/index.rss'), (u'National', u'http://www.charlotteobserver.com/116/index.rss'), (u'World', u'http://www.charlotteobserver.com/235/index.rss'), (u'Business', u'http://www.charlotteobserver.com/123/index.rss'), (u'Banking', u'http://www.charlotteobserver.com/138/index.rss'), (u'Sports', u'http://www.charlotteobserver.com/532/index.rss'), (u'Carolina Panthers', u'http://www.charlotteobserver.com/290/index.rss'), (u'High School Sports', u'http://www.charlotteobserver.com/preps/index.rss'), (u'Entertainment', u'http://www.charlotteobserver.com/122/index.rss'), (u'TV', u'http://www.charlotteobserver.com/167/index.rss')]
Bookworm88 is offline   Reply With Quote
Old 08-28-2009, 08:06 AM   #5
GRiker
Comparer of the Ephemeris
GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.
 
Posts: 1,497
Karma: 424627
Join Date: Mar 2009
Device: iPad
Bookworm88,

I ran your recipe, changing max_articles_per_feed to 5, so that I could get a general sense of what was happening without downloading the entire history of Charlotte. I fetched articles in 6 categories - Local News, Breaking Local News, Politics, National, World and Business. All of the categories except Business downloaded 5 articles, except Business which had 1. This highlights an important notion to be aware of:

If an included RSS feed is empty at the time you run the recipe, you won't get any content in that feed. This can happen for a number of reasons, including a timeout from the remote server, remote server maintenance, or an error of any sort. Often, running the recipe again a few minutes later works.

For the feeds that generated no content (e.g., Sports, Carolina Panthers) a quick look at the RSS feeds shows different URLS than the ones you're using. You should check each of the feeds from this page to make sure yours are the same.

I would encourage you to reduce max_articles_per_feed to a lower number, and try again. Other than needing to confirm your feed URLs, I don't see anything wrong with your recipe.

G
GRiker is offline   Reply With Quote
Old 08-30-2009, 12:54 AM   #6
Bookworm88
Junior Member
Bookworm88 began at the beginning.
 
Posts: 7
Karma: 10
Join Date: Aug 2009
Device: Kindle 2
I appreciate your effort to troubleshoot this problem for me. The problem I'm experiencing is not really with the recipe, I don't think. See, when I run it the resulting ebook that I get reads fine in the Calibre viewer. The problem is when I transfer it to the Kindle. For some reason very little of it is transferring. I'll try your suggestions and see if it helps. Thanks again.
Bookworm88 is offline   Reply With Quote
Old 08-30-2009, 05:38 AM   #7
GRiker
Comparer of the Ephemeris
GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.
 
Posts: 1,497
Karma: 424627
Join Date: Mar 2009
Device: iPad
Your original post said that your output file was 600MB. If that's correct, it's a gigantic file, which may be breaking some internal limits of the Kindle or calibre. By reducing the number of articles fetched from each feed, if you can get the file down to a more reasonable size, my sense is that it will work.

By way of comparison, a typical Sunday NYTimes download purchased from Amazon, with 200+ articles, is ~3MB.

G
GRiker is offline   Reply With Quote
Old 08-31-2009, 12:40 PM   #8
jbambridge
Kindle DX
jbambridge began at the beginning.
 
Posts: 21
Karma: 10
Join Date: Aug 2009
Location: The Netherlands
Device: iPad and Kindle DX
I get a similar problem with the new standard recipe for The Guardian on my Kindle DX. All of the articles are being downloaded but the DX Table of Contents only shows a few in the first section (sometimes it shows two sections, but never the complete TOC.

I know the recipe is working as if I keep paging past the last article in the TOC, all of the rest of the articles are there, just not listed in the TOC.

Other recipes (eg The Telegraph and The Economist) have compete TOCs and work perfectly on the DX.

Any ideas?
jbambridge is offline   Reply With Quote
Old 08-31-2009, 01:53 PM   #9
Bookworm88
Junior Member
Bookworm88 began at the beginning.
 
Posts: 7
Karma: 10
Join Date: Aug 2009
Device: Kindle 2
Quote:
Originally Posted by GRiker View Post
Your original post said that your output file was 600MB.
I don't know what I was smoking when I posted that. It is 649k not 600 mb.
Bookworm88 is offline   Reply With Quote
Old 08-31-2009, 01:57 PM   #10
Bookworm88
Junior Member
Bookworm88 began at the beginning.
 
Posts: 7
Karma: 10
Join Date: Aug 2009
Device: Kindle 2
Quote:
Originally Posted by jbambridge View Post
I get a similar problem with the new standard recipe for The Guardian on my Kindle DX. All of the articles are being downloaded but the DX Table of Contents only shows a few in the first section (sometimes it shows two sections, but never the complete TOC.

I know the recipe is working as if I keep paging past the last article in the TOC, all of the rest of the articles are there, just not listed in the TOC.

Other recipes (eg The Telegraph and The Economist) have compete TOCs and work perfectly on the DX.

Any ideas?
Sounds like exactly what I experienced The Calibre viewer TOC shows everything and all articles are accessible but the K2 TOC only shows 15-20 articles but I can only view what is showing in the K2 TOC.
Bookworm88 is offline   Reply With Quote
Old 08-31-2009, 02:00 PM   #11
GRiker
Comparer of the Ephemeris
GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.
 
Posts: 1,497
Karma: 424627
Join Date: Mar 2009
Device: iPad
jbambridge + Bookworm88:
Can we clarify whether you're talking about Kindle's built-in TOC mechanism, or the TOC that calibre appends to the end of the downloaded content?

For periodicals on the Kindle, the TOC you should be using is the native Kindle TOC - the one accessed by pressing the 'View Sections List' or 'View Articles List' with the 5-way joystick, at the bottom of the screen. Doing so takes you to the list of articles in each section, from which you can easily navigate to the section/article of your choice.

Calibre also creates TOCs for non-Kindle readers, appended to the end of the file, but this is redundant for a Kindle. There is a switch in the Mobi output to suppress the TOC generation, which I'd suggest that Kindle users enable.

G
GRiker is offline   Reply With Quote
Old 08-31-2009, 04:46 PM   #12
jbambridge
Kindle DX
jbambridge began at the beginning.
 
Posts: 21
Karma: 10
Join Date: Aug 2009
Location: The Netherlands
Device: iPad and Kindle DX
I am talking about the Kindle's built in TOC mechanism. Using View Articles List only shows one (or at most two) sections with 10-12 entries. The rest are not shown in the Kindle TOC.

John
jbambridge is offline   Reply With Quote
Old 08-31-2009, 05:12 PM   #13
GRiker
Comparer of the Ephemeris
GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.
 
Posts: 1,497
Karma: 424627
Join Date: Mar 2009
Device: iPad
jbambridge, thanks for confirming. Could you post your recipe so I could try it?

G
GRiker is offline   Reply With Quote
Old 09-01-2009, 01:02 AM   #14
jbambridge
Kindle DX
jbambridge began at the beginning.
 
Posts: 21
Karma: 10
Join Date: Aug 2009
Location: The Netherlands
Device: iPad and Kindle DX
Quote:
jbambridge, thanks for confirming. Could you post your recipe so I could try it?
I am using the standard recipe for "The Guardian" that comes with 6.10.
jbambridge is offline   Reply With Quote
Old 09-02-2009, 06:55 AM   #15
GRiker
Comparer of the Ephemeris
GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.
 
Posts: 1,497
Karma: 424627
Join Date: Mar 2009
Device: iPad
I've confirmed what you've reported, and I will report back when I learn what happened to the missing TOC entries.

G
GRiker is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Can't unsubscribe from news feeds lomax Calibre 6 01-28-2012 05:07 PM
Problem with Chinese news feeds on Kindle 3 spaceniuzai Recipes 14 02-26-2011 07:50 AM
News feeds and Kindle collections poloman Calibre 2 09-03-2010 03:28 AM
Problems with news feeds and Kindle 2 oksahmof2 Calibre 0 08-28-2010 12:32 AM
Kindle Newbie working with RSS news feeds Junior94 Introduce Yourself 2 01-02-2009 09:14 AM


All times are GMT -4. The time now is 04:58 AM.


MobileRead.com is a privately owned, operated and funded community.