Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre

Notices

Reply
 
Thread Tools Search this Thread
Old 11-16-2010, 07:55 AM   #1
janvanmaar
Addict
janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.
 
Posts: 219
Karma: 404
Join Date: Nov 2010
Device: Kindle 3G, Samsung SIII
Automatic sending of RSS news feeds to Kindle as blog/ebook

Currently, any subsequent updates of an RSS feeds sent from Calibre to Kindle *on the same day* suffer by the problem of displaying/sorting incorrectly in Kindle:
https://www.mobileread.com/forums/sho...37#post1218937

Currently, the news sent from Calibre are marked as periodicals (called "issues" in Kindle). However, the default behaviour for standard ebooks (called "documents" in Kindle) or blogs should fix this problem: the latest issue would simply replace the previous one in Kindle, without the feature of saving "older" issues as is the case with periodicals which is broken for updates on the same day.

So my question is: How can I set the type of the document for Kindle in Calibre? I could not find it either in the metadata or in the html. And is it possible to change the type for the news delivered automatically by Calibre?
janvanmaar is offline   Reply With Quote
Old 11-16-2010, 10:53 AM   #2
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,771
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
It isn't. If you do that, you lose all the news navigation features.
kovidgoyal is offline   Reply With Quote
Advert
Old 11-16-2010, 11:08 AM   #3
janvanmaar
Addict
janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.
 
Posts: 219
Karma: 404
Join Date: Nov 2010
Device: Kindle 3G, Samsung SIII
For testing purposes, I have subscribed to a blog at Amazon which is updated many times a day. Kindle recognizes it as blog, has no problems with many updates of it in the same day and all the news navigation features are present (in fact, the navigation seems very similar to the feeds generated and sent by Calibre).

So it seems it should be possible to achieve. I don't mind playing with it a bit to get this working. If you could tell me how to change the document type, I can start playing and let you know how things go...
janvanmaar is offline   Reply With Quote
Old 11-16-2010, 11:09 AM   #4
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,771
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
the document type is set calibre.ebooks.mobi.writer
kovidgoyal is offline   Reply With Quote
Old 11-16-2010, 11:56 AM   #5
janvanmaar
Addict
janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.
 
Posts: 219
Karma: 404
Join Date: Nov 2010
Device: Kindle 3G, Samsung SIII
thanks, I will have a look at it.
janvanmaar is offline   Reply With Quote
Advert
Old 11-16-2010, 02:40 PM   #6
janvanmaar
Addict
janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.
 
Posts: 219
Karma: 404
Join Date: Nov 2010
Device: Kindle 3G, Samsung SIII
I did not get very far: after some effort I managed to compile from sources, however I get
Code:
    for href in cssutils.getUrls(item.data):
  File "install_files/calibre/calibre-src/calibre/lib/calibre/calibre/ebooks/oeb/base.py", line 1066, in fget
    data = self._parse_css(data)
  File "install_files/calibre/calibre-src/calibre/lib/calibre/calibre/ebooks/oeb/base.py", line 1012, in _parse_css
    import_rules = list(data.cssRules.rulesOfType(CSSRule.IMPORT_RULE)
AttributeError: 'CSSRuleList' object has no attribute 'rulesOfType'
error with every news fetching. The version of the downloaded source is the same as the downloaded binary version that works fine though (0.7.28). Does it mean that I have problems with my installation from sources or are the sources different (and contain an CSS bug), just the version has not been updated (yet)?
janvanmaar is offline   Reply With Quote
Old 11-16-2010, 02:56 PM   #7
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,771
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
you dont need to compile from sources, just setup a development environment as described in the user manual.

As for your specific error, the version of cssutils on your system is outdated.
kovidgoyal is offline   Reply With Quote
Old 11-16-2010, 05:02 PM   #8
janvanmaar
Addict
janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.
 
Posts: 219
Karma: 404
Join Date: Nov 2010
Device: Kindle 3G, Samsung SIII
Well, I have compiled from sources already... and after cssutils update it works fine.

But to the results: It turned out that Kindle's blog = 0x102 = news feed with flat navigation. Which is certainly less of a problem for me than the broken Kindle behaviour of 0x103 (after all, the next/previous section navigation by arrows is supported by 0x102). So I set Calibre to produce 0x102 instead of 0x103 and I was happy - until I found out that subsequent "blogs" are actually not replaced but all instances are placed to Home, even if exactly the same "blog" is sent repeatedly...

This is rather strange as
1) when I copy over USB, the problem is gone (only one instance is kept)
2) when I receive the subscribed blog from Amazon, one instance is kept
So it seems to be a problem of sending via wifi (I use gmail)... and I have no idea why this is happening...
janvanmaar is offline   Reply With Quote
Old 11-16-2010, 05:06 PM   #9
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,771
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
it may be that with email delivery amazon rewites some internal metadata in the file causing this behavior.

An alternative is to setup the content server and get your files from that.
kovidgoyal is offline   Reply With Quote
Old 11-16-2010, 05:15 PM   #10
janvanmaar
Addict
janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.
 
Posts: 219
Karma: 404
Join Date: Nov 2010
Device: Kindle 3G, Samsung SIII
The problem with that solution is that I would either have to always manually download the file from the server or to jailbreak the Kindle (which I plan to do but only after a few months as it voids the warranty). At least I do not know how to send a file to Kindle without jailbreaking.
janvanmaar is offline   Reply With Quote
Old 11-16-2010, 05:17 PM   #11
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,771
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
yeah...well that's the problem with buying devices from totally closed companies like Amazon
kovidgoyal is offline   Reply With Quote
Old 11-16-2010, 05:22 PM   #12
janvanmaar
Addict
janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.
 
Posts: 219
Karma: 404
Join Date: Nov 2010
Device: Kindle 3G, Samsung SIII
indeed... well, it is just my first reader, I will certainly take this into account when choosing the next one
Anyway, it seems that I am stuck now.
janvanmaar is offline   Reply With Quote
Old 11-16-2010, 07:06 PM   #13
janvanmaar
Addict
janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.
 
Posts: 219
Karma: 404
Join Date: Nov 2010
Device: Kindle 3G, Samsung SIII
Just a small update: it turned out that the sending through Amazon is actually the main reason of this issue - 0x103 behaves just fine when sent over usb too. And the reason is quite clear when looking at the filenames returned by Amazon - they are all different, containing some asin sequences and more... So this whole thread and my testing was rather pointless, I should have noticed the real problem immediately.
EDIT: However, of course it does not diminish your help, Kovid - thanks a lot for that! If nothing else then at least I learnt something again.

Last edited by janvanmaar; 11-16-2010 at 07:56 PM.
janvanmaar is offline   Reply With Quote
Old 11-16-2010, 07:56 PM   #14
janvanmaar
Addict
janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.janvanmaar has a complete set of Star Wars action figures.
 
Posts: 219
Karma: 404
Join Date: Nov 2010
Device: Kindle 3G, Samsung SIII
Another update: Downloading via Calibre content server does not work either. From some reason (may both feature or bug), the files are uploaded to the server with _number suffix, where number is the internal Calibre unique number of a document (Calibre Quick Start Guide gets number 1 and every added document a number increased by 1).
This means that they show up all as different instances in Kindle, creating the same problems as in case of delivery via Amazon. So either a Calibre content server modification or a separate server would be needed for this to work properly.
Oh well, I am getting too tired of this issue now and finally giving up.
janvanmaar is offline   Reply With Quote
Old 11-16-2010, 08:03 PM   #15
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,771
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Yes, the content server always appends db id to filenames to ensure that two records with the same metadata don't clobber each others files.

If you don't care about that, it should be fairly easy to tweak the server to not do this, you'd need to modify server.content and server.mobile
kovidgoyal is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Automatic news feeds uploading, How does it work? JvdW Calibre 23 11-12-2010 10:21 AM
automatic tag changes for news feeds in calibre? SDgirl Sony Reader 0 06-03-2009 09:11 PM
Kindle Newbie working with RSS news feeds Junior94 Introduce Yourself 2 01-02-2009 09:14 AM
How can I aggregate News/Rss feeds to .mobi tinybilbo Bookeen 5 11-08-2008 02:07 PM
Yahoo! Finance News through RSS feeds TadW Lounge 0 01-13-2005 09:06 AM


All times are GMT -4. The time now is 07:46 AM.


MobileRead.com is a privately owned, operated and funded community.