Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Recipes

Notices

Reply
 
Thread Tools Search this Thread
Old 06-20-2011, 05:04 AM   #1
markwaters
Junior Member
markwaters began at the beginning.
 
markwaters's Avatar
 
Posts: 3
Karma: 10
Join Date: Nov 2009
Device: Kindle3
Recipe for Reading Blog Feeds possible ?

Is this possible ?

A recipe that picks up a RSS feed containing items that include links to longer articles.
It could be used to watch a blog or twitter feed that contains links to longer articles for reading later.
I am thinking of sites / feeds like this :-
Any help would be appreciated.
Thanks.
markwaters is offline   Reply With Quote
Old 06-20-2011, 09:45 AM   #2
Starson17
Wizard
Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.
 
Posts: 4,004
Karma: 177841
Join Date: Dec 2009
Device: WinMo: IPAQ; Android: HTC HD2, Archos 7o; Java:Gravity T
Quote:
Originally Posted by markwaters View Post
Is this possible ?

A recipe that picks up a RSS feed containing items that include links to longer articles.
All RSS feeds contain items that include links to longer articles
Quote:
It could be used to watch a blog or twitter feed that contains links to longer articles for reading later.
I am thinking of sites / feeds like this :-
If those aren't RSS feeds, use parse_index.
http://manual.calibre-ebook.com/news.html#id8
Starson17 is offline   Reply With Quote
Old 06-20-2011, 10:41 AM   #3
markwaters
Junior Member
markwaters began at the beginning.
 
markwaters's Avatar
 
Posts: 3
Karma: 10
Join Date: Nov 2009
Device: Kindle3
Normally a RSS feed contains a number of articles which contain the title and the body of the text.

RSS - Article - Title - Body

I am looking for a solution where the RSS feed contains a number of articles which contain the title but inside the body of text is a URL to the actual article I want to read.

RSS - Article - Title - Body - Link - Article - Title - Body

https://secure.wikimedia.org/wikipedia/en/wiki/Linklog

If I use my current (working) RSS feed recipe I will end up with an ebook containing links to articles.
I am hoping to have calibre go to the next link and pull that article in instead.

Does that make more sense ?
markwaters is offline   Reply With Quote
Old 06-20-2011, 10:58 AM   #4
Starson17
Wizard
Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.
 
Posts: 4,004
Karma: 177841
Join Date: Dec 2009
Device: WinMo: IPAQ; Android: HTC HD2, Archos 7o; Java:Gravity T
Quote:
Originally Posted by markwaters View Post
Normally a RSS feed contains a number of articles which contain the title and the body of the text.
There are various RSS feed formats. Some have the body in the feed, some have only a short summary and a link to the body. Calibre's recipe system can handle all. By default, if the body is longer than 500 characters, Calibre will assume the body is in the feed, and if it's shorter, Calibre will assume the link has the article and retrieve the link. You can force either behavior.

You are asking about non-RSS feeds, aka a "linklog" or just a page that has links. Calibre can handle those as well. As I posted, parse_index is the tool for that job.

Quote:
If I use my current (working) RSS feed recipe I will end up with an ebook containing links to articles.
I suspect that's because it's not an RSS feed, even though it may sort of look like one.

Quote:
I am hoping to have calibre go to the next link and pull that article in instead.
Does that make more sense ?
It made sense the first time. Use parse_index and see the NYT example. You have to craft code to grab the links and create a virtual feed inside the recipe. That's what parse_index does - you tell it to read the page, how to find the links you want, what titles and summaries and dates to use and it builds the virtual RSS feed then proceeds as though there was a real RSS feed.

Last edited by Starson17; 06-20-2011 at 11:09 AM.
Starson17 is offline   Reply With Quote
Old 06-20-2011, 11:08 AM   #5
Starson17
Wizard
Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.
 
Posts: 4,004
Karma: 177841
Join Date: Dec 2009
Device: WinMo: IPAQ; Android: HTC HD2, Archos 7o; Java:Gravity T
BTW, although parse_index is the preferred way to deal with this, you can also try using "recursions" which sets the depth that links will be followed. If your pages are clean, with only links to pages you want, this might do the job.

Also, I should warn you that linklogs where the links are to random pages of interest are poor fodder for recipes. Recipes need some consistency to the pages retrieved if it is going to remove ads, apply formatting, etc. If the links point to just any old random pages, and not to pages with common attributes, the recipe results will be poor.
Starson17 is offline   Reply With Quote
Old 06-20-2011, 11:28 AM   #6
markwaters
Junior Member
markwaters began at the beginning.
 
markwaters's Avatar
 
Posts: 3
Karma: 10
Join Date: Nov 2009
Device: Kindle3
OK , thanks for the answers , at least I know its possible and can give it a try.
markwaters is offline   Reply With Quote
Old 06-22-2011, 12:55 PM   #7
BRGriff
Connoisseur
BRGriff began at the beginning.
 
Posts: 55
Karma: 12
Join Date: May 2011
Location: Deland, Florida
Device: Kindle 3
Try these links for an RSS feed and go from there. It is much simpler and a recipe can be created with little difficulty.
Hope this helps. If so, please do not forget to add to my "Karma".
BRGriff is offline   Reply With Quote
Reply

Tags
calibre, feeds, reading, recipe, request

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
REQUEST: recipe for blog ayurazzz Recipes 0 03-25-2011 01:00 PM
Recipe for Flickr Blog rickydh Recipes 0 02-24-2011 12:59 PM
LRB BLOG - -RECIPE HELP JFS-NMF Recipes 0 01-28-2011 10:00 PM
Automatic sending of RSS news feeds to Kindle as blog/ebook janvanmaar Calibre 19 11-17-2010 01:16 PM
New recipe for Frederik Pohl's blog kiklop74 Recipes 0 09-27-2010 03:34 PM


All times are GMT -4. The time now is 08:08 AM.


MobileRead.com is a privately owned, operated and funded community.