Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Recipes

Notices

Reply
 
Thread Tools Search this Thread
Old 12-15-2010, 11:01 PM   #1
Onecanuck
Member
Onecanuck began at the beginning.
 
Onecanuck's Avatar
 
Posts: 12
Karma: 10
Join Date: Jan 2010
Device: Sony PRS600S
Recipe produces no Images - Please help.

I am the Editor of a weekly newspaper in Canada. We are in the process of buliding a new website, with RSS feeds so that we can have readers subscribe to our feeds and have Calibre port them into eReaders. (ePub format)

The problem I am having is that my Recipe does not fetch our photos. I get the content, but only the text.

I have checked the manual and this forum, but there I fail to locate any indication that Calibre is fussy about what type of web graphic it filters out.

Is there anyone out there that can help me either understand the problem, or even help my create the recipe?

Thank you..
Brian Hahn
Onecanuck is offline   Reply With Quote
Old 12-16-2010, 09:41 AM   #2
marbs
Zealot
marbs began at the beginning.
 
Posts: 122
Karma: 10
Join Date: Jul 2010
Device: nook
try posing your code and the relevant RSS feeds.
marbs is offline   Reply With Quote
Old 12-16-2010, 09:42 AM   #3
Starson17
Wizard
Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.
 
Posts: 4,004
Karma: 177841
Join Date: Dec 2009
Device: WinMo: IPAQ; Android: HTC HD2, Archos 7o; Java:Gravity T
Quote:
Originally Posted by Onecanuck View Post
I am the Editor of a weekly newspaper in Canada. We are in the process of buliding a new website, with RSS feeds so that we can have readers subscribe to our feeds and have Calibre port them into eReaders. (ePub format)

The problem I am having is that my Recipe does not fetch our photos. I get the content, but only the text.

I have checked the manual and this forum, but there I fail to locate any indication that Calibre is fussy about what type of web graphic it filters out.

Is there anyone out there that can help me either understand the problem, or even help my create the recipe?

Thank you..
Brian Hahn
We'd need to see the RSS feed and/or the pages/articles that the feed points to. Are the images jpgs?
Starson17 is offline   Reply With Quote
Old 12-16-2010, 04:53 PM   #4
Onecanuck
Member
Onecanuck began at the beginning.
 
Onecanuck's Avatar
 
Posts: 12
Karma: 10
Join Date: Jan 2010
Device: Sony PRS600S
Hi, and thank you for the quick reply.

The images are .jpg files. I first tried .gif but the change did nothing. The website is under development so the feed page address will change after completion.

It is temporarily on a subdomain. The feed can be found at: http://pipestone.inmca.com/feeds.asp. The actual address will be www.pipestoneflyer.ca when the site is moved over.

Like I said before, the text formats perfectly with the recipe wizard in Calibre. But this image problem is confounding. If anyone can help, It would be appreciated.

Thank you..

Brian Hahn
Editor
Onecanuck is offline   Reply With Quote
Old 12-16-2010, 05:31 PM   #5
Starson17
Wizard
Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.
 
Posts: 4,004
Karma: 177841
Join Date: Dec 2009
Device: WinMo: IPAQ; Android: HTC HD2, Archos 7o; Java:Gravity T
Quote:
Originally Posted by Onecanuck View Post
The feed can be found at: http://pipestone.inmca.com/feeds.asp.
That's not a feed. That page has multiple links to multiple feeds.
Quote:
Like I said before, the text formats perfectly with the recipe wizard in Calibre. But this image problem is confounding. If anyone can help, It would be appreciated.
Your problem is that your actual feeds have both the full content and images. That's unusual. 95% or more of feeds have just brief summaries with links to pages (the articles) that have the full content. Calibre tries to detect if the feed has full content or links to content. It does that by analyzing the length of the text. When the text is long, (500 plus words IIRC) it will assume all the content is on the feed, and it won't go to the article pages with your images.

You can force Calibre to follow to the articles with:

Code:
use_embedded_content = False
Try that and it should go to your article pages and find your images.

Last edited by Starson17; 12-16-2010 at 05:33 PM.
Starson17 is offline   Reply With Quote
Old 12-16-2010, 06:27 PM   #6
Onecanuck
Member
Onecanuck began at the beginning.
 
Onecanuck's Avatar
 
Posts: 12
Karma: 10
Join Date: Jan 2010
Device: Sony PRS600S
Still no Joy...

Quote:
Originally Posted by Starson17 View Post
That's not a feed. That page has multiple links to multiple feeds.


Your problem is that your actual feeds have both the full content and images. That's unusual. 95% or more of feeds have just brief summaries with links to pages (the articles) that have the full content. Calibre tries to detect if the feed has full content or links to content. It does that by analyzing the length of the text. When the text is long, (500 plus words IIRC) it will assume all the content is on the feed, and it won't go to the article pages with your images.

You can force Calibre to follow to the articles with:

Code:
use_embedded_content = False
Try that and it should go to your article pages and find your images.
Hi and thank you for the quick reply,

So this is what I am up to. I downloaded Python and did as you said. I put the changes the embedded condition to FALSE. Now when I run the script, the recipe downloads all images from the website. So in fact it is not really just taking the feed from the RSS files. I have never used Python and the so I am learning as I go.

The following is how my script looks:

class AdvancedUserRecipe1292537099(BasicNewsRecipe):

title = 'Leduc - Wetaskiwin Pipestone Flyer'
__author__ = 'Brian Hahn'
description = 'News from Alberta, Canada'


oldest_article = 14
max_articles_per_feed = 100
no_stylesheets = False
#delay = 1
use_embedded_content = False
encoding = 'utf8'
publisher = 'Pipestone Publishing'
category = 'News, Alberta, Canada'
language = 'en_CA'

feeds = [
('Features Stories', 'http://pipestone.inmca.com/Feature.rss'),
('Editorial Comment', 'http://pipestone.inmca.com/Comments.rss'),
('Letters to the Editor', 'http://pipestone.inmca.com/Opinion.rss'),
('Opinion', 'http://pipestone.inmca.com/Columnists.rss'),
('Sports', 'http://pipestone.inmca.com/Sports.rss'),
('On the Beat', 'http://pipestone.inmca.com/Police%20Blotter.rss'),
('Business News', 'http://pipestone.inmca.com/Chambers.rss'),
('Local Government', 'http://pipestone.inmca.com/Government.rss'),
('Faith', 'http://pipestone.inmca.com/Faith.rss'),

]

I appreciate all your feedback and patience.

Thanks again.

Brian Hahn
Onecanuck is offline   Reply With Quote
Old 12-16-2010, 09:29 PM   #7
Starson17
Wizard
Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.
 
Posts: 4,004
Karma: 177841
Join Date: Dec 2009
Device: WinMo: IPAQ; Android: HTC HD2, Archos 7o; Java:Gravity T
Your heading is "Still no joy" but I don't see a question in your post. Do you have one?

You wrote:
Quote:
Originally Posted by Onecanuck View Post
Now when I run the script, the recipe downloads all images from the website.
Isn't that what you wanted?

Quote:
So in fact it is not really just taking the feed from the RSS files.
I'm not sure what this means? It sounds to me like it's working as it's supposed to.
Starson17 is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Calibre produces Python function terminated unexpectedly roelvdh Calibre 6 09-09-2013 08:50 PM
The Economist recipe images are too large santino1980 Recipes 4 11-01-2010 04:35 PM
New Recipe features supporting Kindle masthead images GRiker Calibre 6 08-27-2010 05:08 PM
Instapaper now produces epub files Harmon Sony Reader 19 02-14-2010 04:31 PM
Seiko Epson produces hi-res E Ink display Alexander Turcic News 38 11-23-2007 01:00 PM


All times are GMT -4. The time now is 02:46 PM.


MobileRead.com is a privately owned, operated and funded community.