Custom recipes (archive, read-only)

[jj2me]

Does anybody have some sample code for dealing with incrementing days/months/years in a cover URL?

Here's how the URLs progress for the two recipes I've contributed in this thread:

Sports Illustrated covers (weekly)
http://i.cdn.turner.com/sivault/si_o...1026_large.jpg
http://i.cdn.turner.com/sivault/si_o...1101_large.jpg

Smithsonian covers (monthly):
http://media.smithsonianmag.com/images/200910_cover.jpg
http://media.smithsonianmag.com/images/200911_cover.jpg

Somehow, the code needs to figure out the current date, and try the next likely increment. If failure, decrement 7 days (or 1 month for the monthly magazine).

Since my two home-grown recipes both have this kind of pattern, I presume that others have encountered and solved this problem already. Or is this the exercise that gets me to learn Python?

[EDIT: Ack, the url tags that got automatically inserted for clickability, managed to hide the part of the Sports Illustrated URL which contains year information. Here is what they should look like:
h ttp://i.cdn.turner.com/sivault/si_online/covers/images/2009/1026_large.jpg
h ttp://i.cdn.turner.com/sivault/si_online/covers/images/2009/1101_large.jpg ]

[kovidgoyal]

There are two alternative approaches you can take

1) Get the webpage and search for the cover URL in it

2) Try alternative URLs

Both require some programming

I'll outline 2

from datetime import datetime, timedelta

t = datetime.utcnow()
while True:
    url = t.strftime('http://whatever/%Y/%m%d_large.jpg')
    try:
         self.browser.open(url)
         return url
    except:
          t = t - timedelta(days=1)

[elgabo]

i'm sorry for asking again but nothing I do fix this. I still only get 5 or 6 sections and I include 8

Any help will be very appreciate

class AdvancedUserRecipe1255971765(BasicNewsRecipe):
    title          = u'Milenio Noticias'
    oldest_article = 2
    max_articles_per_feed = 100
    no_stylesheets = True
    remove_tags_after = dict(name='div',attrs={'class':'go_to'})
    remove_tags    = [dict(name='div', attrs={'class':'print-logo'})]
    remove_attributes = ['style', 'width']
    remove_attributes = ['style', 'height']




    feeds          = [(u'Milenio a tiempo', u'http://www.milenio.com/feed/atiempo/df'),
(u'Politica', u'http://www.milenio.com/feed/atiempo/politica'),
(u'Negocios', u'http://www.milenio.com/feed/atiempo/negocios'),
(u'Policia', u'http://www.milenio.com/feed/atiempo/policia'),
(u'Tendencias', u'http://www.milenio.com/feed/atiempo/tendencias'),
(u'Internacional', u'http://www.milenio.com/feed/atiempo/internacional'),
(u'Cultura', u'http://www.milenio.com/feed/atiempo/cultura'),
(u'Espectaculos', u'http://www.milenio.com/feed/atiempo/espectaculos')]

    def print_version(self, url):
    	return url.replace('http://www.milenio.com/node', 'http://www.milenio.com/print')

[kovidgoyal]

probably because the others contain no articles newer than 2 days

[scwehrl]

Vista SP1 CNN downloads but everything except Sports, Business and one more is just trailers? Uninstalled, nuked everything except the library, reinstalled 6.20, no joy. The job details are attached if that helps

[kovidgoyal]

probably the website changed and the recipe will have to be adjusted. Opena ticket for it.

[elgabo]

Originally Posted by kovidgoyal

probably because the others contain no articles newer than 2 days

If I see in calibre internal view there are articles downloaded but when I send to kindle those articles not appear but only the first 5 sections articles.

[Det-Mark]

I would like a recipe to get articles from the Detroit Free Press.
The list of RSS feeds is here.

http://freep.com/rss

If I can get one that works I can probable get the others myself, like Today's News Headlines, Sports - Spartans, etc...

The RSS link is here.

http://www.freep.com/apps/pbcs.dll/s...e=rss&mime=xml

Which yields this HTML (in part):


<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
<channel>
<title>freep.com | Local News</title>
<description>Latest news County from the Detroit Free Press newspaper of metro Detroit, Michigan, City of Detroit, Oakland County, Wayne County, Macomb County including analysis, commentary and opinion of current events, local news and Detroit area newsmakers.</description>
<link>http://www.freep.com</link>
<language>en-us</language>
<copyright>Copyright 2009, freep.com</copyright>

<generator>SaxoTech Online</generator>
<pubDate>Sat, 31 Oct 2009 00:00:00 00</pubDate>
<lastBuildDate>Sat, 31 Oct 2009 12:53:37 00</lastBuildDate>
<ttl>15</ttl>
<item>
<title>Hundreds at Freedom Hill for H1N1 shots</title>
<link>http://www.freep.com/article/20091031/NEWS05/91031007/1001/news</link>

<description>Hundreds of adults and children have bundled up in winter garb at Freedom Hill County Park in Sterling Heights, hoping to get vaccinated at the last H1N1 clinic in Macomb County this week.</description>
<pubDate>Sat, 31 Oct 2009 11:12:00 00</pubDate>
<guid isPermaLink="true">http://www.freep.com/article/20091031/NEWS05/91031007/1001/news</guid>
</item>


Thanks In advance
Det-Mark

[viv.ie]

Hi Guys
Cant seem to download the Irish Independent which has been added to the latest version of calibre as it gets stuck at 47% and hangs.Any ideas?
Thanks.

[Ea]

I would like a recipe for
http://jp.dk/rss/udland.jsp (international news)
http://jp.dk/rss/indland.jsp (domestic news)
http://jp.dk/rss/kultur.jsp (culture news)

If it could be combined into one it would be great

[kovidgoyal]

Sorry guys, I'm down with the flu, so I wont be able to help you for the next few days.

[kennyc]

Originally Posted by kovidgoyal

Sorry guys, I'm down with the flu, so I wont be able to help you for the next few days.

Oh No. I hope it's not too bad and not the swine flu!, get better soon, best wishes flowing!

[--abc--]

Can someone please have a look at the recipe for NZZ Online?

Example output:

This article was downloaded by calibre from http://www.nzz.ch//nachrichten/wirts...1.3975833.html


| Section menu | Main menu |
| Next | Section menu | Main menu | Previous |

The content is missing.

Update: I just created a ticket for this.

http://calibre.kovidgoyal.net/ticket/3936

[bookfanmd]

Hi,
I read in another thread that a recipe would be a good solution to use to convert books to the .imp format for the EBW1150 in Calibre. If someone could write that recipe it would be great. Thanks.

[niaiserie]

First, I just want to say thanks to whoever created the Harper's subscription recipe. It works beautifully. But I was wondering, since Harper's gives subscribers access to all past issues, if there was a way to download a specific issue via some input in the Fetch News dialog?

I'd also like to request a recipe for the subscription version of The Nation.

Thanks.

** I just figured out that changing the month in Windows will download the Harper's magazine for that particular month... it'd still be nice to select the month within Calibre though. **