Custom recipes (archive, read-only)

[TouchToneTommy]

Thanks for your input and insights, dwanthny and Starson17.

So far, I have not been able to make either to work. Spent the evening googling Python, and not really grasping it yet.

One thing I tried, was " insert(url[:40] + 'v-print/' + url[40:]) ", to break the url at the 40th character, insert the "v-print", and then continue (since the date is always the same number of characters, using 2 digits for even a single digit month or day), but I don't have the form or syntax right yet.

I also tried looking for a newspaper from the same publisher (McClatchy) in the included recipes, hoping that their web templates might be the same. So far, haven't found anything.

[mik991]

Hi,

Is there anyway to customize the filename using the recipe?
Currently a news file will be named something like "Newsweek_2010-5-24.epub" I would like it to read "Newsweek.epub".

This way when calibre moves over files to my nook it should just overwrite the old effectively deleting obsolete news.

Thanks

No you can't adjust the filenames for news files. Eventually calibre will be able to delete news files from the device automatically when you connect it, but not at the moment.

[Starson17]

Originally Posted by TouchToneTommy

Thanks for your input and insights, dwanthny and Starson17.

So far, I have not been able to make either to work. Spent the evening googling Python, and not really grasping it yet.

One thing I tried, was " insert(url[:40] + 'v-print/' + url[40:]) ", to break the url at the 40th character, insert the "v-print", and then continue (since the date is always the same number of characters, using 2 digits for even a single digit month or day), but I don't have the form or syntax right yet.

I also tried looking for a newspaper from the same publisher (McClatchy) in the included recipes, hoping that their web templates might be the same. So far, haven't found anything.

Run your recipe from the command line, use the -vv option and print the "url" variable to see why it isn't working. Read this

[Starson17]

Originally Posted by dwanthny

Thanks for the pointer.
I am curious though, do wildcards work?
If they do what I wrote should return the print edition.

I am not a Python expert, so I'm not the one to ask. I've never tried to use wildcards outside of the regular expression context. All I can say is that I've seen the insert-something-into-url problem solved several times in recipes, and it's always been just a split-at-slash and reassemble or a regex solution.

[kovidgoyal]

wildcards do not work, you have to use a regular expression or the fnmatch module if you want to use wildcards.

[Starson17]

Originally Posted by TouchToneTommy

One thing I tried, was " insert(url[:40] + 'v-print/' + url[40:]) "

I really should never give advice on Python, without testing, but I can't resist. The code above doesn't look right to me. "insert" will put something into a list, but you've got two problems. First is your form - you'd need to specify the list you're inserting into like: list.insert(i, x). The first argument is the index of the element before which to insert.

Second, I don't think you can insert into a string in Python - instead, you create a new string.

You might try this:

url2 = url[:40] + 'v-print/' + url[40:]
return url2

[Starson17]

Originally Posted by kovidgoyal

wildcards do not work, you have to use a regular expression or the fnmatch module if you want to use wildcards.

When first trying to understand regular expressions, I asked a friend for help. IIRC, his answer was something like .. "If you have a problem that needs to be solved with a regular expression ... now you have two problems."

[kovidgoyal]

Originally Posted by Starson17

When first trying to understand regular expressions, I asked a friend for help. IIRC, his answer was something like .. "If you have a problem that needs to be solved with a regular expression ... now you have two problems."

But I must say that having learning regular expressions has boosted my productivity by an order of magnitude.

[chaley]

I have been a user of regular expressions since my early ed/ex/vi days in the early '70s. I can't imagine working on text without them. I remember 'grokking' (shows my age) that a regexp is just a description/template/pattern, and the lights turned on.

If you enjoy constructing regexps, play a bit with (f)lex, a program that generates lexical analyzers that can read files with known structure and split them into usable 'words' (technically, tokens). I am often surprised by how many problems are amenable to solution by a combination of lexical processing and subsequent parsing.

Yes, I know I am weird. Can't help it, and really don't want to change.

[kovidgoyal]

Yeah calibre uses pyparsing to build the parser that tokenizes the search strings. While I haven't used lex/yacc at all, I do enjoying working with pyparsing.

http://onlamp.com/pub/a/python/2006/...pyparsing.html

[TouchToneTommy]

Thanks for everyone's help!! Especially the link to recipe guide, that I did not find by Googling.

Here's what I came up with, a little tweaking of Starson17's original suggestion

    def print_version(self, url):
        segments = url.split('/')
        print_url = 'http://' + segments[2] + '/' + segments[3] + '/' + segments[4] + '/' + segments[5] + '/'  \
                + 'v-print/' + segments[6] + '/' + segments[7]
        return print_url

It was a matter of the segment numbers and an extra slash before 'v-print'

This is really exciting! And now I need to spend some time learning about Python, is there a "Python for Dummies"?

Thanks again!!!

[Starson17]

Originally Posted by TouchToneTommy

This is really exciting! And now I need to spend some time learning about Python, is there a "Python for Dummies"?

Try here.

[bhandarisaurabh]

I WOULD LIKE TO REQUEST A RECIPE FOR
http://knowledge.wharton.upenn.edu/india/rss/
AND
http://knowledge.wharton.upenn.edu/rss/

[notyou]

Hoping someone can help me with the Wired Magazine recipe, which the latest June 2010 issue seems to have broken.

Calibre is giving me the dreaded "AttributeError: 'NoneType' object has no attribute 'a'" error:

It's happening here:

File "c:\docume~1\darryl~1\locals~1\temp\calibre_0.6.54 _jujqqs_recipes\recipe0.py", line 79, in parse_index
url = 'http://www.wired.com' + divurl.a['href']

Looking at the source at http://www.wired.com/magazine I think the problem may be that Wired has added a new "Bonus Video" section which does not have a feature-header div, and so the URL cannot be parsed from there. Is there anyways to have Calibre skip feature sections that don't have headers?

Thanks!

[kiklop74]

I'll look into that this weekend if time permits