Custom recipes (archive, read-only)

[Starson17]

New Recipe: The Skeptical Inquirer

[roguefan99]

Dunno if anyone has reported this but the Esquire reciepe is returning blank articles for me at the moment. I guess they have changed their site design so that calibre doesn't see it correctly at the moment.

Its been doing it for a few weeks now.

[SSH]

Glad you are collecting requests. I have never posted and don't know if this is the right way. I would like to be able to download www.americanbanker.com to my Kindle2.

[SSH]

I would like to have a recipe for downloading the American Banker, at www.americanbanker.com

[wyh]

Hello,

Could someone clue me in as to how to exclude certain articles from within a feed? I'm trying to customize the New Yorker recipe to exclude a bunch of articles called "Goings On Around Town." They usually have URLs that look like:
http://www.newyorker.com/arts/events/..._GOAT_..... (examples below).

I have a clue that it involves using the filter_regexps command but haven't gotten it to work correctly.

Many thanks in advance!

http://www.newyorker.com/arts/events...h_GOAT_theatre
http://www.newyorker.com/arts/events...ab_GOAT_above1
http://www.newyorker.com/arts/events...z_GOAT_horizon
http://www.newyorker.com/arts/events...GOAT_nightlife

[Starson17]

Originally Posted by wyh

I'm trying to customize the New Yorker recipe to exclude a bunch of articles called "Goings On Around Town."
...
I have a clue that it involves using the filter_regexps command but haven't gotten it to work correctly.

I don't think filter_regexps will work. I believe it operates after the feed is parsed for articles.

There is a lengthy discussion of how exclude articles in a feed in this thread between me and another poster. Search my posts and "parse_index" in this thread. Basically, one method is to use parse_index to read the rss page and build your own feed list without GOAT.

Since that time, I've realized that you can process the articles in the feed list with parse_feeds. See here for some info: http://www.feedparser.org/docs/ Also here.

[wyh]

Thanks for the tip. It looks a bit involved, so I'll have to take some time to try it out. But I do appreciate being pointed in the right direction.

[Starson17]

Originally Posted by wyh

Thanks for the tip. It looks a bit involved, so I'll have to take some time to try it out. But I do appreciate being pointed in the right direction.

You're welcome. Yes, it's a bit complex for the small benefit of removing something from the article list of a feed. As you would have found by reading this thread, I've previously believed that the best way to do the job you want to do is to treat the feed page as a plain web page and build your new feed list (omitting GOAT articles) with parse_index. More recently, I've realized that parse_feeds may be the better way, but I haven't seen it used by others, and haven't had a chance to figure it out for myself yet.

As an aside - I once tried to write a recipe for the New Yorker, before realizing there was a built-in (stored under "The", not "New"). As I was building my own, I found there were multiple other feeds available that split up the single feed used in the built-in. I can't recall if the GOAT feeds are separated, but you might consider looking for other feeds, and if the GOAT feeds are separate, you can just eliminate that feed and use the other separated feeds. (I kept the recipe I wrote as a New Yorker Cartoon only recipe, but never released it, as it duplicates some of the built-in New Yorker recipe).

You may also want to review the Scientific American recipe, as I believe it uses parse_index. Good luck

[Starson17]

There are dozens of specialized Yahoo News feeds. I've only included the Top Stories and General Science. Others can be added from the link in the recipe.

[Starson17]

Originally Posted by eric11210

Hi folks, I know there is a place somewhere on the Calibre site to post custom recipes that people created, but I haven't found it.

This is the right place. You can also post in the bug tracker

If you post here, you should post it as a zip file, or you should post it inside of code tags (the hash/pound symbol). Otherwise, your indents are lost, and indents are critical in a recipe.

[Starson17]

This thread is kind of long.

Does anyone think this sticky thread would be better off being split into two threads - one for pure requests by those who just want it done for them and don't have the skills/time/desire to write their own recipe and a second thread for those who want technical help writing their own recipe?

Comments? Do the mixed-in "how-to" discussions bother those who just want to post or find a recipe request?

[DoctorOhh]

Originally Posted by Starson17

Comments? Do the mixed-in "how-to" discussions bother those who just want to post or find a recipe request?

The mixed in how-to discussions actually encouraged me to create 5 or 6 recipes myself, even though I lack any programing skills.

[trinigyal]

Hello,

Can you help me with the following feed:


http://www.ctntworld.com/LocalCategories.aspx?show=true

[Dmurphy]

Not sure if this is the right place for this or not but...I was trying to read Strategy + Business and noticed that each article ends on my reader after the first page from the article on the website. It appears to not be capturing text past the first page. any help is appreciated.

[eric11210]

Edit: Never mind. I just looked at what I had asked about and it turns out what I wanted wouldn't help me since the site doesn't offer a complete copy of the articles in question.