Recipe for many sites at once

[DrArleigh]

I am migrating from using Plucker for a Palm TX to Calibre for Alkido on an Archos 43. I add articles from the web I want to read to my Google Bookmarks and then periodically export from Google to an HTML file.

That is what I used to feed into Plucker and it worked pretty well. I just had to make some hacks in the Plucker Python for some odd markup that caused certain sites to fail.

I am trying to do something similar with Calibre. I am working on a recipe. Getting the bookmarks file to be parsed and the links downloaded is working. But I will need to add some custom processing logic for certain sites. As a start I am trying to add logic from the english.aljazeera.net recipe to make those pages work.

Is this something others have done? I didn't see anything in this forum but it is a tricky topic to search for.

[Starson17]

Originally Posted by DrArleigh

I am migrating from using Plucker for a Palm TX to Calibre for Alkido on an Archos 43. I add articles from the web I want to read to my Google Bookmarks and then periodically export from Google to an HTML file.

That is what I used to feed into Plucker and it worked pretty well. I just had to make some hacks in the Plucker Python for some odd markup that caused certain sites to fail.

I am trying to do something similar with Calibre. I am working on a recipe. Getting the bookmarks file to be parsed and the links downloaded is working. But I will need to add some custom processing logic for certain sites. As a start I am trying to add logic from the english.aljazeera.net recipe to make those pages work.

Is this something others have done? I didn't see anything in this forum but it is a tricky topic to search for.

Yes. Because different sites are organized differently, it's hard to set the remove_tags and keep_tags options for all sites. You can try that approach. If that doesn't work, use preprocess_html or postprocess_html and BeautifulSoup's extract() to process each page. Or you can try auto_cleanup (read the Using recipes sticky above in this forum).

[julio:map]

You may try readitlater or instapaper recipes.

I personally use readitlater which allows me to read from my ebook or my ipad.

This days ago, there is an active thread "Instapaper - updated recipe" about using "readability" that is something you can think of as a feature included in the recipes concept, to make your recipe able to process most of the webpages (as plucker did).

I have used the same concept with readitlater, (one single line of code telling the system to use readability) and it works.

[Starson17]

Originally Posted by julio:map

You may try readitlater or instapaper recipes.

I personally use readitlater which allows me to read from my ebook or my ipad.

This days ago, there is an active thread "Instapaper - updated recipe" about using "readability" that is something you can think of as a feature included in the recipes concept, to make your recipe able to process most of the webpages (as plucker did).

I have used the same concept with readitlater, (one single line of code telling the system to use readability) and it works.

"auto_cleanup," which I suggested, is a relatively new feature based on code from the ReadItLater open source project. There's a link at the end of the "Using News Recipes: Start Here" sticky to a tutorial on using that feature.