downloading epub in recipe Biweekly.pl

[luka6000]

Hello,

I'd like to share my recipe of english edition of polish cultural magazine biweekly.pl

Spoiler:

#!/usr/bin/env python
# -*- coding: utf-8 -*-

__license__ = 'GPL v3'
__copyright__ = u'Łukasz Grąbczewski 2011'
__version__ = '2.0'

import re, zipfile, os, time
from calibre.ptempfile import PersistentTemporaryDirectory
from calibre.ptempfile import PersistentTemporaryFile
from urlparse import urlparse

class biweekly(BasicNewsRecipe):
	__author__ = u'Łukasz Grąbczewski'
	title = 'Biweekly'
	language = 'en_EN'
	publisher = 'National Audiovisual Institute'
	publication_type = 'magazine'
	description = u'link with culture [English edition of Polish magazine]: literature, theatre, film, art, music, views, talks'
	
	conversion_options = {
		'authors' : 'Biweekly.pl'
		,'publisher' : publisher
		,'language' : language
		,'no_default_epub_cover' : True
		,'preserve_cover_aspect_ratio': True
	}

	def build_index(self):
		browser = self.get_browser()
		rc = browser.open('http://www.biweekly.pl/')

		# find the link
		epublink = browser.find_link(text_regex=re.compile('ePUB VERSION'))

		# Cheat calibre's recipe method
		self.report_progress(0,_('downloading'))
		response = browser.follow_link(epublink)
		dir = PersistentTemporaryDirectory()
		book_file = PersistentTemporaryFile(suffix='.epub')
		book_file.write(response.read())
		book_file.close()
				
		self.report_progress(0.2,_('Converting to OEB'))
		oebdir = self.output_dir + '/INPUT/'
		cmd = 'ebook-convert "' + book_file.name + '" "' + oebdir + '"'
		os.system(cmd)
		
		index = os.path.join(oebdir, 'content.opf')
		self.report_progress(0.2,_('successfully downloaded and extracted'))
		
		return index

Let me comment the code and then ask some questions :-)
Basically this recipe opens a web page, finds the epub link, downloads it and converts it to OEB directory structure and outputs that as recipe feed. I think this is a better way of managing this kind of downloadable ebook news than just using zipfile epub unzip as Lars Jacob and Starson17. Using conversion to OEB it is possible to use as input anything that conversion can recognize (mobi, html, txt etc). The problem with this code is that it will not work if ebook-convert is not in path. So my question is if someone could help me with using conversion not as a system call but using native python code. I've already have few more recipes of such "download ebook from here" sources but would like to establish a proper way of handling this kind of news. Thanks in advance!

[kovidgoyal]

If you want to call ebook-convert programmatically, just do

from calibre.ebooks.conversion.cli import main
main(['ebook-convert', 'input.epub', 'oeb', 'whatever', 'options', 'you', 'need'])

[luka6000]

thanks Kovid.

So here comes first two production ready (I think) recipes
biweekly.pl, favicon [EN]
dwutygodnik.com, favicon [PL]