|
|
#1 |
|
Junior Member
![]() Posts: 2
Karma: 10
Join Date: Dec 2010
Device: Kindle3
|
Updated: Gazet van Antwerpen (GVA_BE)
Hi,
I've been using the GVA recipe for a few months now, but recently the newspaper updated their feeds in such a way that the overview feed contains all articles from the other feeds as well, which basically makes you're now downloading every article twice. Therefor I removed that feed from the recipe and also corrected an error which made that the "Science" section contained "Media" articles. This is the new gva_be.recipe: Code:
#!/usr/bin/env python
__license__ = 'GPL v3'
__copyright__ = '2009, Darko Miletic <darko.miletic at gmail.com>'
'''
www.gva.be
'''
from calibre.web.feeds.news import BasicNewsRecipe
from calibre.ebooks.BeautifulSoup import Tag
class GazetvanAntwerpen(BasicNewsRecipe):
title = 'Gazet van Antwerpen'
__author__ = 'Darko Miletic'
description = 'News from Belgium in Dutch'
publisher = 'Gazet van Antwerpen'
category = 'news, politics, Belgium'
oldest_article = 2
max_articles_per_feed = 100
no_stylesheets = True
use_embedded_content = False
encoding = 'utf-8'
language = 'nl_BE'
lang = 'nl-BE'
direction = 'ltr'
html2lrf_options = [
'--comment' , description
, '--category' , category
, '--publisher', publisher
]
html2epub_options = 'publisher="' + publisher + '"\ncomments="' + description + '"\ntags="' + category + '"\noverride_css=" p {text-indent: 0cm; margin-top: 0em; margin-bottom: 0.5em} "'
keep_only_tags = [dict(name='div', attrs={'id':'article'})]
remove_tags = [
dict(name=['embed','object'])
, dict (name='div',attrs={'class':['note NotePortrait','note']})
]
remove_tags_after = dict(name='span', attrs={'class':'author'})
feeds = [
(u'Binnenland' , u'http://www.gva.be/syndicationservices/artfeedservice.svc/rss/mostrecent/binnenland' )
,(u'Buitenland' , u'http://www.gva.be/syndicationservices/artfeedservice.svc/rss/mostrecent/buitenland' )
,(u'Stad & Regio' , u'http://www.gva.be/syndicationservices/artfeedservice.svc/rss/mostrecent/stadenregio' )
,(u'Economie' , u'http://www.gva.be/syndicationservices/artfeedservice.svc/rss/mostrecent/economie' )
,(u'Media & Cultur' , u'http://www.gva.be/syndicationservices/artfeedservice.svc/rss/mostrecent/mediaencultuur')
,(u'Wetenschap' , u'http://www.gva.be/syndicationservices/artfeedservice.svc/rss/mostrecent/wetenschap' )
,(u'Sport' , u'http://www.gva.be/syndicationservices/artfeedservice.svc/rss/mostrecent/sport' )
]
def preprocess_html(self, soup):
del soup.body['onload']
for item in soup.findAll(style=True):
del item['style']
soup.html['lang'] = self.lang
soup.html['dir' ] = self.direction
mlang = Tag(soup,'meta',[("http-equiv","Content-Language"),("content",self.lang)])
mcharset = Tag(soup,'meta',[("http-equiv","Content-Type"),("content","text/html; charset=utf-8")])
soup.head.insert(0,mlang)
soup.head.insert(1,mcharset)
return soup
|
|
|
|
|
|
#2 |
|
creator of calibre
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 45,639
Karma: 28549046
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
thanks, builtin recipe updated.
|
|
|
|
| Advert | |
|
|
![]() |
| Tags |
| gazet van antwerpen, gva |
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Don van Vliet dies | TGS | Lounge | 10 | 12-20-2010 12:02 PM |
| updated metadata=updated file? | jomaweb | Calibre | 13 | 01-28-2010 09:12 PM |
| Science Fiction Sutphen, Van Tassel: The Doomsman. V1. 21 May 2009 | crutledge | Kindle Books | 2 | 05-23-2009 08:45 AM |
| Science Fiction Sutphen, Van Tassel: The Doomsman. V1. 21 May 2009 | crutledge | BBeB/LRF Books | 0 | 05-21-2009 07:37 PM |
| Short Fiction Sutphen, Van Tassel: The Doomsman. V1. 21 May 2009 | crutledge | IMP Books | 0 | 05-21-2009 07:34 PM |