how to filter feeds

[t3d]

Hello!

I have some recipes that are almost ready to publish, but there are some articles that won't work on e-readers. I want to filter them out by URL. It should be easy, as their URLs contains some unique strings. Here is my try, that depicts the idea, but doesn't work at all:

    def get_article_url(self, article): 
        link = article.get('link')
        audio = link.find('audio')
        if not audio:
            return link

I am not familiar with python, so I am not sure if it should have something like "return NULL" when the string is found or not

[TonytheBookworm]

Originally Posted by t3d

Hello!

I have some recipes that are almost ready to publish, but there are some articles that won't work on e-readers. I want to filter them out by URL. It should be easy, as their URLs contains some unique strings. Here is my try, that depicts the idea, but doesn't work at all:

    def get_article_url(self, article): 
        link = article.get('link')
        audio = link.find('audio')
        if not audio:
            return link

I am not familiar with python, so I am not sure if it should have something like "return NULL" when the string is found or not

Try something like this:

Spoiler:

 def preprocess_html(self, soup) :
        
        weblinks = soup.findAll(['a'])
        if weblinks is not None:
            for link in weblinks:
                if re.search('audio',str(link)):
                  
                  link.parent.extract()
        return soup

[kovidgoyal]

You want

def get_article_url(self, article): 
        link = article.get('link')
        if 'audio' not in link:
             return link

[t3d]

Originally Posted by kovidgoyal

You want

def get_article_url(self, article): 
        link = article.get('link')
        if 'audio' not in link:
             return link

Working well and already implemented:
http://github.com/t3d/kalibrator/com...3ad755eb6e597e

Thanks!

[TonytheBookworm]

Originally Posted by kovidgoyal

You want

def get_article_url(self, article): 
        link = article.get('link')
        if 'audio' not in link:
             return link

Kovid,
Thanks for showing that method. I have been doing the preprocess one for a while like with the popscience.recipe but your method is cleaner and faster. Thanks again. I will be updating the popscience for submission in a future build so it implements this. That is one thing I love about this forum and calibre. I learn something new every single day by folks helping others.

[kovidgoyal]

@TtB: That emthod is for recipes that download articles from RSS feeds. It filters items from the RSS feed. It is not meant for filtering links in the actual article

[TonytheBookworm]

Originally Posted by kovidgoyal

@TtB: That emthod is for recipes that download articles from RSS feeds. It filters items from the RSS feed. It is not meant for filtering links in the actual article

I was wondering what the difference was. thank you for explaining that.

[t3d]

@Kovid
I didn't expect you would immediately add my recipe
Actually I recently improved the string used for filtering so that eg. article with 'audiobook' in title wouldn't be ommited

Could you please update it with this revision: http://github.com/t3d/kalibrator/raw..._opinie.recipe

It is the same source as rmf24_fakty.recipe and rmf24_ESKN.recipe, so please link it to the same favicon. I sometimes split one source into more recipes to prevent ebook files from growing into files too big for ebook devices, and separate not related topics.

[kovidgoyal]

done .