Help needed for "Tagespost" recipe

[Leonatus]

Might be this is a beginners issue:
I tried to write a recipe for the "Tagespost" newspaper. It'sthis:

#!/usr/bin/env python2
# vim:fileencoding=utf-8
from __future__ import unicode_literals, division, absolute_import, print_function
from calibre.web.feeds.news import BasicNewsRecipe

class AdvancedUserRecipe1589629735(BasicNewsRecipe):
    title          = 'Tagespost'
    oldest_article = 7
    max_articles_per_feed = 100
    auto_cleanup   = True

    feeds          = [
        ('Tagespost', 'https://www.die-tagespost.de/storage/rss/rss/die-tagespost-komplett.xml'),
    ]
    
    def print_version(self, url):
        return url + "/print/yes"
    def get_browser(self, *a, **kwargs):
        kwargs['verify_ssl_certificates'] = False
        return BasicNewsRecipe.get_browser(self, *a, **kwargs)
    extra_css = 'td.textb {font-size: medium;}'

First, everything seemed to work well: The content page showed the headers with short summaries. But pageing downwards, there appear only the headers of two articles, and where should be the text of the articles, only the summaries of all the articles shown in the content page are repeated, and this various times, so that the paper got a volume of about 200 pages.

Can someone, please, tell me what I'm doing wrong?

[PatStapleton]

Try this:

I added use_embedded_content = False which tells Calibre to follow the links in the feed (not just use the summary)

I also commented out the other sections with a # as they aren't needed.

#!/usr/bin/env python2
# vim:fileencoding=utf-8
from __future__ import unicode_literals, division, absolute_import, print_function
from calibre.web.feeds.news import BasicNewsRecipe

class AdvancedUserRecipe1589629735(BasicNewsRecipe):
    title          = 'Tagespost'
    oldest_article = 7
    max_articles_per_feed = 100
    auto_cleanup   = True
    use_embedded_content = False

    feeds          = [
        ('Tagespost', 'https://www.die-tagespost.de/storage/rss/rss/die-tagespost-komplett.xml'),
    ]
    
#    def print_version(self, url):
#        return url + "/print/yes"
#    def get_browser(self, *a, **kwargs):
#        kwargs['verify_ssl_certificates'] = False
#        return BasicNewsRecipe.get_browser(self, *a, **kwargs)
    extra_css = 'td.textb {font-size: medium;}'

[Leonatus]

Great! That works phantastically, even pictures appear! Thank you so much!
Would you like to add the recipe to Calibre's collection, once you had dealt with the work?
I still have only a slight idea about what has been the trick.

[PatStapleton]

Sure, I think Kovid usually is kind enough to add them from here to Calibre.

Here's a tidier version that Kovid might be able to use:

#!/usr/bin/env python2
# vim:fileencoding=utf-8
from __future__ import unicode_literals, division, absolute_import, print_function
__license__ = 'GPL v3'
__copyright__ = '2020, Pat Stapleton <pat.stapleton at gmail.com>'
'''
Recipe for Die Tagespost
'''
from calibre.web.feeds.news import BasicNewsRecipe

class AdvancedUserRecipe1589629735(BasicNewsRecipe):
    title          = 'Tagespost'
    language       = 'de'
    __author__     = 'Pat Stapleton'
    description = 'Die Tagespost trägt den Untertitel Katholische Wochenzeitung für Politik, Gesellschaft und Kultur und ist eine überregionale, wöchentlich im Johann Wilhelm Naumann Verlag in Würzburg erscheinende Zeitung.'
    oldest_article = 7
    max_articles_per_feed = 100
    auto_cleanup   = True
    use_embedded_content = False

    feeds          = [
        ('Tagespost', 'https://www.die-tagespost.de/storage/rss/rss/die-tagespost-komplett.xml'),
    ]

    extra_css = 'td.textb {font-size: medium;}'

[kovidgoyal]

https://github.com/kovidgoyal/calibr...e40b32005af9d4

[Leonatus]

Thank you both!

[Leonatus]

Still a tiny little Question, Born in attack of perfectionism:

Many news sources that appear in calibre's collection show their logo as sort of an icon. The "Tagespost" has such a logo, too (see attachment). How does one manage to make the logo appear instead of the default?

And is it possible to replace Calibre's default cover (which is a big feature of its own, there's no doubt) by the logo at downloading the news on Calibre's bibliotheque (and on the Reader)?

[kovidgoyal]

You want a cover, you set cover_url in the recipe. As for the logo, if you can come up with a small 32x32 or 64x64 logo, I will be happy to add it.

[Leonatus]

I'll do my very best!

[Leonatus]

Here it is: I hope that's o.k.

[kovidgoyal]

that will be illegible at small sizes, might be better to just use the blue logo between die and tagesspost as the icon.

[Leonatus]

That's good idea:

[Leonatus]

Originally Posted by kovidgoyal

You want a cover, you set cover_url in the recipe.

That works! Great! Only that the date is missing on the cover page; in Calibre's default cover it appears. Where is the trick, please?

[kovidgoyal]

If yo uuse cover_url whatever image it points to will be used as the cover, there wont be any metadata added to it, like with a generated cover.

[Leonatus]

Ah, thank you!