every article is downloaded from an rss link instead of only today's!

[unkn0wn]

This is live-mint recipe from calibre

Every article present in the rss links of this recipe gets downloaded instead of ignoring previous dates, even though the oldest article is set to 1 day.

this is from https://www.livemint.com/rss/opinion

even though the <pubDate>Thu, 28 Oct 2021 22:18:15+5:30 </pubDate> is old it gets downloaded as today's. Images also don't get downloaded even though image link is given.

<item>
<title>
Coal's deadly grip over development is coming to an end
</title>
<link>
https://www.livemint.com/opinion/columns/people-may-now-be-ready-for-a-renewable-revolution-11635439494131.html
</link>
<description>
Incomes in large swathes of UP depend on power supply disrupted by coal shortages while coal-fired electricity generation loses economic viability in our clean-energy shift.
</description>
<pubDate>Thu, 28 Oct 2021 22:18:15+5:30 </pubDate>
<guid>11635439494131</guid>
<media:content height="900" medium="image" url="https://images.livemint.com/img/2021/10/28/1600x900/08526396-22d7-11ec-9efd-3aa1f7245a3d_1633178819103_1635439609948.jpg" width="1600"/>
</item>

this is recipe with links updated

#update links from https://www.livemint.com/static/rss

from calibre.web.feeds.news import BasicNewsRecipe


class LiveMint(BasicNewsRecipe):
    title = u'Live Mint'
    language = 'en_IN'
    __author__ = 'Krittika Goyal'
    oldest_article = 1  # days
    max_articles_per_feed = 50
    use_embedded_content = False

    no_stylesheets = True
    auto_cleanup = True

    feeds = [
        ('Companies',
         'http://www.livemint.com/rss/companies'),
         ('Opinion',
         'http://www.livemint.com/rss/opinion'),
          ('Money',
         'http://www.livemint.com/rss/money'),
         ('Politics',
         'http://www.livemint.com/rss/politics'),
         ('Science',
         'http://www.livemint.com/rss/science'),
         ('Industry',
         'http://www.livemint.com/rss/industry'),
         ('Lounge',
         'http://www.livemint.com/rss/lounge'),
         ('Education',
         'http://www.livemint.com/rss/education'),
         ('Sports',
         'http://www.livemint.com/rss/sports'),
         ('Technology',
         'http://www.livemint.com/rss/technology'),
        ('News',
         'http://www.livemint.com/rss/news'),
        ('Mutual Funds',
         'http://www.livemint.com/rss/Mutual Funds'),
         ('Markets',
         'http://www.livemint.com/rss/markets'),
         ('AI',
         'http://www.livemint.com/rss/AI'),
         ('Insurance',
         'http://www.livemint.com/rss/insurance'),
         ('Budget',
         'http://www.livemint.com/rss/butget'),
         ('Elections',
         'http://www.livemint.com/rss/elections'),    
    ]


calibre_most_common_ua = 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36'

[kovidgoyal]

That's because the published date is in an invalid format.

[unkn0wn]

Originally Posted by kovidgoyal

That's because the published date is in an invalid format.

Is there a way to make it work? We can't tell the website people to change formats.

I don't know anymore than changing links and stuff.. It'll take time for me to learn but someday i will.

[kovidgoyal]

https://github.com/kovidgoyal/calibr...aa917274999cfa

[unkn0wn]

Does this mean it'll work after the next update and not in the present version?

[kovidgoyal]

yes these are changes to calibre not the recipe.