The Daily Mail Article Titles Missing

jma1 · 08-09-2026, 11:27 AM

The article titles in the Daily Mail outputs are missing due to a change in the way they are presented on the web pages. The mobi output does continue to display byline (author, date, date updated) correctly. Could the article titles be restored?

Also, there are two in-line boxes that appear in many of the articles and if possible they should be removed for cleaner reading.

The first is a Join the discussion box as included in this example article. Picture shows it in the online article.

The second is a 'Read More' box typically including a title and picture as included in this article. Picture show it in the online article.

Thanks in advance.

kovidgoyal · 08-10-2026, 11:35 PM

Sadly those read more boxes are not easily identifiable but the rest should be fixed: https://github.com/kovidgoyal/calibr...f985182c3650b4

jma1 · 08-11-2026, 10:07 AM

The output content looks great, however the job run time is more than 10 minutes and times out at 20 minutes if I run for 50 articles per feed. The prior recipe usually finished in less than one minute. Log file (for just 5 articles per feed) attached. Could you check that? Thanks in advance.

kovidgoyal · 08-11-2026, 10:23 AM

I doubt that has anything to do with the recipe changes which just change a few kept/removed tags. You can remove or reduce the delay from the recipe if you want to improve fetch times at the risk of the daily mail servers blocking you.

jma1 · 08-11-2026, 10:45 AM

Removing the delay line worked. If the source servers do block the feed, could you say how long a block typically remain in effect?

kovidgoyal · 08-11-2026, 10:46 AM

Quote:

Originally Posted by jma1

Removing the delay line worked. If the source servers do block the feed, could you say how long a block typically remain in effect?

I have no idea.

jma1 · Today, 07:30 AM

OK - it runs well without the delay.

Now there are several additional feeds which I had incorporated into the prior recipe which continue to work in that recipe, but do not return articles in the new version. This is one -

(u'US News', u'http://www.dailymail.co.uk/ushome/index.rss')

and here is the job details message for that feed -

Spoiler:

Fixable?

08-09-2026, 11:27 AM	#1
jma1 Connoisseur Posts: 92 Karma: 10 Join Date: Dec 2015 Device: Kindle	The Daily Mail Article Titles Missing The article titles in the Daily Mail outputs are missing due to a change in the way they are presented on the web pages. The mobi output does continue to display byline (author, date, date updated) correctly. Could the article titles be restored? Also, there are two in-line boxes that appear in many of the articles and if possible they should be removed for cleaner reading. The first is a Join the discussion box as included in this example article. Picture shows it in the online article. The second is a 'Read More' box typically including a title and picture as included in this article. Picture show it in the online article. Thanks in advance. Attached Thumbnails

Today, 07:30 AM	#7
jma1 Connoisseur Posts: 92 Karma: 10 Join Date: Dec 2015 Device: Kindle	OK - it runs well without the delay. Now there are several additional feeds which I had incorporated into the prior recipe which continue to work in that recipe, but do not return articles in the new version. This is one - (u'US News', u'http://www.dailymail.co.uk/ushome/index.rss') and here is the job details message for that feed - Spoiler: Failed feed: US News Traceback (most recent call last): File "calibre\web\feeds\news.py", line 1826, in parse_feeds File "calibre\scraper\qt.py", line 57, in read File "calibre\scraper\qt.py", line 52, in _wait urllib.error.URLError: <urlopen error Failed to fetch> Fixable?

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
The Australian recipie: Article titles missing	jma1	Recipes	1	12-23-2020 12:10 AM
The Daily Mail (UK) recipie omits pictures	jma1	Recipes	2	05-22-2017 12:05 AM
Daily Mail not emailing	mandraek	Recipes	14	04-01-2015 04:01 PM
The Daily Mail Newspaper	Keios	Recipes	2	11-07-2010 12:50 AM
An Article on the Sony Reader in the Daily Mail	M0zza	News	9	09-02-2008 01:12 PM

08-10-2026, 11:35 PM	#2
kovidgoyal creator of calibre Posts: 46,439 Karma: 29634066 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Sadly those read more boxes are not easily identifiable but the rest should be fixed: https://github.com/kovidgoyal/calibr...f985182c3650b4

08-11-2026, 10:23 AM	#4
kovidgoyal creator of calibre Posts: 46,439 Karma: 29634066 Join Date: Oct 2006 Location: Mumbai, India Device: Various	I doubt that has anything to do with the recipe changes which just change a few kept/removed tags. You can remove or reduce the delay from the recipe if you want to improve fetch times at the risk of the daily mail servers blocking you.

08-11-2026, 10:45 AM	#5
jma1 Connoisseur Posts: 92 Karma: 10 Join Date: Dec 2015 Device: Kindle	Removing the delay line worked. If the source servers do block the feed, could you say how long a block typically remain in effect?