Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Recipes

Notices

Reply
 
Thread Tools Search this Thread
Old 08-09-2026, 11:27 AM   #1
jma1
Connoisseur
jma1 began at the beginning.
 
Posts: 92
Karma: 10
Join Date: Dec 2015
Device: Kindle
The Daily Mail Article Titles Missing

The article titles in the Daily Mail outputs are missing due to a change in the way they are presented on the web pages. The mobi output does continue to display byline (author, date, date updated) correctly. Could the article titles be restored?

Also, there are two in-line boxes that appear in many of the articles and if possible they should be removed for cleaner reading.

The first is a Join the discussion box as included in this example article. Picture shows it in the online article.

The second is a 'Read More' box typically including a title and picture as included in this article. Picture show it in the online article.

Thanks in advance.
Attached Thumbnails
Click image for larger version

Name:	The Daily Mail Join the discussion in-line box example.JPG
Views:	57
Size:	42.8 KB
ID:	225051   Click image for larger version

Name:	The Daily Mail Read More in-line box example.JPG
Views:	58
Size:	91.2 KB
ID:	225052  
jma1 is offline   Reply With Quote
Old 08-10-2026, 11:35 PM   #2
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 46,439
Karma: 29634066
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Sadly those read more boxes are not easily identifiable but the rest should be fixed: https://github.com/kovidgoyal/calibr...f985182c3650b4
kovidgoyal is offline   Reply With Quote
Old 08-11-2026, 10:07 AM   #3
jma1
Connoisseur
jma1 began at the beginning.
 
Posts: 92
Karma: 10
Join Date: Dec 2015
Device: Kindle
The output content looks great, however the job run time is more than 10 minutes and times out at 20 minutes if I run for 50 articles per feed. The prior recipe usually finished in less than one minute. Log file (for just 5 articles per feed) attached. Could you check that? Thanks in advance.
Attached Files
File Type: txt The Daily Mail Job Details.txt (181.0 KB, 40 views)
jma1 is offline   Reply With Quote
Old 08-11-2026, 10:23 AM   #4
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 46,439
Karma: 29634066
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
I doubt that has anything to do with the recipe changes which just change a few kept/removed tags. You can remove or reduce the delay from the recipe if you want to improve fetch times at the risk of the daily mail servers blocking you.
kovidgoyal is offline   Reply With Quote
Old 08-11-2026, 10:45 AM   #5
jma1
Connoisseur
jma1 began at the beginning.
 
Posts: 92
Karma: 10
Join Date: Dec 2015
Device: Kindle
Removing the delay line worked. If the source servers do block the feed, could you say how long a block typically remain in effect?
jma1 is offline   Reply With Quote
Old 08-11-2026, 10:46 AM   #6
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 46,439
Karma: 29634066
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Quote:
Originally Posted by jma1 View Post
Removing the delay line worked. If the source servers do block the feed, could you say how long a block typically remain in effect?
I have no idea.
kovidgoyal is offline   Reply With Quote
Old Today, 07:30 AM   #7
jma1
Connoisseur
jma1 began at the beginning.
 
Posts: 92
Karma: 10
Join Date: Dec 2015
Device: Kindle
OK - it runs well without the delay.

Now there are several additional feeds which I had incorporated into the prior recipe which continue to work in that recipe, but do not return articles in the new version. This is one -

(u'US News', u'http://www.dailymail.co.uk/ushome/index.rss')

and here is the job details message for that feed -

Spoiler:
Failed feed: US News
Traceback (most recent call last):
File "calibre\web\feeds\news.py", line 1826, in parse_feeds
File "calibre\scraper\qt.py", line 57, in read
File "calibre\scraper\qt.py", line 52, in _wait
urllib.error.URLError: <urlopen error Failed to fetch>


Fixable?
jma1 is offline   Reply With Quote
Reply


Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
The Australian recipie: Article titles missing jma1 Recipes 1 12-23-2020 12:10 AM
The Daily Mail (UK) recipie omits pictures jma1 Recipes 2 05-22-2017 12:05 AM
Daily Mail not emailing mandraek Recipes 14 04-01-2015 04:01 PM
The Daily Mail Newspaper Keios Recipes 2 11-07-2010 12:50 AM
An Article on the Sony Reader in the Daily Mail M0zza News 9 09-02-2008 01:12 PM


All times are GMT -4. The time now is 09:14 AM.


MobileRead.com is a privately owned, operated and funded community.