Economist - KeyError: 'content'

njpig · 06-10-2022, 03:01 AM

Anyone faced this error?

Code:

Failed to download article: Artificial intelligence: The world that Bert built from https://www.economist.com/interactive/briefing/2022/06/11/huge-foundation-models-are-turbo-charging-ai-progress
Traceback (most recent call last):
  File "calibre/web/fetch/simple.py", line 600, in process_links
    soup = self.get_soup(dsrc, url=iurl)
  File "calibre/web/fetch/simple.py", line 208, in get_soup
    usrc = self.preprocess_raw_html(usrc, url)
  File "calibre/web/feeds/news.py", line 629, in preprocess_raw_html_
    raw_html = self.preprocess_raw_html(raw_html, url)
  File "<string>", line 211, in preprocess_raw_html
  File "<string>", line 57, in load_article_from_json
KeyError: 'content'

jwhittin · 06-11-2022, 01:24 AM

Recently I've been getting a few articles which don't download and this week it's https://www.economist.com/interactiv...ng-ai-progress which I think is the article to which you refer.

Each time, when I've looked at the actual article online, it's not just a text page and has interactive aspects to it. Perhaps that's the problem.

John

kovidgoyal · 06-11-2022, 03:17 AM

https://github.com/kovidgoyal/calibr...9b21ae8250fa2a

njpig · 06-11-2022, 06:50 PM

It works. Thanks for keeping the debug code there, which makes me to understand how it works.

jwhittin · 06-13-2022, 08:13 PM

Thanks Kovid, words for me too. As you say, it doesn't look great, but much better than it was before (nothing

).

davidsmartin · 06-15-2022, 10:48 AM

Do I have to do something different to run this version? Both of the versions I see in the app only download the first two articles.

06-13-2022, 08:13 PM	#5
jwhittin Enthusiast Posts: 46 Karma: 10 Join Date: Dec 2010 Location: Melbourne, Australia Device: Kobo Clara Colour	Thanks Kovid, words for me too. As you say, it doesn't look great, but much better than it was before (nothing). Last edited by jwhittin; 06-13-2022 at 08:21 PM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
KeyError: 'user_categories' - please help	kaisersozee	Library Management	4	07-21-2021 09:47 PM
KeyError: u'format_group'	sws	Server	4	06-10-2020 03:57 AM
The Economist is downloading with no content	eastonfmly	Recipes	5	04-14-2017 05:44 AM
KeyError: u'MimeType'	Geremia	Calibre	3	02-03-2017 09:39 AM
KeyError: u'kind'	senhal	Calibre	2	06-19-2016 03:37 PM

06-11-2022, 01:24 AM	#2
jwhittin Enthusiast Posts: 46 Karma: 10 Join Date: Dec 2010 Location: Melbourne, Australia Device: Kobo Clara Colour	Recently I've been getting a few articles which don't download and this week it's https://www.economist.com/interactiv...ng-ai-progress which I think is the article to which you refer. Each time, when I've looked at the actual article online, it's not just a text page and has interactive aspects to it. Perhaps that's the problem. John

06-11-2022, 03:17 AM	#3
kovidgoyal creator of calibre Posts: 45,355 Karma: 27182818 Join Date: Oct 2006 Location: Mumbai, India Device: Various	https://github.com/kovidgoyal/calibr...9b21ae8250fa2a

06-11-2022, 06:50 PM	#4
njpig Zealot Posts: 106 Karma: 10 Join Date: Sep 2020 Device: kindle paperwhite3/Oasis2	It works. Thanks for keeping the debug code there, which makes me to understand how it works.

06-15-2022, 10:48 AM	#6
davidsmartin Enthusiast Posts: 26 Karma: 10 Join Date: May 2011 Device: kindle	Do I have to do something different to run this version? Both of the versions I see in the app only download the first two articles.

Advert

Advert