Spiegel Online - German: download empty!

[ganesh]

Hi,
I am new to this forum but have used the Calibre software to download the 'Spiegel Online - German' for some weeks now. But, since some days the output is nearly empty (3 cover pages only).
I already looked at the Recipe: the URL has not changed.
I also looked at the log and found these errors:

...
Downloading
Fetching http://www.spiegel.de#ai=932738&aitype=rss&ref=rss
Could not fetch link http://www.spiegel.de#ai=932738&aitype=rss&ref=rss
Traceback (most recent call last):
File "site-packages\calibre\web\fetch\simple.py", line 518, in process_links
File "site-packages\calibre\web\fetch\simple.py", line 260, in fetch_url
URLError: <urlopen error [Errno 11004] getaddrinfo failed>

http://www.spiegel.de#ai=932738&aitype=rss&ref=rss saved to
Failed to download article: Gauck zur Pogromnacht: "Verhindern, dass Hass und Rassenwahn die Gehirne vernebeln" from http://www.spiegel.de#ai=932738&aitype=rss&ref=rss
Traceback (most recent call last):
File "site-packages\calibre\utils\threadpool.py", line 95, in run
File "site-packages\calibre\web\feeds\news.py", line 1106, in fetch_article
File "site-packages\calibre\web\feeds\news.py", line 1101, in _fetch_article
Exception: Konnte Artikel nicht abrufen. Die Fehlerdiagnose-Rückverfolgung befindet sich weiter oben in diesem Protokoll
...

What's going on?

Thanks.

[kiklop74]

The Spiegel's RSS feeds are screwed. They do not point to the actual articles. Instead you are redirected to the frontpage of the site. You should write to them and suggest they fix their feeds.

[kovidgoyal]

This was actually a fun little challenge. Spiegel has changed its rss feeds to redirect to the homepage with a prominent link to the article at the top. I have fixed the recipe to handle this.

[ganesh]

Thanks, kovidgoyal.
Will the fix be part of the next release or how can I get it?

[kovidgoyal]

Just run it again.

[schwaede]

Hello,

Unfortunately, "Spiegel Online - German" seems not to work still for me. I updated to the newest version of Calibre today. See [1] for the error message. By the way, where does calibre take its recipes? I do not find them in /opt/calibre/resources/.

Any help would be appreciated.

Best,

Benedikt


[1] ---------------------------

ebook-convert "Spiegel Online - German.recipe" spiegelonline.mobi --output-profile kindle1% Converting input to HTML...
InputFormatPlugin: Recipe Input running
Trying to get latest version of recipe: spiegelde
Using downloaded builtin recipe
1% Fetching feeds...
1% Fetching feed Spiegel Online...
Failed to get link for Fotostrecke: Von der Schanze auf die Trage
Failed to get link for Rassismus-Vorwurf gegen "Wetten, dass..?": "Haben die niemanden mit einer Spur Fingerspitzengefühl?"
Failed to get link for Skispringen: Olympiasieger Morgenstern schwer gestürzt
Failed to get link for Engpass: Impfstoff gegen Gelbfieber geht aus
Failed to get link for Unionspersonal: Peter Tauber wird neuer CDU-Generalsekretär
Failed to get link for Diebstahlschutz auf Bahnreisen: Angst im Gepäck
Failed to get link for Drohnen-Service: Invasion der Lego-Insekten
Failed to get link for Ultra-Gruppe "Green Brigade": Celtic räumt Block 111
Failed to get link for Deutsche Bahn: Ab heute sind Zugfahrten teurer
Failed to get link for 2. Fußball-Bundesliga: Sechs Treffer in Karlsruhe, Pleite für Fürth
Failed to get link for Neues Kabinett: Zwölf Aufsteiger, vier Umsteiger, drei Absteiger
Failed to get link for Phnom Penh: Tausende protestieren gegen Kambodschas Regierung
Failed to get link for Ex-Arcandor-Chef: Sal. Oppenheim verklagt Middelhoff auf 78 Millionen Euro
Failed to get link for Janukowitsch-Vertrauter: "Putin will die Sowjetunion neu errichten"
Failed to get link for Syrien-Konflikt: Mehr als 20 Tote bei Luftangriffen in Aleppo
Failed to get link for Ski alpin: Höfl-Riesch in St. Moritz nur auf Rang elf
Failed to get link for Kabinettsliste: Das sind Merkels wichtigste Minister
Failed to get link for Surfen: Fanning krönt sich vor Hawaii zum Weltmeister
Failed to get link for SPD-Personalien: Gabriel verteilt weitere Posten
Failed to get link for Neuer Internetminister: Ausgerechnet Dobrindt
Failed to get link for Volkszählung: Statistiker verheimlichten schlechte Datenqualität
Failed to get link for Jemen: Japanischer Konsul mit Messerstichen verletzt
Failed to get link for Flughafenprivatisierung: Griechen streiten über chinesische Investoren
Failed to get link for Heikler Deal: AfD bekam günstigen Millionenkredit von Hamburger Reeder
Failed to get link for Hamburger Reeperbahn: Polizei evakuiert Esso-Häuser wegen Einsturzgefahr
Failed to get link for Wintersport: Biathlet Lesser feiert zweiten Platz in der Verfolgung
Failed to get link for Proteste gegen Janukowitsch: Brüssel stoppt Arbeit an Abkommen mit Ukraine
Failed to get link for Große Koalition: Der verfrühte Jubel
Failed to get link for Russland: Polizei nimmt Olympia-Kritiker fest
Failed to get link for Remis gegen Hannover: Nürnberg fühlt sich betrogen
1% Trying to download cover...
1% Generating masthead...
Synthesizing mastheadImage
1% Starting download [5 thread(s)]...
34% Feeds downloaded to /tmp/calibre_1.15.0_tmp_QFfBuQ/1JXrk3_plumber/index.html
34% Download finished
Parsing all content...
Forcing index.html into XHTML namespace
34% Running transforms on ebook...
Merging user specified metadata...
Detecting structure...
Flattening CSS and remapping font sizes...
Source base font size is 12.00000pt
Removing fake margins...
Cleaning up manifest...
Trimming unused files from manifest...
Creating MOBI Output...
67% Running MOBI Output plugin
Serializing resources...
Creating MOBI 6 output
Applying case-transforming CSS...
Rasterizing SVG images...
Converting XHTML to Mobipocket markup...
Serializing markup content...
Compressing markup content...
No TOC, MOBI index not generated

[kovidgoyal]

Fixed, again. I wish they'd make up their minds on their website design. Surely they have better things to do than play with their website.

[schwaede]

Thanks, it works!