Guardian/Observer recipe not working 1/4/22

paddyrm · 04-01-2022, 05:40 PM

Hi Kovid, the Guardian/Observer recipe has stopped working today, perhaps they have made changes. The script was running for 13 hours before I realised! Have just run it anew and it sticks at

Processing images...
Fetching https://sb.scorecardresearch.com/p?c...s%2CArms+trade
Fetched https://sb.scorecardresearch.com/p?c...+news%2CUnesco in 0.250000 seconds
Fetched https://sb.scorecardresearch.com/p?c...a%2CWorld+news in 0.266000 seconds

Cheers

Paddy in Wales

kovidgoyal · 04-01-2022, 07:57 PM

Works for me

paddyrm · 04-02-2022, 05:21 AM

Quote:

Originally Posted by kovidgoyal

Works for me

But not for me again this morning, sadly! Stuck for an hour at the same point. Will download the latest update (am currently on 5.38) and see if that clears the blockage! Will let you know.

Paddy

paddyrm · 04-02-2022, 05:35 AM

Works perfectly! Memo to self; if in doubt, update...

Thanks once more Kovid

Paddy

paddyrm · 04-06-2022, 06:38 AM

However, I now find that the restarting of the PC following the update solves the problem for that day, but the download stopping at one minute happens next day, can only be resolved by restarting the PC! Surely not a recipe problem, something in the settings? Been no problem before.

kovidgoyal · 04-06-2022, 07:14 AM

This will most likely be your antivirus/firewall or similar security software sticking its nose in.

paddyrm · 04-08-2022, 05:49 AM

Thanks Kovid, will investigate in that direction! -- Paddy

paddyrm · 04-14-2022, 07:29 AM

Well it seems that my problem is with scheduled downloads: if I choose "download now" it performs perfectly, but scheduled downloads stick at 1%, with either the Calibre recipe or my edited version (no Sports).
I will try it with another publication to see if the same issue happens, and give outcome here.

pharben · 04-24-2022, 07:27 AM

Had a similar problem, although it may not be related, but my download worked after changing the base URL for The Observer from

https://www.theguardian.com/theobserver

to

https://www.theguardian.com/observer

paddyrm · 04-24-2022, 05:59 PM

I find that it doesn't work most mornings, but if I try the same recipe again some time later it completes the download. Here are some relevant snippets from the job details. It always seems to fail on a scorecardresearch line and will hang all day if I leave it. Pharben, thanks for the tip, will amend now and try tomorrow!

cut here========================
21/4/22
First attempt
Fetched https://sb.scorecardresearch.com/p?c...e%2CWorld+news in 0.094000 seconds
stopped there, at 1%

Second attempt one minute later
Fetching https://i.guim.co.uk/img/media/8fbf5...fit=max&dpr=2&
Fetched https://sb.scorecardresearch.com/p?c...e%2CWorld+news in 0.109000 seconds
Fetching https://i.guim.co.uk/img/media/59e14...fit=max&dpr=2&
carried on to 100%

23/4/22
First attempt
Processing images...
Fetching https://sb.scorecardresearch.com/p?c...ymyr+Zelenskiy
Fetched https://sb.scorecardresearch.com/p?c...+news%2CEurope in 0.328000 seconds
Fetched https://sb.scorecardresearch.com/p?c...ymyr+Zelenskiy in 0.312000 seconds
stopped there, at 1%

Second attempt 30 minutes later
Processing images...
Fetching https://sb.scorecardresearch.com/p?c...ymyr+Zelenskiy
Fetched https://sb.scorecardresearch.com/p?c...ymyr+Zelenskiy in 0.297000 seconds
Fetching https://i.guim.co.uk/img/media/f4ae7...fit=max&dpr=2&
carried on to completion

24/2/2022
First attempt
Processing images...
Fetching https://sb.scorecardresearch.com/p?c...%2CCoronavirus
Fetched https://sb.scorecardresearch.com/p?c...ion%2CRefugees in 0.375000 seconds
Fetched https://sb.scorecardresearch.com/p?c...2CVoter+apathy in 0.234000 seconds
Stops at 1%

Second attempt ten minutes later
https://sb.scorecardresearch.com/p?c...2CVoter+apathy in 0.234000 seconds
Fetched https://sb.scorecardresearch.com/p?c...ves%2CPolitics in 0.266000 seconds
Fetching https://i.guim.co.uk/img/media/3d0cf...fit=max&dpr=2&
continues to completion

paddyrm · 04-25-2022, 02:24 PM

Quote:

Originally Posted by pharben

Had a similar problem, although it may not be related, but my download worked after changing the base URL for The Observer from

https://www.theguardian.com/theobserver

to

https://www.theguardian.com/observer

Worked for me this morning, thanks for the suggestion!

paddyrm · 04-29-2022, 03:26 AM

Sadly, having worked for days in a row with no "the" in the URL, it broke this morning in the usual way, at 1%, on this line:

Fetched https://sb.scorecardresearch.com/p?c...s%2CWorld+news in 0.406000 seconds

paddyrm · 05-03-2022, 07:24 AM

Still not working as it should every time: worked on 3rd attempt today, so cannot be automated

paddyrm · 08-02-2022, 05:57 AM

Kovid, recipe still not working, three out of four times. I scheduled the original recipe plus four copies with different names to run this morning, and only one worked, three stopped at 1% and the last to run failed to start. Here are the last few lines of each of the 1%ers showing that each fails at https://sb.scorecardresearch.com:

GO-3-EPUB
Processing images...
Fetching https://sb.scorecardresearch.com/p?c...%2CCommodities
Fetching https://sb.scorecardresearch.com/p?c...d+central+Asia
Fetched https://sb.scorecardresearch.com/p?c...news%2CUK+news in 0.313000 seconds
Fetched https://sb.scorecardresearch.com/p?c...athrow+airport in 0.313000 seconds

GO-2-EPUB
Processing images...
Fetching https://sb.scorecardresearch.com/p?c...%2CCommodities
Fetched https://sb.scorecardresearch.com/p?c...d+central+Asia in 0.296000 seconds
Fetched https://sb.scorecardresearch.com/p?c...%2CCommodities in 0.125000 seconds

The Guardian and The Observer (original recipe)
Processing images...
Fetching https://sb.scorecardresearch.com/p?c...%2CCommodities
Fetching https://sb.scorecardresearch.com/p?c...athrow+airport
Fetched https://sb.scorecardresearch.com/p?c...sama+bin+Laden in 0.297000 seconds
Fetched https://sb.scorecardresearch.com/p?c...d+central+Asia in 0.391000 seconds

kovidgoyal · 08-02-2022, 09:37 AM

Well i modified the recipe to not download any images that has scorecardresearch in their urls, but I doubt that will make a difference.

04-01-2022, 05:40 PM	#1
paddyrm Connoisseur Posts: 67 Karma: 10 Join Date: Oct 2012 Device: Kindle 3	Guardian/Observer recipe not working 1/4/22 Hi Kovid, the Guardian/Observer recipe has stopped working today, perhaps they have made changes. The script was running for 13 hours before I realised! Have just run it anew and it sticks at Processing images... Fetching https://sb.scorecardresearch.com/p?c...s%2CArms+trade Fetched https://sb.scorecardresearch.com/p?c...+news%2CUnesco in 0.250000 seconds Fetched https://sb.scorecardresearch.com/p?c...a%2CWorld+news in 0.266000 seconds Cheers Paddy in Wales

04-01-2022, 07:57 PM	#2
kovidgoyal creator of calibre Posts: 43,866 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Works for me Attached Thumbnails

04-29-2022, 03:26 AM	#12
paddyrm Connoisseur Posts: 67 Karma: 10 Join Date: Oct 2012 Device: Kindle 3	Sadly, having worked for days in a row with no "the" in the URL, it broke this morning in the usual way, at 1%, on this line: Fetched https://sb.scorecardresearch.com/p?c...s%2CWorld+news in 0.406000 seconds Last edited by paddyrm; 04-29-2022 at 03:28 AM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Guardian/Observer recipe broken	paddyrm	Recipes	5	08-04-2021 05:43 AM
Problem with The Guardian & The Observer recipe?	dinwood	Recipes	7	12-06-2014 12:07 PM
The Guardian / Observer (UK)	ribena	Recipes	3	11-19-2014 10:38 AM
The Guardian/The observer broken recipe ?	wingmongyee	Recipes	6	07-08-2011 10:38 PM
Guardian Recipe has stopped working	jbambridge	Calibre	2	04-11-2010 01:14 PM

04-02-2022, 05:35 AM	#4
paddyrm Connoisseur Posts: 67 Karma: 10 Join Date: Oct 2012 Device: Kindle 3	Works perfectly! Memo to self; if in doubt, update... Thanks once more Kovid Paddy

04-06-2022, 06:38 AM	#5
paddyrm Connoisseur Posts: 67 Karma: 10 Join Date: Oct 2012 Device: Kindle 3	However, I now find that the restarting of the PC following the update solves the problem for that day, but the download stopping at one minute happens next day, can only be resolved by restarting the PC! Surely not a recipe problem, something in the settings? Been no problem before.

04-06-2022, 07:14 AM	#6
kovidgoyal creator of calibre Posts: 43,866 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	This will most likely be your antivirus/firewall or similar security software sticking its nose in.

04-08-2022, 05:49 AM	#7
paddyrm Connoisseur Posts: 67 Karma: 10 Join Date: Oct 2012 Device: Kindle 3	Thanks Kovid, will investigate in that direction! -- Paddy

04-14-2022, 07:29 AM	#8
paddyrm Connoisseur Posts: 67 Karma: 10 Join Date: Oct 2012 Device: Kindle 3	Well it seems that my problem is with scheduled downloads: if I choose "download now" it performs perfectly, but scheduled downloads stick at 1%, with either the Calibre recipe or my edited version (no Sports). I will try it with another publication to see if the same issue happens, and give outcome here.

04-24-2022, 07:27 AM	#9
pharben Junior Member Posts: 1 Karma: 10 Join Date: Apr 2022 Device: Kobo Libra 2	Had a similar problem, although it may not be related, but my download worked after changing the base URL for The Observer from https://www.theguardian.com/theobserver to https://www.theguardian.com/observer

04-24-2022, 05:59 PM	#10
paddyrm Connoisseur Posts: 67 Karma: 10 Join Date: Oct 2012 Device: Kindle 3	I find that it doesn't work most mornings, but if I try the same recipe again some time later it completes the download. Here are some relevant snippets from the job details. It always seems to fail on a scorecardresearch line and will hang all day if I leave it. Pharben, thanks for the tip, will amend now and try tomorrow! cut here======================== 21/4/22 First attempt Fetched https://sb.scorecardresearch.com/p?c...e%2CWorld+news in 0.094000 seconds stopped there, at 1% Second attempt one minute later Fetching https://i.guim.co.uk/img/media/8fbf5...fit=max&dpr=2& Fetched https://sb.scorecardresearch.com/p?c...e%2CWorld+news in 0.109000 seconds Fetching https://i.guim.co.uk/img/media/59e14...fit=max&dpr=2& carried on to 100% 23/4/22 First attempt Processing images... Fetching https://sb.scorecardresearch.com/p?c...ymyr+Zelenskiy Fetched https://sb.scorecardresearch.com/p?c...+news%2CEurope in 0.328000 seconds Fetched https://sb.scorecardresearch.com/p?c...ymyr+Zelenskiy in 0.312000 seconds stopped there, at 1% Second attempt 30 minutes later Processing images... Fetching https://sb.scorecardresearch.com/p?c...ymyr+Zelenskiy Fetched https://sb.scorecardresearch.com/p?c...ymyr+Zelenskiy in 0.297000 seconds Fetching https://i.guim.co.uk/img/media/f4ae7...fit=max&dpr=2& carried on to completion 24/2/2022 First attempt Processing images... Fetching https://sb.scorecardresearch.com/p?c...%2CCoronavirus Fetched https://sb.scorecardresearch.com/p?c...ion%2CRefugees in 0.375000 seconds Fetched https://sb.scorecardresearch.com/p?c...2CVoter+apathy in 0.234000 seconds Stops at 1% Second attempt ten minutes later https://sb.scorecardresearch.com/p?c...2CVoter+apathy in 0.234000 seconds Fetched https://sb.scorecardresearch.com/p?c...ves%2CPolitics in 0.266000 seconds Fetching https://i.guim.co.uk/img/media/3d0cf...fit=max&dpr=2& continues to completion

05-03-2022, 07:24 AM	#13
paddyrm Connoisseur Posts: 67 Karma: 10 Join Date: Oct 2012 Device: Kindle 3	Still not working as it should every time: worked on 3rd attempt today, so cannot be automated

08-02-2022, 05:57 AM	#14
paddyrm Connoisseur Posts: 67 Karma: 10 Join Date: Oct 2012 Device: Kindle 3	Kovid, recipe still not working, three out of four times. I scheduled the original recipe plus four copies with different names to run this morning, and only one worked, three stopped at 1% and the last to run failed to start. Here are the last few lines of each of the 1%ers showing that each fails at https://sb.scorecardresearch.com: GO-3-EPUB Processing images... Fetching https://sb.scorecardresearch.com/p?c...%2CCommodities Fetching https://sb.scorecardresearch.com/p?c...d+central+Asia Fetched https://sb.scorecardresearch.com/p?c...news%2CUK+news in 0.313000 seconds Fetched https://sb.scorecardresearch.com/p?c...athrow+airport in 0.313000 seconds GO-2-EPUB Processing images... Fetching https://sb.scorecardresearch.com/p?c...%2CCommodities Fetched https://sb.scorecardresearch.com/p?c...d+central+Asia in 0.296000 seconds Fetched https://sb.scorecardresearch.com/p?c...%2CCommodities in 0.125000 seconds The Guardian and The Observer (original recipe) Processing images... Fetching https://sb.scorecardresearch.com/p?c...%2CCommodities Fetching https://sb.scorecardresearch.com/p?c...athrow+airport Fetched https://sb.scorecardresearch.com/p?c...sama+bin+Laden in 0.297000 seconds Fetched https://sb.scorecardresearch.com/p?c...d+central+Asia in 0.391000 seconds

08-02-2022, 09:37 AM	#15
kovidgoyal creator of calibre Posts: 43,866 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Well i modified the recipe to not download any images that has scorecardresearch in their urls, but I doubt that will make a difference.

Advert

Advert