WSJ recipe -- subscription is not fully recognized

pmiles · 01-24-2012, 04:04 AM

I've been using The Wall Street Journal (WSJ) recipe (subscription version -- wsj.recipe) for a long time without a hitch. Since January 16th the recipe has been generating output files with a few full-length articles and a bunch of truncated ones with subscription warnings. My WSJ subscription is valid as I can read any articles online at wsj.com. I haven't done any changes to Calibre or the recipe recently. I tried to update the recipe, but there are no new versions available.

Attached are today's .mobi output and verbose log (too long to place here). I've removed my username and password from the log.

It seems to me that WSJ has changed how it treats simultaneous downloads. Calibre downloads 5 articles at once. Perhaps, that causes the problem. Otherwise, I cannot identify any other problems. I'd appreciate your help with this.

rdell · 10-12-2013, 02:09 PM

I am having this same issue, although it appears every 8th article ... one is fine, then 7 that are "screwy" with login prompts and such, then the 8th one is fine again.

Is this indeed an issue with multiple downloads, and if so, how might I throttle back to one downloaded article at a time ? I don't mind it taking longer.

kovidgoyal · 10-12-2013, 09:56 PM

Add

delay = 1

to the recipe to add a one second delay between every download request.

rdell · 10-15-2013, 01:10 AM

Thanks! I'll let you know if that works, and if not I'll have time to dig deeper next week.

rdell · 10-26-2013, 08:19 PM

That delay setting did not significantly change the behavior, BUT by the time I finished my travels and had time to dig deeper, it was working fine again!
I hate such ghost problems.

Thanks again for the help.

kovidgoyal · 10-26-2013, 10:23 PM

I updated the wsj recipe a few weeks back to deal with various website changes at wsj.com, that is probably why it is working again.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
recipe for newspaper subscription www.nd.nl	NicoDeMus!	Recipes	0	11-24-2011 05:02 PM
How to use recipe with subscription from command line	miwie	Calibre	3	11-23-2010 04:10 AM
Calibre WSJ subscription problem	moosejons_dad	Recipes	3	11-10-2010 02:10 PM
Where's the wsj recipe?	mdovell	Calibre	7	09-10-2010 08:29 AM
PRS-900 WSJ subscription through Sony vs WSJ direct	advocate2	Sony Reader	14	01-29-2010 11:52 AM

10-12-2013, 02:09 PM	#2
rdell Junior Member Posts: 6 Karma: 10 Join Date: Oct 2012 Device: Kindle DX, Nook HD+	I am having this same issue, although it appears every 8th article ... one is fine, then 7 that are "screwy" with login prompts and such, then the 8th one is fine again. Is this indeed an issue with multiple downloads, and if so, how might I throttle back to one downloaded article at a time ? I don't mind it taking longer.

10-12-2013, 09:56 PM	#3
kovidgoyal creator of calibre Posts: 43,843 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Add delay = 1 to the recipe to add a one second delay between every download request.

10-15-2013, 01:10 AM	#4
rdell Junior Member Posts: 6 Karma: 10 Join Date: Oct 2012 Device: Kindle DX, Nook HD+	Thanks! I'll let you know if that works, and if not I'll have time to dig deeper next week.

10-26-2013, 08:19 PM	#5
rdell Junior Member Posts: 6 Karma: 10 Join Date: Oct 2012 Device: Kindle DX, Nook HD+	That delay setting did not significantly change the behavior, BUT by the time I finished my travels and had time to dig deeper, it was working fine again! I hate such ghost problems. Thanks again for the help.

10-26-2013, 10:23 PM	#6
kovidgoyal creator of calibre Posts: 43,843 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	I updated the wsj recipe a few weeks back to deal with various website changes at wsj.com, that is probably why it is working again.

Advert

Advert