WSJ changed print edition url

magneticsubset · 01-20-2021, 05:50 PM

Hey guys I'm working with the wall street journal prebuilt recipe and the url format for the print edition changed by adding in today's date for the print edition. Previously it was

WSJ_ITP = 'https://www.wsj.com/print-edition/today'

They have changed it from "/today" to the days date "yearmonthday" (20210120) so the new url is https://www.wsj.com/print-edition/20210120

If I manually customize the recipe I can get the print edition to download correctly but that requires me to update the script every night manually with the next day's date to run in the morning. How can I automate this for the script to automatically put in today's date?

kovidgoyal · 01-20-2021, 06:47 PM

https://www.wsj.com/print-edition/today

works fine it auto redirects to the correct page.

magneticsubset · 01-20-2021, 07:44 PM

That's weird it downloaded a bunch of random articles today and not the print edition. Had articles from December in there. Maybe the redirect wasn't working this morning?

01-20-2021, 05:50 PM	#1
magneticsubset Junior Member Posts: 7 Karma: 10 Join Date: Jan 2021 Device: Kindle Paperwhite	WSJ changed print edition url Hey guys I'm working with the wall street journal prebuilt recipe and the url format for the print edition changed by adding in today's date for the print edition. Previously it was WSJ_ITP = 'https://www.wsj.com/print-edition/today' They have changed it from "/today" to the days date "yearmonthday" (20210120) so the new url is https://www.wsj.com/print-edition/20210120 If I manually customize the recipe I can get the print edition to download correctly but that requires me to update the script every night manually with the next day's date to run in the morning. How can I automate this for the script to automatically put in today's date?

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Print friendly url unrelated to regular url (and javascript)	sleepless	Recipes	3	12-03-2011 10:43 AM
Ho to get the print url(Little complex)	sexymax15	Recipes	2	06-19-2011 12:11 AM
get print-url and somtimes non-print-url	schuster	Recipes	4	05-28-2011 03:01 AM
Need Help Splitting a Print URL ... easy stuff. HELP!	mjcassel	Recipes	2	11-25-2010 09:30 AM
Proper code for fetching Print Version from WSJ and NYT?	brad382	Calibre	1	12-20-2008 01:06 PM

01-20-2021, 06:47 PM	#2
kovidgoyal creator of calibre Posts: 43,850 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	https://www.wsj.com/print-edition/today works fine it auto redirects to the correct page.

01-20-2021, 07:44 PM	#3
magneticsubset Junior Member Posts: 7 Karma: 10 Join Date: Jan 2021 Device: Kindle Paperwhite	That's weird it downloaded a bunch of random articles today and not the print edition. Had articles from December in there. Maybe the redirect wasn't working this morning?

Advert