MobileRead Forums - View Single Post - The Economist recipe does not work anymore

fstulp · 10-09-2014, 05:18 AM

Same problem for me, from France. I don't think it is a redesign of the Economist. Rather, in France, one must "agree and proceed" to use cookies before actually entering the site. This confirmation is probably not necessary in the US, where laws are more lenient about requiring sites to ask users about cookies. So in the US it still works. That's my working hypothesis (could someone confirm that by going on the site in the US? remove the cookie first though). What surprises me though, is that it still works in the Netherlands (see post by "parizer"), where laws are just as strict as in France.

Anyhow, here's what I get in France if I remove the Economist cookie (in a separate frame overlayed on the Economist website): http://consent-pref.truste.com/?type...ste.com/notice

I know Python, so I gave it a shot. But I know nothing about Mechanize or automatically navigating the web with Python (and no time/desire to learn it), so I failed.

Basically, you need to automatically "click" the "agree and proceed" button, which is somehow generated by javascript on the link I included above (I guess... I really don't have a clue about website design/generation, sorry). I tried to do this by adding a javascript_login(...) function with some form and submit stuff in the Economist recipe, but I gave up. Maybe that isn't the right approach anyway.

I hope my aborted attempt provides a good starting point for people who know more about Mechanize and javascript.

10-09-2014, 05:18 AM	#23
fstulp Junior Member Posts: 4 Karma: 10 Join Date: Oct 2014 Device: kindle	Probably a problem with "agreeing to cookies" button Same problem for me, from France. I don't think it is a redesign of the Economist. Rather, in France, one must "agree and proceed" to use cookies before actually entering the site. This confirmation is probably not necessary in the US, where laws are more lenient about requiring sites to ask users about cookies. So in the US it still works. That's my working hypothesis (could someone confirm that by going on the site in the US? remove the cookie first though). What surprises me though, is that it still works in the Netherlands (see post by "parizer"), where laws are just as strict as in France. Anyhow, here's what I get in France if I remove the Economist cookie (in a separate frame overlayed on the Economist website): http://consent-pref.truste.com/?type...ste.com/notice I know Python, so I gave it a shot. But I know nothing about Mechanize or automatically navigating the web with Python (and no time/desire to learn it), so I failed. Basically, you need to automatically "click" the "agree and proceed" button, which is somehow generated by javascript on the link I included above (I guess... I really don't have a clue about website design/generation, sorry). I tried to do this by adding a javascript_login(...) function with some form and submit stuff in the Economist recipe, but I gave up. Maybe that isn't the right approach anyway. I hope my aborted attempt provides a good starting point for people who know more about Mechanize and javascript.