MobileRead Forums - View Single Post

kovidgoyal · 08-04-2022, 10:42 AM

If the same url is returning different results from the browser vs calibre, then it has to be some sort of bot detection causing the errors.

I tried this:

Code:

calibre-debug -c 'from calibre import browser; br = browser(); import sys; print(br.open(sys.argv[-1]).read().decode())' 'https://webcache.googleusercontent.com/search?q=cache:5bpEhP6UzRUJ:https://www.amazon.com.br/As-vinhas-...&ct=clnk&gl=br'

and it printed out the cached webpage for me.

08-04-2022, 10:42 AM	#9
kovidgoyal creator of calibre Posts: 45,418 Karma: 27757236 Join Date: Oct 2006 Location: Mumbai, India Device: Various	If the same url is returning different results from the browser vs calibre, then it has to be some sort of bot detection causing the errors. I tried this: Code: calibre-debug -c 'from calibre import browser; br = browser(); import sys; print(br.open(sys.argv[-1]).read().decode())' 'https://webcache.googleusercontent.com/search?q=cache:5bpEhP6UzRUJ:https://www.amazon.com.br/As-vinhas-...&ct=clnk&gl=br' and it printed out the cached webpage for me.