Difficulties in connection with getting "Access Denied"

itssudipok · 09-17-2024, 02:46 PM

I am trying to scrape the data from an esteemed bengali newspaper, wherein the said data content is available in public domain. When I try with the browser, everything works perfect without an issue, but when I try through webscraping, I get 403 error.However, I got a solution by using headers and cookies in my script along with the url. The BeautifulSoup helps accessing the data, but all I need to do is to find a way to feed the cookies and headers through a recipe in calibre. Is there any way to do that?Any help would be greatly appreciated. Thank you.

kovidgoyal · 09-17-2024, 11:26 PM

Look at the documentation of the get_browser() method in the recipe class, it shows you how to add cookies to the browser used by calibre.

09-17-2024, 02:46 PM	#1
itssudipok Junior Member Posts: 7 Karma: 10 Join Date: Jul 2021 Location: West Bengal Device: Kindle Paper White 11th Gen	Difficulties in connection with getting "Access Denied" I am trying to scrape the data from an esteemed bengali newspaper, wherein the said data content is available in public domain. When I try with the browser, everything works perfect without an issue, but when I try through webscraping, I get 403 error.However, I got a solution by using headers and cookies in my script along with the url. The BeautifulSoup helps accessing the data, but all I need to do is to find a way to feed the cookies and headers through a recipe in calibre. Is there any way to do that?Any help would be greatly appreciated. Thank you.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
General Connection Error on any wireless device connection"Send to device" (Android)	Cris B	Calibre Companion	0	03-21-2020 10:20 PM
"Permission Denied" when Creating a Backup in Moon+ Reader	Suige	Android Devices	2	11-28-2015 02:28 PM
Bug "IOError: [Errno 13] Permission denied" when editing meta-data	ShellShock	Calibre	5	09-23-2013 12:34 AM
"Access denied" to downloaded news - Windows Error message 5	SunFuLai	Recipes	14	12-02-2011 03:20 AM
Troubleshooting "Access denied" when connected to computer. Virus.	Dr. Drib	Amazon Kindle	16	08-23-2010 06:54 PM

09-17-2024, 11:26 PM	#2
kovidgoyal creator of calibre Posts: 45,615 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Look at the documentation of the get_browser() method in the recipe class, it shows you how to add cookies to the browser used by calibre.

Advert