Get Books Some Stores not Working

sitrucz · 01-05-2025, 01:48 PM

I was looking to get into some python development and I noticed some stores aren't working on my system. Barnes and Noble (not that I'd buy from there), Kobo, and Pragmatic Programmer. I found the source for Pragmatic Programmer and changed the initial url but that didn't do anything. I did a search through the log and I see no entries for prag or prog or anything related to it. Can someone point me in the right direction to begin working on getting this fixed?

kovidgoyal · 01-05-2025, 09:32 PM

You would need to fix the store plugin for it which is in pragmatic_bookshelf_plugin.py

Set up a calibre dev env as described in the manual: https://manual.calibre-ebook.com/develop.html

sitrucz · 01-06-2025, 04:45 PM

I scraped an example search page off of pragprog but the data isn’t the same as me pasting the url in my own web browser. I suspect there is some back end code updating the results after the fact (JavaScript or something else). Has anyone dealt with something like that before? TIA

Sent from my iPad using Tapatalk

kovidgoyal · 01-06-2025, 09:36 PM

You typically use devtools in the browser to see what HTTP requests the JS is making and clone those in the scraper.

01-05-2025, 01:48 PM	#1
sitrucz Connoisseur Posts: 67 Karma: 40919 Join Date: Sep 2012 Device: Kindle Paperwhite 3, Apple iPad Air 3, Apple iPhone 16 Pro, iMac M3	Get Books Some Stores not Working I was looking to get into some python development and I noticed some stores aren't working on my system. Barnes and Noble (not that I'd buy from there), Kobo, and Pragmatic Programmer. I found the source for Pragmatic Programmer and changed the initial url but that didn't do anything. I did a search through the log and I see no entries for prag or prog or anything related to it. Can someone point me in the right direction to begin working on getting this fixed?

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Which stores do you use for English books?	GERGE	General Discussions	40	01-11-2015 12:28 PM
Kobo to open 100 stores within WHS stores in UK	lecoeur	Kobo Reader	5	04-20-2012 04:13 AM
Kobo Vox wifi not working in stores	wmacphail@gmail.	Kobo Tablets	7	11-18-2011 11:08 AM
Danish book stores to sell ebooks in physical stores	Ea	News	12	04-20-2011 10:44 AM
See MR Author books in the stores	jhempel24	General Discussions	0	02-28-2011 10:36 AM

01-05-2025, 09:32 PM	#2
kovidgoyal creator of calibre Posts: 45,364 Karma: 27230406 Join Date: Oct 2006 Location: Mumbai, India Device: Various	You would need to fix the store plugin for it which is in pragmatic_bookshelf_plugin.py Set up a calibre dev env as described in the manual: https://manual.calibre-ebook.com/develop.html

01-06-2025, 04:45 PM	#3
sitrucz Connoisseur Posts: 67 Karma: 40919 Join Date: Sep 2012 Device: Kindle Paperwhite 3, Apple iPad Air 3, Apple iPhone 16 Pro, iMac M3	I scraped an example search page off of pragprog but the data isn’t the same as me pasting the url in my own web browser. I suspect there is some back end code updating the results after the fact (JavaScript or something else). Has anyone dealt with something like that before? TIA Sent from my iPad using Tapatalk

01-06-2025, 09:36 PM	#4
kovidgoyal creator of calibre Posts: 45,364 Karma: 27230406 Join Date: Oct 2006 Location: Mumbai, India Device: Various	You typically use devtools in the browser to see what HTTP requests the JS is making and clone those in the scraper.

Advert