[GUI Plugin] Best Sellers - Book Catalogs plus Blurbs, Reviews and Series Finders

[sgmoore]

Thank you for this (and your other plugins).

A few requests/notes.

Screen-Size
Can you change this to remember the last screen-size (similar to the way CCR does)?

Top 100 not showing 100
"Amazon UK: Kindle eBooks — Top 100 Paid" and "Amazon UK: Kindle eBooks — Top 100 Free" only show 30 books. (Although "Independent Publishers: Top 40 Fiction" does show 40).

Standard Ebooks
"Browse" and any of the subjects I have looked at all work perfectly, but new Releases gives this error

https://standardebooks.org/feeds/rss/new-releases
No books were parsed from the fetched page. received 60,308 characters.

Additional urls

How much customisation has to be made for each URL from the same source? For example are all amazon pages in the same format? If so, it is possible for me to add my own sections/urls?

An example, if I go to https://www.amazon.co.uk/kindle-dbs/..._sf_tab_ebooks , there are links to various sections like 'New in Prime' which would be nice to see in your plugin.(I haven't posted the URL as it is extremely long and I'm not sure what it contains - it could be tied to my account.)

[Martinoptic]

I'm a bit late to the party, but thank you for such a great plug-in.

[MiceAndMischief]

Hi,
Just having some trouble with the plugin. no sources besides from the "watchlist" is showing up when opening the plugin window. If there's something I'm missing please let me know.

Hi, just having some trouble with no sources showing up in the sidebar when opening the plugin
If theres anything I'm missing please let me know.

Merged replies

[Comfy.n]

Originally Posted by sgmoore

Thank you for this (and your other plugins).

A few requests/notes.

Screen-Size
Can you change this to remember the last screen-size (similar to the way CCR does)?

Top 100 not showing 100
"Amazon UK: Kindle eBooks — Top 100 Paid" and "Amazon UK: Kindle eBooks — Top 100 Free" only show 30 books. (Although "Independent Publishers: Top 40 Fiction" does show 40).

Standard Ebooks
"Browse" and any of the subjects I have looked at all work perfectly, but new Releases gives this error

https://standardebooks.org/feeds/rss/new-releases
No books were parsed from the fetched page. received 60,308 characters.

Additional urls

How much customisation has to be made for each URL from the same source? For example are all amazon pages in the same format? If so, it is possible for me to add my own sections/urls?

An example, if I go to https://www.amazon.co.uk/kindle-dbs/..._sf_tab_ebooks , there are links to various sections like 'New in Prime' which would be nice to see in your plugin.(I haven't posted the URL as it is extremely long and I'm not sure what it contains - it could be tied to my account.)

Working on it. Thanks for the detailed report!

Originally Posted by Martinoptic

I'm a bit late to the party, but thank you for such a great plug-in.

Glad you like it.

Originally Posted by MiceAndMischief

Hi,
Just having some trouble with the plugin. no sources besides from the "watchlist" is showing up when opening the plugin window. If there's something I'm missing please let me know.

Hi, just having some trouble with no sources showing up in the sidebar when opening the plugin
If theres anything I'm missing please let me know.

Merged replies

Could you please post some screenshots, and plugin/calibre version info?

For screenshots, use the 'Go Advanced' posting button when replying and click the clip icon to attach the images.

For system and calibre info, I suggest Calibre Config Reports.

[MiceAndMischief]

Hi, here are some screenshots of the plugin as well as the config report info. My calibre version is 7.6

[Comfy.n]

Originally Posted by MiceAndMischief

Hi, here are some screenshots of the plugin as well as the config report info. My calibre version is 7.6

Awesome, thanks for the screenshots. Please see if the attached version fixes both the sources not showing on Mint, and the 🔗 link symbol not being displayed on About tab.

And if you want to provide detailed feedback, please attach a log file upon running this command:

BS_DEBUG_ENABLED=1 calibre-debug -g

or

BS_DEBUG_ENABLED=1 calibre-debug -g > ~/calibre_debug.log 2>&1

[MiceAndMischief]

Hi, yes everything is working now!! please find attatched screenshots of everything working including the log file after running the requested command:

BS_DEBUG_ENABLED=1 calibre-debug -g

calibre 7.6  embedded-python: False
Linux-7.0.0-38-generic-x86_64-with-glibc2.39 Linux ('64bit', 'ELF')
('Linux', '7.0.0-38-generic', '#38~24.04.4-Ubuntu SMP PREEMPT_DYNAMIC Mon Sep 14 16:37:11 UTC 2')
Python 3.12.3
Interface language: None
EXE path: /usr/bin/python3.12
Successfully initialized third party plugins: Gather KFX-ZIP (from KFX Input) (2, 34, 2) && DeDRM (10, 0, 9) && Package KFX (from KFX Input) (2, 34, 2) && KFX Output (2, 22, 0) && Best Sellers (6, 0, 111) && Calibre Config Reports (5, 0, 2) && FanFicFare (4, 62, 0) && KFX metadata reader (from KFX Input) (2, 34, 2) && From KFX (2, 34, 2) && KFX Input (2, 34, 2) && Set KFX metadata (from KFX Output) (2, 22, 0) && KOReader Sync (0, 8, 2)
QPA platform: xcb
devicePixelRatio: 1.0
logicalDpi: 96.0 x 96.0
physicalDpi: 102.45378151260503 x 102.35820895522387
ApplicationPaletteChange event ignored
Using calibre Qt style: True

[Comfy.n]

Version 6.1

- fixes and additions to Standard Ebooks source
- window persistence fixes
- Amazon UK - several new categories are now available besides Top 100 Free and Paid, including First Reads and Prime Reads categories; the latter require setting session cookies in config dialog
- compatibility improvements for macOS and Linux

[sgmoore]

- Version 6.1

Mostly good news but some not so good.

- fixes and additions to Standard Ebooks source

All working now.

- window persistence fixes

Not working.

- Amazon UK - several new categories are now available besides Top 100 Free and Paid, including First Reads and Prime Reads categories; the latter require setting session cookies in config dialog

Mostly working (after a hiccup with cookies due to me not paying attention)

I tried the Top 100 and it said I must have hit a captcha, so I tried to add my cookie (using cookies.txt One Click on firefox). I did not pay attention to the contents of the file it download, just pasted it in and saved and because the Top 100 refreshed, I assumed it had worked. But none of the prime sections worked (0 bytes download) and when I actually checked, the file just contained a few lines of header and no actually cookies. The "Get cookies.txt LOCALLY" extension is also available for firefox, but it did not work either, but I did manage to get the cookies using Chrome.

All the prime readings sections now work. (Thank you)

The Top 100 Free and Paid works, but not quite how I expected. In the browser this displays as 2 pages with 50 books per page and your plugin downloads some books and then has a button to download more. But not 50 and 50 as I expected, but 30 from the first page and 30 from the second. Also the 31st book in your list is actually number 51.

You also have two "First reads" categories - one on its own and the other inside Prime Reading. The latter works fine, but the former produced this error

Amazon UK: First Reads https://www.amazon.co.uk/firstreads/...uk_first_reads No books were parsed from the fetched page. received 363,642 characters; page appears JavaScript-heavy.

When I clicked on the preview button, calibre shutdown completely.

This was done before I had saved my cookies correctly, so I tried this again after the cookies were set and the error was basically the same (except 433,320 bytes) but this time clicking on preview brought up the browser correctly, but I was not actually logged in.

Thanks again.

[JSWolf]

You can use AI to remove the crap from most blurbs. Does this plugin do that?

[Comfy.n]

Originally Posted by sgmoore

- Version 6.1

Mostly good news but some not so good.

- fixes and additions to Standard Ebooks source

All working now.

- window persistence fixes

Not working.[...]

Thanks again.

I tested on Windows, macOS and Linux this time. Geometry is saved in all cases...

Will you please run these commands then send me the log? (assuming Windows)


set "BS_DEBUG_ENABLED=1"
set dt="%date:~-4,4%-%date:~-7,2%-%date:~-10,2%,%time:~0,2%_%time:~3,2%_%time:~6,2%"
calibre-debug -g 1>> calibre-debug-log-%dt%.txt 2>&1

or just
set "BS_DEBUG_ENABLED=1"
calibre-debug -g

(and watch console in this case)

Then play around a bit with the plugin, move window, minimise, restore... should be useful, I think.

Later I'll address other issues you and JSwolf raise. I dont use chrome, so I recommend the firefox extension for session cookies and it works flawlessly for me.

[sgmoore]

Nothing appears when I resize, move, maximise, minimise or restore the window.

These message appear when I load the plugin

[Best Sellers][DEBUG] _load_sources: starting load (os=nt, platform=Windows, sys.platform=win32)
[Best Sellers][DEBUG] _load_sources: zip candidates to test: ['C:\\Users\\Stephen\\AppData\\Roaming\\calibre\\pl ugins\\Best Sellers.zip', 'C:\\Users\\Stephen\\AppData\\Roaming\\calibre\\pl ugins\\best_sellers.zip', 'C:\\Users\\Stephen\\AppData\\Roaming\\calibre\\pl ugins\\Best sellers.zip']
[Best Sellers][DEBUG] _load_sources: checking zip: C:\Users\Stephen\AppData\Roaming\calibre\plugins\B est Sellers.zip -> exists=True
[Best Sellers][DEBUG] _load_sources: zip opened (entries=502, has_sources=True)
[Best Sellers][DEBUG] _load_sources: loaded 2130 sources from zip C:\Users\Stephen\AppData\Roaming\calibre\plugins\B est Sellers.zip
[Best Sellers][PERF] 0.176s (+0.176s) BestSellersDialog.__init__ START
[Best Sellers][PERF] 0.000s (+0.000s) __init__ base + attrs
[Best Sellers][PERF] 0.000s (+0.000s) window flags + title
[Best Sellers][DEBUG] plugin icon: theme=light file=images/iconplugin_light.png
[Best Sellers][DEBUG] icon: get_icons(('images/iconplugin_light.png',)) OK
[Best Sellers][PERF] 0.000s (+0.000s) icon + min size
[Best Sellers][PERF] 0.000s (+0.000s) _build_ui START
[Best Sellers][PERF] 0.006s (+0.006s) _build_ui: sources panel done
[Best Sellers][DEBUG] icon: get_icons(('images/zoom_out.png',)) OK
[Best Sellers][DEBUG] icon: get_icons(('images/zoom_in.png',)) OK
[Best Sellers][DEBUG] icon: get_icons(('images/zoom-reset.png',)) OK
[Best Sellers][PERF] 0.017s (+0.017s) _build_ui END
[Best Sellers][PERF] 0.000s (+0.000s) _build_ui done
[Best Sellers][PERF] 0.003s (+0.003s) _restore_geo done
[Best Sellers][PERF] 0.000s (+0.000s) _populate_sources START
[Best Sellers][PERF] 0.000s (+0.000s) before model.clear()
[Best Sellers][PERF] 0.000s (+0.000s) after model.clear()
[Best Sellers][PERF] 0.004s (+0.004s) before SOURCES loop
[Best Sellers][DEBUG] _populate_tree: populated 1125 sources into tree (hidden count=85)
[Best Sellers][PERF] 0.028s (+0.028s) after SOURCES loop (1125 items)
[Best Sellers][PERF] 0.001s (+0.001s) before setUpdatesEnabled(True)
[Best Sellers][PERF] 0.000s (+0.000s) after setUpdatesEnabled(True) scheduled
[Best Sellers][PERF] 0.000s (+0.000s) after expand groups
[Best Sellers][PERF] 0.000s (+0.000s) _populate_sources END
[Best Sellers][PERF] 0.001s (+0.001s) _populate_sources done
[Best Sellers][PERF] 0.000s (+0.000s) BestSellersDialog.__init__ END
[Best Sellers][DEBUG] Source favicon: url=https://www.amazon.co.uk/gp/bestsellers/digital-text/341689031?tf=1 domain=amazon.co.uk key=amazon.co.uk is_nyt=False
[Best Sellers][DEBUG] Display books: total=60 missing_covers=0 missing_blurbs=0 is_bookshop=False

[Comfy.n]

Thanks, I found the issue, will upload a hotfix ASAP.

[Best Sellers][PERF] 0.003s (+0.003s) _restore_geo done

This was restoring only window position, not window size.

[Comfy.n]

Originally Posted by JSWolf

You can use AI to remove the crap from most blurbs. Does this plugin do that?

Not something I will be focusing on for now; maybe in the future.

[Comfy.n]

Version 6.1.1

- Fixes window geometry persistence
- Improves Amazon UK Top 100 loading
- Reorganize Sessions tab in config dialog - I hope it is clear that pasting the entire content of the cookies export file (Firefox extension) then clicking 'Save' is enough for the session to pick; however in order to not break translation files, I opted to leave the explanatory text unchanged.