Amazon has removed Download & Transfer option

[Timboli]

Originally Posted by flowoeB

my solution: no more kindle hardware, no more book buying from amazon... i can still read my books on android hardware and a lot of shops sell me the same books at the same price without trying to f me...

Some of the things you said and more.

I'd like to thank Amazon for continuing to show me the error of my ways.

It's been one thing after another, and so I eventually turned to Kobo for most of my ebook purchases. So in the end, for the last three years or so, I have only been purchasing at Amazon, what isn't available at Kobo or is significantly cheaper at Amazon.

Now it is looking like I might have to bite the bullet and sacrifice getting any ebooks at Amazon. With several thousand Kindle purchases, and still many physical books to read, and plenty of ebooks now at Kobo, which has my preferred reading device anyway, it should not be too much of a hardship.

I'd also like to thank Amazon for lighting a fire under me.

Sometime ago I had started using the Download & transfer via USB option, instead of using the Kindle For PC app, and then gone back and started getting older purchases. However, I had a lot to do, so that soon became something I put off for another day.

This latest action by Amazon, and that wonderful JS script, enabled me to revisit getting the rest, especially when I saw how I could improve things, such that it was full automation to get the rest.

So it could well be - So long and thanks for all the fish ... I mean ebooks.

[JSWolf]

Originally Posted by tomsem

Without D&T the only Kindle that gets books with color images is Colorsoft.

I do get color images when I download to my Kindle Touch that does not do KFX.

What should be said is that it's KFX that doesn't deliver color except for the Colorsoft.

Another reason to purchase ePub.

[Ma'am-I-Am]

Time's a-wastin', people.

If you still need to download - and aren't all hung up about KFX - use K4PC. Sorry about the Mac folks. Open your Digital Content page, choose Select All, choose send to device, choose K4PC. Next page. Repeat. Find your files on your PC, search for ebok.azw, select all (my Calibre can only handle about 8 at a time before KFX-ZIP starts showing up), drag/drop to Calibre.

As for Update Available, open your Digital Content page, use your browser's Find In Page (on Firefox Edit menu), type Update, do the search. If an update is found, add it to a collection called Updated or whatever. You can bulk download the collection to K4PC. Or send to K4PC as you find them. If no update is found, hit End, then Page Up to get to the page number bar faster.

Just a note: in the past, I've had difficulty getting the updated versions. It seems like you have to send it to a device first before you can D&T the new version - and sometimes I still get the old version over and over. I'm hoping that sending it to K4PC first, then hitting Update Available will at least give me some of them.

I already had all my books D&T, but I did 242 pages/~180 updates this way. I kept K4PC open while I did this and let it sync continuously, i.e. the old version got sent, then when I hit Update Available, hopefully the new one got sent.

If someone knows a surefire way to get the Updated versions, let me know.

[Keybounce]

I attempted to use this python package to download my books, and being my first time doing anything fancy in Python on my linux system, I found out that Debian systems disable user installs of new packages (pip and other python installers) to avoid breaking system behavior.

Never having had to worry about this before, what is the best way to proceed? I am aware that this is a last day thing now, can you help me out please?

user@NS70PU:~/Downloads/kindle$ python3 kindle.py
python3: can't open file '/home/user/Downloads/kindle/kindle.py': [Errno 2] No such file or directory
user@NS70PU:~/Downloads/kindle$ apt install python3-kindle
E: Could not open lock file /var/lib/dpkg/lock-frontend - open (13: Permission denied)
E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), are you root?
user@NS70PU:~/Downloads/kindle$ sudo !!
sudo apt install python3-kindle
[sudo] password for user: 
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
E: Unable to locate package python3-kindle
user@NS70PU:~/Downloads/kindle$ sudo apt install python3-kindle.py
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
E: Unable to locate package python3-kindle.py
E: Couldn't find any package by glob 'python3-kindle.py'
user@NS70PU:~/Downloads/kindle$

Originally Posted by Fraccy

I was able to automate the download of my ~2400 Kindle books using the command line utility from https://github.com/yihong0618/Kindle_download_helper

Log in to your Amazon account > Manage Your Content and Devices

Copy the cookie and save it to a file ('cookie.txt'): https://github.com/yihong0618/Kindle...rieving-cookie

Execute the Python utility (this example accesses amazon.co.uk):

  python kindle.py --cookie-file cookie.txt --uk -o DOWNLOADS --device_sn [Your Kindle serial no.] --mode all

You can also download a JSON list containing details of all your Kindle books:

  python kindle.py --cookie-file cookie.txt --uk --list --device_sn [Your Kindle serial no.]

There are other methods outlined in the README, but this worked best for me.

[DNSB]

You could try adding '--break-system-packages' to the end of the pip install line. I did this on my Linux install but since it's a VM, I did a snapshot first to make it easy to revert if I found any issues.

[Keybounce]

Originally Posted by Ma'am-I-Am

Time's a-wastin', people.

If you still need to download - and aren't all hung up about KFX - use K4PC. Sorry about the Mac folks. Open your Digital Content page, choose Select All, choose send to device, choose K4PC. Next page. Repeat. Find your files on your PC, search for ebok.azw, select all (my Calibre can only handle about 8 at a time before KFX-ZIP starts showing up), drag/drop to Calibre.
..

Ok, how do I do this? I do "select all", and send to device -- but there is no K4PC option, and I cannot find any download and transfer except on a book by book basis.

Will you please be a helper and tell me what I am overlooking/missing?

[Keybounce]

Ugh, really? KUbuntu:
> user@NS70PU:~/Downloads/kindle$ pipx
> Command 'pipx' not found, but can be installed with:
> sudo apt install pipx

Packaging pipx in the distro avoids the irony of instructing users to pip install --user --break-system-packages pipx to avoid breaking system packages. Consider arranging things so your distro’s package / environment for Python for end users (e.g., python3 on Fedora or python3-full on Debian) depends on pipx.

[DNSB]

Select All, click on Deliver to Device, select your K4PC install and click okay. Repeat for the next page.

As for automating download and transfer, there are several TamperMonkey scripts to automate sending each page and a couple of Python scripts that will download your entire library.

[Keybounce]

Originally Posted by DNSB

Select All, click on Deliver to Device, select your K4PC install and click okay. Repeat for the next page.

As for automating download and transfer, there are several TamperMonkey scripts to automate sending each page and a couple of Python scripts that will download your entire library.

I do not see a "K4PC" install. Only my physical devices.

[DiapDealer]

Virtual Python environments help in this situation too:

python -m venv amzpy

from within your home directory will create the amzpy (or whatever you decide to name it) directory. Activate the virtual environment using:

source amzpy/bin/activate

Install the extra requirements in your new virtual environment using pip as you used to do.

pip install requests selenium PyVirtualDisplay (no sudo/su necessary)

Then run the script to login and get your books.

When done using the virtual environment, enter "deactivate" at the command prompt. Delete the amzpy folder if you no longer need it.

[Keybounce]

Originally Posted by DiapDealer

Virtual Python environments help in this situation too:

python -m venv amzpy

Thank you. I have managed to get a virtual python setup. Things seem to be working. But neither the BulkKindleUSBDownloader, nor the Kindle_download_helper are working.

Bulk Downloader is able to create a chrome window, but never gets to the web page. Looking at the script, after "Starting browser", and assembling the options, it calls webdriver.Chrome() and that call never returns; a print() before it works, and a print() after it fails (and there is a logger call just after it as well).

The kindle.py script from download_helper is able to take my ajax cookie (stored in a file), find my account, list books, and all of them fail to download.

[DiapDealer]

Do you have the ChromeDriver dependency installed? It's mentioned right after the Python 3 dependency.

typing:

which chromedriver

at a command prompt will let you know if (and where) it's installed. It has to be in your system path if the script is to work.

[Keybounce]

This is odd:

(Python) user@NS70PU:~/Documents/dev/BulkKindleUSBDownloader$ pip install chromedriver
Requirement already satisfied: chromedriver in /home/user/Python/lib/python3.12/site-packages (2.24.1)
(Python) user@NS70PU:~/Documents/dev/BulkKindleUSBDownloader$ which chromedriver
(Python) user@NS70PU:~/Documents/dev/BulkKindleUSBDownloader$

So it is installed, but it's not in path?
I mean, it is in the python path.


Full output:

python3 bookp.py --email keybounce@gmail.com --verbose --showbrowser
Your Amazon password: 
Your Amazon Oath (just hit enter if you don't have this): 
Please choose which country's Amazon you want to access!
 0. UK
 1. USA
 2. Germany
 3. Italy
 4. Canada
 5. France
 6. Japan
Country #: 1
{'base_url': 'https://www.amazon.com', 'account_list_selector': 'nav-link-accountList-nav-line-1', 'sign_in_selector': '#nav-flyout-ya-signin > a.nav-action-signin-button', 'email_selector': 'ap_email'}
[INFO]  2025-02-24 04:43:56,787 Starting browser
<selenium.webdriver.chrome.options.Options object at 0x743fb9406840>
Traceback (most recent call last):
  File "/home/user/Documents/dev/BulkKindleUSBDownloader/bookp.py", line 355, in <module>
    sys.exit(main())
             ^^^^^^
  File "/home/user/Documents/dev/BulkKindleUSBDownloader/bookp.py", line 317, in main
    cookies, csrf_token, custid = create_session(
                                  ^^^^^^^^^^^^^^^
  File "/home/user/Documents/dev/BulkKindleUSBDownloader/bookp.py", line 91, in create_session
    browser = webdriver.Chrome(options=options)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/Python/lib/python3.12/site-packages/selenium/webdriver/chrome/webdriver.py", line 45, in __init__
    super().__init__(
  File "/home/user/Python/lib/python3.12/site-packages/selenium/webdriver/chromium/webdriver.py", line 66, in __init__
    super().__init__(command_executor=executor, options=options)
  File "/home/user/Python/lib/python3.12/site-packages/selenium/webdriver/remote/webdriver.py", line 250, in __init__
    self.start_session(capabilities)
  File "/home/user/Python/lib/python3.12/site-packages/selenium/webdriver/remote/webdriver.py", line 342, in start_session
    response = self.execute(Command.NEW_SESSION, caps)["value"]
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/Python/lib/python3.12/site-packages/selenium/webdriver/remote/webdriver.py", line 429, in execute
    self.error_handler.check_response(response)
  File "/home/user/Python/lib/python3.12/site-packages/selenium/webdriver/remote/errorhandler.py", line 232, in check_response
    raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.SessionNotCreatedException: Message: session not created: DevToolsActivePort file doesn't exist
Stacktrace:
#0 0x56c519a4a53a <unknown>
#1 0x56c519545f00 <unknown>
#2 0x56c519582b24 <unknown>
#3 0x56c51957d589 <unknown>
#4 0x56c5195794b6 <unknown>
#5 0x56c5195c67b6 <unknown>
#6 0x56c5195c5e06 <unknown>
#7 0x56c5195ba343 <unknown>
#8 0x56c51958778a <unknown>
#9 0x56c5195889de <unknown>
#10 0x56c519a142cb <unknown>
#11 0x56c519a18242 <unknown>
#12 0x56c519a017ac <unknown>
#13 0x56c519a18df7 <unknown>
#14 0x56c5199e5b2f <unknown>
#15 0x56c519a391a8 <unknown>
#16 0x56c519a39370 <unknown>
#17 0x56c519a493b6 <unknown>
#18 0x73eb93a9caa4 <unknown>
#19 0x73eb93b29c3c <unknown>

(Python) user@NS70PU:~/Documents/dev/BulkKindleUSBDownloader$

[DiapDealer]

Chromedriver is not a python module. It can't be installed with pip. What you installed was an ancient python helper used to download ancient versions of chromedriver. You could try installing chromedriver-py with pip, but that would likely require you to manually modify the bookp.py script for the script to be able to locate it.

The chromedriver binary comes with the Chromium browser package, or it can be installed manually on its own. you could also see if it's your distro's repository.

[Keybounce]

Thank you. I got the proper version from google. And ... it behaves the same -- opens a window to "data:,", and then dies exactly the same.

The chromedriver binary comes with the Chromium browser package,

which might explain why it seemed to work, as I have that browser. But then, why was it not found in PATH?