Amazon has removed Download & Transfer option

[Quoth]

I had been downloading everything for years, but discovered 20 books with updates. Magazines are on a separate tab. Gifts seem to be in main list as well as Gifts.

[Quoth]

And just now on Download

This XML file does not appear to have any style information associated with it. The document tree is shown below.
<error>
<message>Invalid access token</message>
</error>

[Quoth]

Also in the Library / My Content -> Books on Amazon Web Site:
1) Send/Deliver to Device doesn't work with Paperwhite 3. Nothing in Queue.
2) On Paperwhite 3 the Whispersync has to be enabled and WiFi on. Apparently no need to Sync. The book appears and you tap to download it. Then when complete, connect to USB and it's visible in Calibre Device view (not clicking on Device column), then Add to Library works, assuming the two plugins are installed. Conversion to epub is then fine.
3) Bizarrely Send/Deliver to Device and selecting DXG DOES put the ebook in the Queue. Then doing Sync on the DXG works (because it still gets the EDGE version of 2G GSM here, which can sometimes be faster than 3G at always 245 kbps. Basic GSM 2G is only 14.4 kbps).

I only bought & tried to download an ebook just now because it was the last in a Kindle only exclusive series and I wanted to beat deadline! But Download & Transfer is broken just now from Amazon UK.

[lkmiller]

Originally Posted by salamanderjuice

Are you missing some sort of update that added a new SSL cert or something? Perhaps that's why it works for some and not you.

I've used the on device store a few times, usually after finishing a book in a series and wanting to start the next one right away.

I have the last update that the Kindle Touch got. But no big deal. It still downloads the books (for now). When I can no longer get kf8/azw3, I'll be done.

[jhowell]

Originally Posted by BionicGecko

I think I remember reading here that the quality of images in files obtained via “Download and Transfer” vary depending on the target device (when one has more than one Kindle).

That is not true. Books downloaded using Download & Transfer produce the same file (except for DRM keys) when targeting anything except the oldest Kindle models that do not support KF8/AZW3. It is when you extract files directly from a device or app that you can run into major differences in image quality. Some will be higher quality than D&T provides and some lower.

[Quoth]

It's the direct WiFi (or cell/mobile in few cases) that vary, because some give azw3 (PW1 and earlier) and others after PW1 give KFX (if FW updated since 2019). The Scribe might get different KFX. For eink Kindles. It does seem to allow an App as target device, which is odd.

It's a shame D&T is going because AZW3 is the best format for conversion and the default for all but 4 models of Kindle (K1, K2, DX and DXG are all mobi, no KF8/Azw3). Some older ebooks might be in formats other than azw3/KF8, but never in KFX. Not all kinds of "Kindle" ebooks are supported for eink.

[Timboli]

As I mentioned in an earlier post, I created a program that assists with the JavaScript program that has been posted back on Page 6. My program gives full automation, so progresses through all your pages of ebooks, saving each one.

Alas I was late to the party, so sorry about the late provision of this.

My 'KindEbook Downloader Assistant' program is a companion to the 'download-all-kindle-books.js' script.

The program makes downloading of your Amazon ebooks a fully automated process.

There are several requirements.

(1) Windows OS is required.
(2) The 'download-all-kindle-books.js' script is required, and needs to be slightly modified. See here for the detail and link.
(3) Your browser window should be full screen. This simplifies setting up the mouse fallback option.
(4) Your browser needs to be set to query mode for saving files. This ensures my program does the saving, not the JS script.
(5) Your browser's default save location (path) needs to be set, and then entered into the input provided.
(6) Do not use your PC for anything else while my program is running. Perhaps disable any background process that might interfere.
(7) You probably need to also update the following line in the JS file.
await new Promise(resolve => setTimeout(resolve, 5000));
to at least -
await new Promise(resolve => setTimeout(resolve, 10000));
I have mine set at -
await new Promise(resolve => setTimeout(resolve, 14000));
which was the value in the original version of the script.

ADVICE
My program has only been tested in Windows 7 with the Brave (Chrome clone) browser.
The default delay values (delay, sleep, wait) reflect the use of a low power PC. They can possibly be reduced if using a much better PC, especially the 'Web Page Load Delay', which can probably be reduced to 30 seconds instead of 60.

I cannot advise how my program will work with a different version Windows OS or different browser. It should work with all Chrome variants though.

A line of code needs to be added (inserted) to the 'download-all-kindle-books.js' script.

button.innerText = 'Trigger Download';
button.accessKey = 'b';
button.style.position = 'fixed';

That second line, adds a hotkey (ALT+B) for the green JavaScript button (Trigger Download).
That hotkey is used by my program to click the JavaScript button as required.IMPORTANT - Sometimes that hotkey fails, at least for me. So there is a fallback, using your mouse, which moves until centered over the green JavaScript button and then clicks it. You need to set this during the first startup of my program.

The browser's default save location (path), is key to a few things. It is required for record keeping and easier result checking. Part of that, is creating folders based on page numbers, and relocating the downloaded ebooks to that folder when a page has finished being processed. So generally each page folder should contain 25 downloaded ebooks.

Exceptions to the 25 downloaded ebooks, are ebooks that are a Sample ebook or a magazine or any format that requires a Kindle device you don't have registered with Amazon. In fact, a magazine can halt the download process for a page, due to an error dialog being left open. With that last scenario, you will need to manually download any ebooks that are after a magazine ebook.

The timing of various elements is important, hence the various delays.

USAGE
Start the program, and respond to dialogs and inputs. I recommend going with defaults to start off with.
Don't click OK on the final dialog, until the desired Amazon ebook page is loaded, and you have clicked that green (Trigger Download) JavaScript button, after which you immediately click the OK button.

Pages are processed from high number to low number. You can set the start page number and the stop page number. Both those pages are processed in the session. If you are wanting every page in your Kindle library, start with the oldest page (highest number).

After the last ebook download for a page, there will be a delay, as the program ensures that the page has been fully dealt with. Then there will be another delay, as the next web page (if any) loads. Then the program will attempt to use the hotkey to start that next page being processed. If the hotkey fails, there will be another delay to ensure that is the case, then the fallback mouse option will be used, to click that green (Trigger Download) JavaScript button. NOTE - You don't really see anything happening during the delays.

It is recommended to just let things run and not interact with timed dialogs unless you need to. Essentially the only need to, would be to cancel (stop) the program, which is done using the CANCEL button on that final dialog. You get that opportunity after every page has been processed, for the period of the delay shown on the dialog.

FURTHER INFO
On average for me, it took 490 secs for a page, so roughly 8 to 10 mins.
On a better PC you can probably halve that.
A brief splash screen shows you the download count per page, after each download.
Before opening the next page tab, the previous one is closed, using the regular hotkey for that (at least in Chrome).
My program opens each new page with your default web browser.

DOWNLOAD
KindEbook Downloader Assistant v1-2.zip

This is a Rebrandly link for a download from MEGA.
The zip file contains the EXE and the AU3 source files, plus the above instructions in a text file.

You may need to give an exclusion in your AV program for my program. If unsure about that, just upload to VirusTotal to have it checked properly.

NOTE
Even though I have tested this program significantly, and managed to download almost 200 pages in a single run over many hours, it is still a quick and dirty program, mostly because it is a one time use, and didn't warrant me spending too much time on it. Normally I would have developed a GUI etc. So there are no guarantees, and any risks are all your own.

Best of luck and enjoy ... I hope it helps!

P.S. For one reason or another, an ebook download fails or is skipped. Those will have to be manually dealt with, which is not too difficult, due to the Log.txt file results and the number of files in each page folder, along with their file names.

[Quoth]

Originally Posted by Quoth

And just now on Download

The D&T is back again on Amazon UK, so I now have an azw3/KF8 and a KFX version of the last ebook.

[richorlin]

It doesn’t matter which model Kindle you have, old or new. As of Feb 26th you can no longer download and transfer ANY kindle book.

[flowoeB]

i don't get it... i have downloaded all my 830 books i bought from amazon since the first generation kindle... they keep throwing stones at me... obsolete hardware, removed connectivity, incompatible hardware, removed books, altered forced updated books, firmware updates that removed things,... and now no chance for backup and versioning my books anymore...

my solution: no more kindle hardware, no more book buying from amazon... i can still read my books on android hardware and a lot of shops sell me the same books at the same price without trying to f me...

[BionicGecko]

Originally Posted by jhowell

That is not true. Books downloaded using Download & Transfer produce the same file (except for DRM keys) when targeting anything except the oldest Kindle models that do not support KF8/AZW3. It is when you extract files directly from a device or app that you can run into major differences in image quality. Some will be higher quality than D&T provides and some lower.

Originally Posted by Quoth

It's the direct WiFi (or cell/mobile in few cases) that vary, because some give azw3 (PW1 and earlier) and others after PW1 give KFX (if FW updated since 2019). The Scribe might get different KFX. For eink Kindles. It does seem to allow an App as target device, which is odd.

Thank you both! Good to know the target device makes no difference for D&T. Do you reckon the image quality would be higher on files obtained via Kindle for PC, versus D&T?

[jhowell]

Originally Posted by BionicGecko

Do you reckon the image quality would be higher on files obtained via Kindle for PC, versus D&T?

It can vary for different books. See the section Alternatives to KFX in the first post of the KFX Input thread for more information.

[BionicGecko]

Originally Posted by jhowell

It can vary for different books. See the section Alternatives to KFX in the first post of the KFX Input thread for more information.

Thanks, will look into it!

p.s. I’ve been meaning to give you karma several times lately but feel sorry to disturb that beautiful progression!

[Timboli]

Originally Posted by Timboli

(7) You probably need to also update the following line in the JS file.
await new Promise(resolve => setTimeout(resolve, 5000));
to at least -
await new Promise(resolve => setTimeout(resolve, 10000));
I have mine set at -
await new Promise(resolve => setTimeout(resolve, 14000));
which was the value in the original version of the script.

I added that to my previous post.

[tomsem]

Originally Posted by BionicGecko

I already downloaded all my regular books throughout the years, but I also have a bunch of comics (around 200) which I never bothered to save, and am thinking of doing so before the deadline.

I think I remember reading here that the quality of images in files obtained via “Download and Transfer” vary depending on the target device (when one has more than one Kindle). This brings a couple of questions:

• Instinctively I’d guess targeting the Scribe would give the highest quality images, is that indeed the case?
• Would the images in such books downloaded for the Scribe be in color?
• Amongst the scripts shared in this thread, is there one which allows selecting the target device?
• Would the image quality be better if I got the files through Kindle for PC?

D&T AZW3 downloads were not finely tailored to device. They contained color images and for comics, at least, resolution equal to what K4PC gets.

Without D&T the only Kindle that gets books with color images is Colorsoft. The image resolution is exactly the same as what K4PC gets in the spot checking I've done.

I have not explored the comix tool yet (a sorta last resort way of re-creating comic books when D&T, K4PC, or Colorsoft options are not available), but in the end it's not going to give better results than having AZW3 from D&T or KFX download (for a color app or device). And it takes a lot more effort.