06-30-2018, 08:32 PM | #31 | |
Wizard
Posts: 4,742
Karma: 246906703
Join Date: Dec 2011
Location: USA
Device: Oasis 3, Oasis 2, PW3, PW1, KT
|
Quote:
|
|
07-02-2018, 05:07 PM | #32 | |
Grand Sorcerer
Posts: 5,278
Karma: 98804578
Join Date: Apr 2011
Device: pb360
|
Quote:
Big thanks to everyone that looked into this and reported their findings. |
|
Advert | |
|
07-02-2018, 09:34 PM | #33 | |
Wizard
Posts: 4,742
Karma: 246906703
Join Date: Dec 2011
Location: USA
Device: Oasis 3, Oasis 2, PW3, PW1, KT
|
Quote:
I don't mind either way - archive book without X-Ray and without DRM is good enough for me. I can read comfortably with KFX or KF8 files, so downloading from my Kindle is never inconvenient. The only problem is my font ramp - on KFX I use size 5, on KF8 I need 9. One of these days I am going to change my ramp to copy the 9 spot to 5, so it is the same either way ... |
|
07-03-2018, 06:45 AM | #34 |
curly᷂͓̫̙᷊̥̮̾ͯͤͭͬͦͨ ʎʌɹnɔ
Posts: 3,002
Karma: 50506927
Join Date: Dec 2010
Location: ♁ ᴺ₄₅°₃₀' ᵂ₇₃°₃₇' ±₆₀"
Device: K3₃.₄.₃ PW3&4₅.₁₃.₃
|
Yes, that is also the way it worked for me.
After the book has been touched by Calibre it no longer is the same book and it won't trigger the X-Ray download from Amazon. Even if it did, the X-Ray entities locations won't match the locations in the de-DRMed book. You can try this by using Amazon's X-Ray files with the sideloaded book, X-Ray seems functional but give irrelevant references. |
07-03-2018, 07:19 AM | #35 | |
Wizard
Posts: 4,742
Karma: 246906703
Join Date: Dec 2011
Location: USA
Device: Oasis 3, Oasis 2, PW3, PW1, KT
|
Quote:
|
|
Advert | |
|
07-04-2018, 09:34 PM | #36 | |
Grand Sorcerer
Posts: 5,278
Karma: 98804578
Join Date: Apr 2011
Device: pb360
|
That is what I've been doing.
Quote:
You have goaded me into an experiment. Doing an od -a (like hex dump, but ascii like characters) on both gave results with 3 small blocks of differences near the top. od -a precalbook.azw3 > precalbook.txt od -a postcalbook.azw3 > postcalbook.txt The parts that were the same had the same offset from the beginning of the file, so xray matching should be perfect. |
|
07-05-2018, 07:16 AM | #37 |
Wizard
Posts: 4,742
Karma: 246906703
Join Date: Dec 2011
Location: USA
Device: Oasis 3, Oasis 2, PW3, PW1, KT
|
So, possibly removing of DRM is safe, but editing metadata might not be as it changes file size. Either not triggering the download of X-Ray or making it corrupt. Makes sense that DRM alone would not effect locations - otherwise syncing between different devices might not work.
As an afterthought, it is very practical that a new X-Ray file does not need to be generated everytime DRM is applied - what nightmare would that be for Amazon. |
07-08-2018, 03:22 PM | #38 | |
curly᷂͓̫̙᷊̥̮̾ͯͤͭͬͦͨ ʎʌɹnɔ
Posts: 3,002
Karma: 50506927
Join Date: Dec 2010
Location: ♁ ᴺ₄₅°₃₀' ᵂ₇₃°₃₇' ±₆₀"
Device: K3₃.₄.₃ PW3&4₅.₁₃.₃
|
Quote:
Thanks for pointing the usefulness of od -a . In addition to removing DRM, by "touching with Calibre", I meant converting AZW3 to AZW3 or KFX to KFX with the KFX input plugin. This indeed does modify the file length and does cause invalid X-Ray references. Per your analysis I have to agree that X-Ray matching should be perfect when only sideloading I never was succesful in testing this though, when I replaced amazon "War and Peace" by its de-DRMed sideloaded copy I never saw the book appearing on the Kindle. It obstinately gave me a message saying "1 item pending download from the cloud" until I gave in, deleted everyting -- sdr directory and book -- and re-downloaded a fresh copy from amazon. Makes me wonder of the correct procedure for moving an original sdr directory + its de-DRMed book to another ereader. |
|
07-08-2018, 06:31 PM | #39 | |
Grand Sorcerer
Posts: 5,278
Karma: 98804578
Join Date: Apr 2011
Device: pb360
|
You're welcome.
I usually use od -t x1 for this sort of thing, but many flavors of od do not support the -t option. Quote:
Managing books seems to be getting more complicated. As near as I can tell, copying an AZW3 directly to /mnt/us/documents then turning airplane mode off, the Kindle will delete the AZW3 and download the KFX version of the book if there is one. But if I do the same except to a subdirectory of documents, the Kindle leaves the AZW3 alone and downloads an XRAY file if there is one for the book. |
|
07-08-2018, 06:44 PM | #40 |
curly᷂͓̫̙᷊̥̮̾ͯͤͭͬͦͨ ʎʌɹnɔ
Posts: 3,002
Karma: 50506927
Join Date: Dec 2010
Location: ♁ ᴺ₄₅°₃₀' ᵂ₇₃°₃₇' ±₆₀"
Device: K3₃.₄.₃ PW3&4₅.₁₃.₃
|
|
07-10-2018, 04:21 PM | #41 |
Grand Sorcerer
Posts: 5,278
Karma: 98804578
Join Date: Apr 2011
Device: pb360
|
Amazon's XRAY file for the War and Peace version in this thread has two
entities that I think are the same character. I haven't read the book yet and part of why I want to do so with a reasonably good XRAY file is to keep characters straight, especially Russians with a confusing array of names. (And then there all the mind numbing different transliterations used in different sources.) Code:
Entity | Name | Number of mentions 90 | Prince Vasili Sergeevich | 225 92 | Prince Vasili Kuragin | 17 https://en.wikipedia.org/wiki/List_o...ace_characters but no trace of Vasili Sergeevich. Can anyone confirm whether these are the same character? |
07-10-2018, 07:18 PM | #42 | |
Wizard
Posts: 4,742
Karma: 246906703
Join Date: Dec 2011
Location: USA
Device: Oasis 3, Oasis 2, PW3, PW1, KT
|
According to: https://www.macalester.edu/~hammarbe.../Whoiswho.html
It may just be multiple last names and same person: Quote:
|
|
07-10-2018, 07:59 PM | #43 | |
User
Posts: 234
Karma: 3246802
Join Date: Jul 2013
Device: Iphone, Kindle 3, PW1/2/3, KOA1/2/3, Aura HD/One/, Kobo Forma
|
Quote:
|
|
07-13-2018, 04:12 PM | #44 | |||
Grand Sorcerer
Posts: 5,278
Karma: 98804578
Join Date: Apr 2011
Device: pb360
|
Quote:
Quote:
This is turning out to be even more complicated than I thought. I had planned to eliminate entity 92 and its description and change all references of 92 to 90 and change the label for 90 to "Prince Vasili" which would match both. But for entity 92 the first "i" in Vasili isn't an ASCII "i" but an UTF character where the dot is an accent mark. (Please don't flame me on terminology, my cultural written language is 7 bit ASCII.) Also for entity 92, the "a" in Kuragin has an accent mark. It also turns out that there is an entity 708 "Prince Vasili Kuragin" (All 7 bit ASCII). I don't know whether it is possible to make the XRAY.entities file correct and consistent without changing the text of the book. I guess that I will stick to fixing mistaken identities in XRAY.entities files, there are certainly plenty of them. |
|||
07-14-2018, 10:38 PM | #45 |
Addict
Posts: 328
Karma: 800105
Join Date: Feb 2013
Device: PW1
|
It doesn't actually do any matching from the X-Ray file unless it's changed recently, so you should be good to use whichever entity you want to keep, change the references to that entity id (in entity_description, entity_exerpt, exerpt, and occurrence).
Last edited by Ephemerality; 07-14-2018 at 10:41 PM. |
Tags |
war and peace, x-ray |
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
10h BBC Radio dramatisation of "War and Peace" | HarryT | Deals and Resources (No Self-Promotion or Affiliate Links) | 14 | 01-15-2015 05:09 PM |
Proposal: CSS "normalisation" functionality in Sigil | Man Eating Duck | Sigil | 17 | 08-20-2013 12:25 PM |
Suggestions for Functionality of the "consumer" iLiad | Riocaz | iRex | 20 | 06-01-2006 08:08 AM |