convert book's Index into X-Ray

pepe_alter_ego · 07-24-2014, 12:35 PM

I've got some non-fiction books which are not X-Ray "enabled".
Each of them, however, contains a good (Subject and Author) Index.
So, I've been thinking that maybe there is a way to convert the existing Index into X-Ray.
Any ideas?

Ephemerality · 07-24-2014, 03:24 PM

There are 2 tools that exist to create x-ray files for books based on the info on Shelfari (and/or Wikipedia):
Command-line xray tool
Mjwilson's Calibre Plugin

You could certainly build one from that info in the index, but it would be time consuming if it's not already on Shelfari.

pepe_alter_ego · 07-24-2014, 05:42 PM

So, I checked two of my non-fiction books on Shelfari and the entries for both of them are very basic / plain (just some description, covers, author).

Well, I hoped I could "extract" the Index chapter from such a book and convert it somehow automatically into an X-Ray, but this doesn't seem to be that straightforward.

BTW. For one of these books, I noticed an even worse problem. It's "GoTo" -> "Contents" numbers are in "Location" units. There are no "Page Numbers" at all (so you can only "Go To Location", "Go To Page" is not possible). But the (Subject and Author) Index entries contain "Page Numbers" (it just seems to be a direct copy of the paperback version) and no "Locations", so you cannot "click" on an entry in it and go to the place in the book which it references. Does anybody know where / how to report such a problem?

Ephemerality · 07-25-2014, 07:41 AM

Quote:

Originally Posted by pepe_alter_ego

Well, I hoped I could "extract" the Index chapter from such a book and convert it somehow automatically into an X-Ray, but this doesn't seem to be that straightforward.

BTW. For one of these books, I noticed an even worse problem. It's "GoTo" -> "Contents" numbers are in "Location" units. There are no "Page Numbers" at all (so you can only "Go To Location", "Go To Page" is not possible). But the (Subject and Author) Index entries contain "Page Numbers" (it just seems to be a direct copy of the paperback version) and no "Locations", so you cannot "click" on an entry in it and go to the place in the book which it references. Does anybody know where / how to report such a problem?

There was another thread on reporting X-ray bugs/issues and there was no conclusive answer aside from just contacting their customer service. Converting it all in the way you want could certainly be done, but it would either be a lengthy manual process, or an automated process that would have to be written from scratch and not have much reusability, unfortunately.

davidn · 08-14-2014, 12:21 AM

Quote:

Originally Posted by Ephemerality

There are 2 tools that exist to create x-ray files for books based on the info on Shelfari (and/or Wikipedia):
Command-line xray tool
Mjwilson's Calibre Plugin

You could certainly build one from that info in the index, but it would be time consuming if it's not already on Shelfari.

Hi,

I'm trying to run xraybuilder on a 64 bit windows machine, and I'm getting an error (see below), perhaps because there are Chinese characters in the shelfari web page?

Is there any additional data I can give you to help troubleshoot the issue?

Thanks.

Code:

c:\Users\David\Downloads\xraybuilder>xraybuilder "f:\Users\David\Documents\Calibre Library\Cao Xueqin\The Story of the Stone (18)\The Story of the Stone - Cao Xueqin.mobi"
xraybuilder "f:\Users\David\Documents\Calibre Library\Cao Xueqin\The Story of the Stone (18)\The Story of the Stone - Cao Xueqin.mobi"
X-Ray Builder Version 1.50

Using c:\Users\David\Downloads\xraybuilder\out as an output directory.
Processing The Story of the Stone - Cao Xueqin.mobi...
Enter Shelfari URL for The Story of the Stone - Cao Xueqin (Enter to skip): 
http://www.shelfari.com/books/13038144/The-Golden-Days
Running mobi_unpack to get book data...
Mobi unpacked...
RawML found at C:\Users\David\AppData\Local\Temp\vehumt0k.cal/mobi7/The Story of the Stone - Cao Xueqin.rawml. Grabbing metadata...
Got metadata!
Database Name: The_Story_of_the_Stone
ASIN: c83d80b0-5d61-438c-8f6f-ebf0f02d09a4
UniqueID: 1347007238
Attempting to build X-Ray...
Spoilers: Disabled
Location Offset: 0
Downloading Shelfari page... 
Characters exported to c:\Users\David\Downloads\xraybuilder\ext\c83d80b0-5d61-438c-8f6f-ebf0f02d09a4.aliases for adding aliases.
Terms found on Shelfari:
Jia Baoyu (賈寶玉)  (also Pao-Yu), Lin Daiyu (林黛玉), Xue Baochai (薛寶釵), Jia Yuanchun (賈元春), Jia Tanchun (賈探春), Shi Xiangyun (史湘雲), Miaoyu (妙玉), Jia Yingchun (賈迎春), Jia Xichun (賈惜春), Wang Xifeng (王熙鳳), Jia Qiaojie (賈巧姐), Li Wan (李紈), Qin Keqing (秦可卿), Grandmother Jia (賈母), Jia Zheng (賈政), Jia Lian (賈璉), Xiangling (香菱, \"Fragrant Water caltrop\", Caltrop), Ping'er (平兒, \"Peace\", Patience), Xue Pan (薛蟠), Granny Liu (劉姥姥), Lady Wang (王夫人), Aunt Xue (薛姨媽), Qingwen (晴雯, Skybright), Xiren (襲人, \"Fragrance raids people\", Aroma), Zijuan (紫鵑, Nightingale), Yuanyang (鴛鴦, Mandarin Duck), Mingyan (茗煙, Tea-mist), Xueyan (雪雁, Snowgoose), Jia She (贾赦), Concubine Zhao (趙姨娘), Qin Zhong (秦鐘), Jia Lan (賈蘭), Jia Zhen (賈珍), Lady You (尤氏), Jia Rong (賈蓉), Second Sister You (尤二姐), Lady Xing (邢夫人), Jia Huan (賈環), Sheyue (麝月, Musk), Qiutong (秋桐), Sister Silly (傻大姐), Nanking, Heaven, Euergesia, Soochow, Naiad, Garden, Sapientia, Yangchow  
Continue building using these terms (cancel if you want to add aliases)? (Y/N) y


Initial X-Ray built, adding locs and chapters...
Chapters exported to c:\Users\David\Downloads\xraybuilder\ext\c83d80b0-5d61-438c-8f6f-ebf0f02d09a4.chapters for manual editing.
Found chapters:
Introduction | start: 15526 | end: 98356
Chapter 1  | start: 98356 | end: 98356
Zhen Shi-yin makes the Stone’s acquaintance in a dream;  | start: 98356 | end: 98356
and Jia Yu-cun finds that poverty is not incompatible  | start: 98356 | end: 98356
with romantic feelings | start: 98356 | end: 145932
Chapter 2  | start: 145932 | end: 145932
A daughter of the Jias ends her days in Yangchow city;  | start: 145932 | end: 145932
and Lang Zi-xing discourses on the Jias of Rong-guo  | start: 145932 | end: 145932
House | start: 145932 | end: 186505
Chapter 3  | start: 186505 | end: 186505
Lin Ru-hai recommends a private tutor to his  | start: 186505 | end: 186505
brother-in-law;  | start: 186505 | end: 186505
and old Lady Jia extends a compassionate welcome to the  | start: 186505 | end: 186505
motherless child | start: 186505 | end: 245829
Chapter 4  | start: 245829 | end: 245829
The Bottle-gourd girl meets an unfortunate young man;  | start: 245829 | end: 245829
and the Bottle-gourd monk settles a protracted lawsuit | start: 245829 | end: 284663
Chapter 5  | start: 284663 | end: 284663
Jia Bao-yu visits the Land of Illusion;  | start: 284663 | end: 284663
and the fairy Disenchantment performs the ’Dream of  | start: 284663 | end: 284663
Golden Days’ | start: 284663 | end: 353504
Chapter 6  | start: 353504 | end: 353504
Jia Bao-yu conducts his first experiment in the Art of Love;  | start: 353504 | end: 353504
and Grannie Liu makes her first entry into the  | start: 353504 | end: 353504
Rong-guo mansion | start: 353504 | end: 397518
Chapter 7  | start: 397518 | end: 397518
Zhou Rui’s wife delivers palace flowers and finds Jia  | start: 397518 | end: 397518
Lian pursuing night sports by day;  | start: 397518 | end: 397518
Jia Bao-yu visits the Ning-guo mansion and has an  | start: 397518 | end: 397518
agreeable colloquy with Qin-shi’s brother | start: 397518 | end: 441002
Chapter 8  | start: 441002 | end: 441002
Jia Bao-yu is allowed to see the strangely corresponding  | start: 441002 | end: 441002
golden locket;  | start: 441002 | end: 441002
and Xue Bao-chai has a predestined encounter with the  | start: 441002 | end: 441002
Magic Jade | start: 441002 | end: 481957
Chapter 9  | start: 481957 | end: 481957
A son is admonished and Li Gui receives an alarming  | start: 481957 | end: 481957
warning;  | start: 481957 | end: 481957
a pupil is abused and Tealeaf throws the classroom in an  | start: 481957 | end: 481957
uproar | start: 481957 | end: 517087
Chapter 10  | start: 517087 | end: 517087
Widow Jin’s self-interest gets the better of her righteous  | start: 517087 | end: 517087
indignation;  | start: 517087 | end: 517087
and Doctor Zhang’s diagnosis reveals the origin of a  | start: 517087 | end: 517087
puttgling disease | start: 517087 | end: 547214
Chapter 11  | start: 547214 | end: 547214
Ning-guo House celebrates the birthday of an absent  | start: 547214 | end: 547214
member;  | start: 547214 | end: 547214
and Jia Rui conceives an illicit passion for his  | start: 547214 | end: 547214
attractive cousin | start: 547214 | end: 582453
Chapter 12  | start: 582453 | end: 582453
Wang Xi-feng sets a trap for her admirer;  | start: 582453 | end: 582453
and Jia Rui looks into the wrong side of the mirror | start: 582453 | end: 610365
Chapter 13  | start: 610365 | end: 610365
Qin-shi posthumously acquires the status of a Noble Dame;  | start: 610365 | end: 610365
and Xi-feng takes on the management of a neighbouring  | start: 610365 | end: 610365
establishment | start: 610365 | end: 649286
Chapter 14  | start: 649286 | end: 649286
Lin Ru-hai is conveyed to his last resting-place in  | start: 649286 | end: 649286
Soochow;  | start: 649286 | end: 649286
and Jia Bao-yu is presented to the Prince of Bei-jing  | start: 649286 | end: 649286
at a roadside halt | start: 649286 | end: 690486
Chapter 15  | start: 690486 | end: 690486
At Water-moon Priory Xi-feng finds how much profit  | start: 690486 | end: 690486
may be procured by the abuse of power;  | start: 690486 | end: 690486
and Qin Zhong discovers the pleasures that are to be had  | start: 690486 | end: 690486
under the cover of darkness | start: 690486 | end: 724930
Chapter 16  | start: 724930 | end: 724930
Jia Yuan-chun is selected fur glorious promotion to the  | start: 724930 | end: 724930
Imperial Bedchamber;  | start: 724930 | end: 724930
and Qin Zhong is summoned for premature departure on  | start: 724930 | end: 724930
the Journey into Night | start: 724930 | end: 777241
Chapter 17  | start: 777241 | end: 777241
The inspection of the new garden becomes a test of talent;  | start: 777241 | end: 777241
and Rong-guo House makes itself ready for an important  | start: 777241 | end: 777241
visitor | start: 777241 | end: 849149
Chapter 18  | start: 849149 | end: 849149
A brief family reunion is permitted by the magnanimity  | start: 849149 | end: 849149
of a gracious Emperor;  | start: 849149 | end: 849149
and an Imperial Concubine takes pleasure in the literary  | start: 849149 | end: 849149
progress of a younger brother | start: 849149 | end: 905053
Chapter 19  | start: 905053 | end: 905053
A very earnest young woman offers counsel by night;  | start: 905053 | end: 905053
and a very endearing one is found to be a source of  | start: 905053 | end: 905053
fragrance by day | start: 905053 | end: 968215
Chapter 20  | start: 968215 | end: 968215
Wang Xi-feng castigates a jealous attitude with some  | start: 968215 | end: 968215
forthright speaking;  | start: 968215 | end: 968215
and Lin Dai-yu makes a not unattractive speech  | start: 968215 | end: 968215
impediment the subject of a jest | start: 968215 | end: 1002523
Chapter 21  | start: 1002523 | end: 1002523
Righteous Aroma discovers bow to rebuke ber master by  | start: 1002523 | end: 1002523
saying nothing;  | start: 1002523 | end: 1002523
and artful Patience is able to rescue hers by being somewhat  | start: 1002523 | end: 1002523
less than truthful | start: 1002523 | end: 1046002
Chapter 22  | start: 1046002 | end: 1046002
Bao-ju finds Zen enlightenment in an operatic aria;  | start: 1046002 | end: 1046002
and Jia Zheng sees portents of doom in lantern riddles | start: 1046002 | end: 1098439
Chapter 23  | start: 1098439 | end: 1098439
Words from the ‘Western Chamber’ supply a joke that  | start: 1098439 | end: 1098439
offends;  | start: 1098439 | end: 1098439
and songs from the ‘soul’s Return’ move a tender heart  | start: 1098439 | end: 1098439
to anguish | start: 1098439 | end: 1137563
Chapter 24  | start: 1137563 | end: 1137563
The Drunken Diamond shows nobility of character in  | start: 1137563 | end: 1137563
handling bis money;  | start: 1137563 | end: 1137563
and the Quiet-voiced Girl provides material for fantasy  | start: 1137563 | end: 1137563
by losing her handkerchi  ef | start: 1137563 | end: 1187155
Chapter 25  | start: 1187155 | end: 1187155
Two cousins are subjected by witchcraft to the assaults of  | start: 1187155 | end: 1187155
demons;  | start: 1187155 | end: 1187155
and the Magic Jade meets an old acquaintance while  | start: 1187155 | end: 1187155
rather the worse for wear | start: 1187155 | end: 1234904
Chapter 26  | start: 1234904 | end: 1234904
A conversation on Wasp Waist Bridge is a cover for  | start: 1234904 | end: 1234904
communication of a different kind;  | start: 1234904 | end: 1234904
and a soliloquy overheard in the Naiad’s House reveals  | start: 1234904 | end: 1234904
unsuspected depths of feeling | start: 1234904 | end: 1283872
Appendix | start: 1283872 | end: 1300196
Characters in Volume I | start: 1300196 | end: 1322589
Genealogical Tables | start: 1322589 | end: 1334587
  
Continue building using these chapters? (Y/N) y

Unhandled Exception: System.IO.IOException: The handle is invalid.

   at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
   at System.Console.GetBufferInfo(Boolean throwOnNoConsole, Boolean& succeeded)
   at System.Console.get_CursorTop()
   at XRayBuilder.XRay.expandFromRawML(String rawML)
   at XRayBuilder.Program.Main(String[] args)

07-24-2014, 12:35 PM	#1
pepe_alter_ego Zealot Posts: 121 Karma: 6899 Join Date: Nov 2012 Device: Onyx Boox M92, Kindle Paperwhite 1 (Wi-Fi)	convert book's Index into X-Ray I've got some non-fiction books which are not X-Ray "enabled". Each of them, however, contains a good (Subject and Author) Index. So, I've been thinking that maybe there is a way to convert the existing Index into X-Ray. Any ideas?

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Urgent: How To Convert Wikibook PDF Into a Searchable Index?	deerayolia	Kindle Formats	4	05-28-2012 06:52 AM

07-24-2014, 03:24 PM	#2
Ephemerality Addict Posts: 328 Karma: 800105 Join Date: Feb 2013 Device: PW1	There are 2 tools that exist to create x-ray files for books based on the info on Shelfari (and/or Wikipedia): Command-line xray tool Mjwilson's Calibre Plugin You could certainly build one from that info in the index, but it would be time consuming if it's not already on Shelfari.

07-24-2014, 05:42 PM	#3
pepe_alter_ego Zealot Posts: 121 Karma: 6899 Join Date: Nov 2012 Device: Onyx Boox M92, Kindle Paperwhite 1 (Wi-Fi)	So, I checked two of my non-fiction books on Shelfari and the entries for both of them are very basic / plain (just some description, covers, author). Well, I hoped I could "extract" the Index chapter from such a book and convert it somehow automatically into an X-Ray, but this doesn't seem to be that straightforward. BTW. For one of these books, I noticed an even worse problem. It's "GoTo" -> "Contents" numbers are in "Location" units. There are no "Page Numbers" at all (so you can only "Go To Location", "Go To Page" is not possible). But the (Subject and Author) Index entries contain "Page Numbers" (it just seems to be a direct copy of the paperback version) and no "Locations", so you cannot "click" on an entry in it and go to the place in the book which it references. Does anybody know where / how to report such a problem?

Advert

Advert