what is the transliteration map for non-ascii names and titles

zubzero · 06-08-2020, 07:05 AM

Is there any documentation on this? One of the reasons I need the transliteration map file is to compare my export library (saved in original Arabic) with Calibre's base library (saved in not so great a transliteration, if you don't mind me saying).

It's clear the transliteration to ascii has to happen, and I guess they have to be one to one mappings, but are the particular mapping choices set in stone or can we work on making them make more sense for Arabic unicode.

fyi:
I am working on a tool to romanizes Arabic records into standards such as the Library of Congress standard, the ISO standard, and so on, which is how many libraries store their Arabic collections, sometimes even losing the link to the original Arabic records and keepings just the romanization. I'd be curious to know if anyone is interested in incorporating such a conversion tool into calibre. something that would make all naming variations easily retrievable.

kovidgoyal · 06-08-2020, 07:46 AM

Feel free to submit improvements, looking in unihandecode in the calibre source.

06-08-2020, 07:05 AM	#1
zubzero Junior Member Posts: 1 Karma: 10 Join Date: Jun 2020 Device: boox note pro	what is the transliteration map for non-ascii names and titles Is there any documentation on this? One of the reasons I need the transliteration map file is to compare my export library (saved in original Arabic) with Calibre's base library (saved in not so great a transliteration, if you don't mind me saying). It's clear the transliteration to ascii has to happen, and I guess they have to be one to one mappings, but are the particular mapping choices set in stone or can we work on making them make more sense for Arabic unicode. fyi: I am working on a tool to romanizes Arabic records into standards such as the Library of Congress standard, the ISO standard, and so on, which is how many libraries store their Arabic collections, sometimes even losing the link to the original Arabic records and keepings just the romanization. I'd be curious to know if anyone is interested in incorporating such a conversion tool into calibre. something that would make all naming variations easily retrievable.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Non-ASCII File Names	Hopkins	Editor	5	01-18-2018 08:02 AM
Series names in titles	bethohio3	Library Management	30	11-16-2014 03:21 PM
Non-ASCII characters in recipe titles show as Ã¼	bubak	Recipes	2	11-30-2011 07:49 AM
transliteration in file&directory names	vadim_k	Calibre	4	11-14-2011 07:04 AM
ASCII transliteration problems (spanish)	efejota	Calibre	3	06-25-2010 09:25 AM

06-08-2020, 07:46 AM	#2
kovidgoyal creator of calibre Posts: 43,879 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Feel free to submit improvements, looking in unihandecode in the calibre source.