Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Library Management

Notices

Reply
 
Thread Tools Search this Thread
Old 01-04-2012, 08:52 PM   #1
Kees44
Junior Member
Kees44 began at the beginning.
 
Posts: 3
Karma: 10
Join Date: Jan 2012
Device: Sony T1
Unhappy CSV catalog still fails

I tried all to get a good csv catalog.
One that can be converted (data to colums) in a xls-file.
Title, Author, ISBN, Publisher.
Author (put first in csv) gets NO quotes.
Must be a bug! How/where to report?

Better still would be: Choice of delimiting character when exporting.

And also: Accented characters that are shown correctly in Calibre, show up as 'strange' character-combinations in the csv.
Something wrong with choice of character sets...
Tried everything to convert back; via MSWord, texteditors, no luck.

Suggestions here?
Kees44 is offline   Reply With Quote
Old 01-04-2012, 10:09 PM   #2
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 25,906
Karma: 5035037
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Quotes are only needed if the field contains a comma. The file is encoded in UTF-8. Tell whatever program you are using it to open it in UTF-8.
kovidgoyal is offline   Reply With Quote
 
Enthusiast
Old 01-09-2012, 03:03 PM   #3
Kees44
Junior Member
Kees44 began at the beginning.
 
Posts: 3
Karma: 10
Join Date: Jan 2012
Device: Sony T1
A method found

Kovidgoyal,
Just updated to 8.0.34.
I chose export fields: Author-sort; Title; Publisher; ISBN. (Tried also the no-sort field)
Author-sort comes out first in the CSV, but without quotes (" 's).
This field containes many comma's :-(
Other 3 fields are in quotes.

I use MS-Excel 2002/2003 to import the CSV , to split the fields to columns ("Data to columns") and save in XLS format.

I can specify any printable character, or a tab, in MS-Excel to look for as a delimiter.
So if I could tell Calibre to use a # or ^ or < or ... as delimiter, that would solve the problem.
But I suspect a (simple?!?) omission in Calibre, not putting the first field in quotes.
BTW the first record in the CSV, the header, has no quotes at all.
I have found no way in Excel to convert UTF8 to "normal(?)"
e.g "é" comes out for "é"

>>>>>>>>>>>>>>>>>>>> Stop press <<<<<<<<<<<<<<<
>>>>> SORRY <<<<<<<<< >>>>>>>>>SORRY<<<<<<<<

Just thought of pgm texteditor EditPad: Has Unicode (and more) conversions.
Tried it while making this message.
Turns out: CSV of Calibre HAS quotes around first fields of records
Apparently (stupid) MS-Excel strips those first pair of quotes (why)?!?!
Making it impossible to correctly divide the fields of the records further into cells.
[And: Editpad interprets UTF-8 correctly.]

So - for other readers with MS-Excel - summary:
Calibre export to CSV ("Create catalog ...")
Open CSV in Teksteditor.
Select All in texteditor; Copy.
Open empty Excel-sheet; First cell; Paste.
Then "Text to columns" with " (quote) as delimiter.
[remove columns with , (comma) in them]

See screenshots to clarify my text.
Kovidgoyal, sorry long message, first part WRONG.
I let it in to show you how wrong users can be. Shame on us.
GREAT program, me new user, will be donating, soon as I finish trying out !
btw: delimiter of choice in CSV export still a wish
Thanks
Attached Thumbnails
Click image for larger version

Name:	1_CSV-in-MS-Excel_Problem.jpg
Views:	150
Size:	50.6 KB
ID:	81004   Click image for larger version

Name:	2_CSV-in-Editpad.jpg
Views:	138
Size:	53.4 KB
ID:	81005   Click image for larger version

Name:	3_CSV-via-Editpad-in-MS-Excel.jpg
Views:	124
Size:	46.8 KB
ID:	81006   Click image for larger version

Name:	4_CSV-via-Editpad-in-MS-Excel-Divided-columns.jpg
Views:	132
Size:	53.4 KB
ID:	81007  
Kees44 is offline   Reply With Quote
Old 01-17-2012, 06:52 PM   #4
Kees44
Junior Member
Kees44 began at the beginning.
 
Posts: 3
Karma: 10
Join Date: Jan 2012
Device: Sony T1
Suggestion for Sticky How-To

Kovidgoyal,

My suggestion:
Write in your/Grikers sticky "Creating Catalogs: Start here"
thread as an extra that CSV's are incorrectly handled by MS-Excel.
It strips the first pair of Quotes ("...")

I saw more people like me blaming the Calibre export function.

So: first copy-paste the CSV to a texteditor.
Then Copy-paste the texteditor content to Excel.

Greets, Kees.
Kees44 is offline   Reply With Quote
Old 01-18-2012, 12:05 AM   #5
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 25,906
Karma: 5035037
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Added under known issues.
kovidgoyal is offline   Reply With Quote
Old 03-14-2012, 11:22 AM   #6
koland
Grand Sorcerer
koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.
 
Posts: 7,815
Karma: 5922610
Join Date: Aug 2008
Location: TN, USA
Device: kindle(1/2/3/dx), nook, nookcolr, Sony, Kobo, epic, iphone, iPad, pc
Quote:
Originally Posted by kovidgoyal View Post
Added under known issues.
Kovid,

Can you work on the export to CSV? I've tried several of the latest versions (.20 now on .24, I think) and they all skip the title and title_sort, naming the author field as "author_sort" when imported into a spreadsheet (I can't see anything before "author_sort" in notepad. The title is never exported in the body, either.

I need a searchable format that I can easily use with one line/book - CSV would be ideal, as I can read it in notepad, a spreadsheet, create a PDF, etc, but I can't get it to work. I thought I might be able to get around with with XML, opening in a browser and creating a PDF (not ideal, but doable), but all it does is open a notepad like view of it - can't get it into Open Office calc, either (just write, which is beyond useless).

As a possible future improvement - I'd love to be able to drag the fields around and have them create the file in the order I want, rather than the order listed in the database file.
koland is offline   Reply With Quote
Old 03-14-2012, 12:39 PM   #7
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 25,906
Karma: 5035037
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
I dont see this behavior. You need to make sure your import program knows that the csv file is UTF-8 encoded.
kovidgoyal is offline   Reply With Quote
Old 03-14-2012, 07:46 PM   #8
koland
Grand Sorcerer
koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.
 
Posts: 7,815
Karma: 5922610
Join Date: Aug 2008
Location: TN, USA
Device: kindle(1/2/3/dx), nook, nookcolr, Sony, Kobo, epic, iphone, iPad, pc
I'm just looking at it in notepad. I've also pulled it into OpenOffice.

The title simply isn't there (neither field), despite being checked. The file starts with the author (and the odd character is only see when pulling into OpenOffice).

Is there any way to troubleshoot the catalog creation?
koland is offline   Reply With Quote
Old 03-14-2012, 08:19 PM   #9
koland
Grand Sorcerer
koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.koland ought to be getting tired of karma fortunes by now.
 
Posts: 7,815
Karma: 5922610
Join Date: Aug 2008
Location: TN, USA
Device: kindle(1/2/3/dx), nook, nookcolr, Sony, Kobo, epic, iphone, iPad, pc
BTW, I do have quite a few books, in case that makes a difference....
koland is offline   Reply With Quote
Old 03-14-2012, 10:20 PM   #10
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 25,906
Karma: 5035037
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
The odd character is the UTF-8 BOM. I dont use OpenOffice so I cannot tell you how to get it to recognize that.
kovidgoyal is offline   Reply With Quote
Reply

Tags
problem csv character-set

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
a bug with csv catalog Noughty Library Management 9 10-16-2011 06:07 PM
How to use "catalog CSV/XML" plugin? katsu Library Management 4 10-14-2011 11:07 AM
Big catalog fails... Hougaard Library Management 3 08-14-2011 08:56 PM
Catalog Function Fails With Memory Error Ambermonk Library Management 4 03-08-2010 01:10 PM
Catalog Function Fails With Memory Error Ambermonk Calibre 0 03-07-2010 08:54 PM


All times are GMT -4. The time now is 09:32 PM.


MobileRead.com is a privately owned, operated and funded community.