[GUI Plugin] Author Book Count Hierarchy

[mariaclaudia]

Hi:
Well, to tell the truth there's someting that make me feel rare.
In your first answer you wrote:

From the OP:
Quote:
6. Calibre > Preferences > Custom Columns > Add Optionally add another new custom column called "abc_abc_hierarchy" with a title of "ABC_ABCH" and with the type "column built from other columns, behaves like tags". The template could either be: {author}.{#abc_hierarchy} or perhaps {#author_book_count}.{author}.{#abc_hierarchy}. Of course, you may customize this template to please yourself. This column is not to be shown. Uncheck it to hide it.

However in the PDF I have, from the plugin of course, this is the text. As you see, there's no "optionally". This make me think about the version.



That's the reason because I created that column. I install the plugin using the user plugins option from Calibre, you know, preferences-plugins-get new plugins and then select Author Book Count Hierarchy (available 1.1.5, released 16 May 2016)

At this moment, this is the configuration of those items in Tweaks..










Yesterday I remove the plugin, and in this moment, I downloaded the plugin from the plugin homepage. After following the installation steps, I proceeded to run the plugin again.

Unfortunately there was no change, still the same problem. By the way, the version of the plugin is 1.1.5, I just check it again.

However I found a light about this issue. I create a new library with the same structure that the main library, and add all the books from Clarin, and another from other author. Then I run ABCH and works fine. In this new library I have only 16 books, but in the main library I have, make sure you're sit, 10,569. Don't ask me why so much, it's long to explain, but there's a good reason for that.

Finally I believe found the problem, at least part. As you see in the capture, some authors have a "," and others "|". If the author name have a "," the problem arises, but whith a "|" no.



I think that the problem is the numbers of books, but, 10,000 is not a big number for Calibre, isn't? I just remember something, at least for this author "Alias Clarin, Leopoldo". By example, in this case the author Mario Vargas Llosa, if I use the "copy author sort to author" option, the name looks "Llosa, Mario Vargas", but the right form is "Vargas Llosa, Mario". So in that case, i select "Vargas" and copy before "Llosa", add a space and then use the "copy author sort to author".

In the case of Vargas Llosa, ABCH works fine, but with Alias Clarin, Leopoldo not. However in both cases, I make the same "operation" about last names and names.

I hope you can decipher the problem

Best regards from Lima, Perú
I hope my grammar are acceptable

Blessings

[DaltonST]

@mariaclaudia:

The bar "|" in the author name column in the authors table is correct when there should be a comma (",") because you have chosen LN,FN (Last Name, First Name) for the author column. The bar tells Calibre that it should display it LN,FN.

"Julio Ramon Ribeyro" displays as "Julio Ramon Ribeyro"

"Ribeyro| Julio Ramon" displays as "Ribeyro, Julio Ramon".

So, what you found in the authors table is interesting.


Please do this:

[1] Install the "Quality Check" plug-in by Kiwidude.

[2] Set "Search Scope" to "Library".

[3] "Check Metadata" > "Check Authors" > "Check Authors Missing Commas".

If it finds them, "fix" them so they are properly LN,FN.

[4] Do the [3] but "Check Authors with Commas". 100% of the books should be selected. This is a double-check on [3].

[5] Run ABCH.

[6] If ABCH is wrong, try this: Copy some of the incorrect books to your new library, deleting them from your big library. Switch to the new library, and copy them back to the big library. Run ABCH. Did it fix them?



DaltonST

[mariaclaudia]

I try the first tips, but nothing. Many authors are only with one word, like Platon, Aristoteles, etc. and the plugin found them like "missing commas". However, the last tip works fine, because I move some books to the new library, deleting them from the main library, run ABCH in the new library and copy them to the main library, then, run again ABCH and looks fine for now.

Now, I have a question: how can I found all the records with the issue? Any suggestions?

[DaltonST]

@mariaclaudia:

Use my Multi-Column Search plug-in to find the incorrect books. See the attached image for settings that will get all of the incorrect books that have a single author for sure, and perhaps some of those with multiple authors too.


DaltonST

[mariaclaudia]

Thanks, but when I start, calibre show me this message:

MCS Criteria Error(s). Search Cancelled.

What I do wrong?

[DaltonST]

@mariaclaudia:

In the first tab on the top right side, the 2 fields say "ERROR: UNSUPPORTED COLUMN NAME". That is the error. It cannot be invalid, even if it is inactive. Put "author" or "title" or any valid column name in both of those fields.

Also, ensure you are on the latest version of MCS, which is 1.0.64.


DaltonST

[DaltonST]

Also, the Final Filter REGEX value should have [ ] not ( ).

It should be: [0-9]+

That caused a REGEX compile error, resulting in the error message you got.


DaltonST

[mariaclaudia]

Yeah!. In more than 10,588 books, I found 2,800 with "the issue". I thought there were more books. Now I copy them to the new library, run ABCH, delete the originals, copy the news, restart Calibre, run ABCH and... when it finish i publish the result, I promise.

[DaltonST]

Por supuesto.

[mariaclaudia]

Well, unfortunately the issue persist, but now only in 259 books. The funny thing is that first I copy them to the new library, then I execute ABCH and works fine, then I load the main library and delete the 259 books, return to the new library and copy all the books to the main library. Then I restart Calibre and execute ABCH and, voila!, the issue came back. Any suggestions?

[DaltonST]

@mariaclaudia:

I think it is because some books with the corrupt author name were possibly left behind in the old library, and contaminated the newly recopied books.

Do this:

[1] Select all the 259 books (only).

[2] Click "E" for Bulk Edit Metadata

[3] Click the checkbox "Swap Author and Title", and save it. It will take a minute since Calibre will have to create new subdirectories for the new "authors" and the new "titles".

[4] Select all of the same 259 books (only).

[5] Click the checkbox "Swap Author and Title", and save it. Ditto about taking a minute for the same reason.

[6] If any are still wrong, you need to select all of the books for each author represented in the incorrect books, change their name from LN,FN to FN,LN, save, then change them back to LN,FN.

That will force Calibre to fix the corruption in the authors table.

The corruption was that instead of having a bar "|" for LN,FN in the author name column, they had a real comma ",". That should not happen except for suffixes, such as ", Jr.". Your books had no suffixes. There was truly a comma instead of a bar.

If you downloaded the new version of ABCH, and look at its Job Log, you will see something new: a corruption detection message. What does your ABCH Job Log say?

By the way, you should perform a Calibre Library Maintenance > Check Library to defragment your metadata.db when you have finally fixed the books.



DaltonST

[mariaclaudia]

Nop, I do all but nothing. This is the log:

Starting job: Author Book Count Hierarchy
================================================== ==
Library path: C:\Users\Romulo\Documents\Biblioteca Calibre
External-to-Calibre SQLite in-memory database is being used
Beginning ABCH for All Books In Library
Calibre metadata.db has been properly attached
C:/Users/Romulo/Documents/Biblioteca Calibre/metadata.db
Custom_Column Configuration Verified
-------------------------------------------------------------------------------------------------------------------------------------
Number of authors with a bar '|' due to a LN,FN format: 2416
Number of authors without a bar '|' but with a comma: 39 This could be correct, such as for a suffix. However, if your #abc_hierarchy is incorrect, then this is likely the cause.
To fix a corrupt author name as described above, simply manually change the author from LN,FN to FN,LN. Save. Then, manually change it back to LN,FN. It should now be fixed.
-------------------------------------------------------------------------------------------------------------------------------------
Temporary Tables Created
Calibre metadata.db has been detached
New ABC Hierarchy Constructed
Calibre metadata.db has been properly attached
C:/Users/Romulo/Documents/Biblioteca Calibre/metadata.db
Custom_Column Tables Populated
================================================== ==
Author Book Count Hierarchy Is Complete
Every book in this library has been updated for ABCH
================================================== ==

I changed manually for a single author with 3 books, execute BATCH but nothing. To tell the truth this is frustrating.
I'm considering remove the plugin and forget this problem

[DaltonST]

@mariaclaudia,

This is not the plug-in's fault. This is corrupt Calibre author data.

The job log proves that there are 39 corrupt authors.

You must select all of the books for all of those 39 corrupt authors.

Easy way to do that: run the MultiColumnSearch as for before, but this time check the checkbox "All Authors" also. It will select all of the books for all of the 39 authors.

Then, do what I said in my previous post about changing the author names, and then changing them back.

Check the ABCH log again. Also, run MCS again to see how many are left.

You could just use ABC instead of ABCH, by the way.


DaltonST

[DaltonST]

@mariaclaudia:

I think you did only [1] thru [5], and not [6].

[6] If any are still wrong, you need to select all of the books for each author represented in the incorrect books, change their name from LN,FN to FN,LN, save, then change them back to LN,FN.

If you had done [6], which means select 100% of the books (good or bad, right or wrong, correct or incorrect) for each and every corrupt author, it would have fixed them. All books for an author must be changed simultaneously.

Changing only the bad books is not enough.



DaltonST

[mariaclaudia]

How can I do it for all the authors? There are 2,485