[GUI Plugin] QuarantineAndScrub

[DaltonST]

Great in theory, but does not apply to this specific plugin. This plugin is targeted at a very specific user base. I bet you are not even a user of this plugin, nor need to be. If you were, you would intuitively understand the benefit of PMs in this very specific context.

Some people will send a PM with no hesitation, but will not post the identical message so the people with nothing better to do with their time can make random comments about their posts that add no value.

Those are the reasons why. It has worked beautifully. I get only constructive PMs that require no response by me, and can be used to enhance the plugin functionality and/or enhance the 11-page (so far) user instructions.

Win-Win.


DaltonST

[DaltonST]

New version: Version 1.5.5 - 11 October 2014 New Scrubbing Rules

[DaltonST]

New release. Version 1.5.6 - 12 October 2014 New Functions and Features; New Scrubbing Rules

New menu action item to delete all non-ISBN identifiers for selected books. No more painful and repetitive search/replace to nothingness via bulk metadata editing.

New menu action item to copy the "real" author to the pristine author table for selected books. This is to facilitate making a valid author available immediately for scrubbing validation of authors without importing (again) all pristine authors from your pristine library after first moving your now-clean books with now-clean authors to your pristine library.

Thank you for your PM'd suggestions and test data. Very useful.


DaltonST

[DaltonST]

New release: Version 1.5.7 - 13 October 2014 New Scrubbing Rules

[DaltonST]

Version 1.5.9 - 14 October 2014 New Scrubbing Rules


The Q&S Test Library now consists of 610 different test cases (610 contentless ebooks) for different types of malformed, misplaced, bogus and/or garbage author/title/series/series index/tags and ISBNs. This version, 1.5.9, fixes all of them. Thank you for your PMs with your problem metadata. All the scenarios/patterns that I have received so far have been fixed as of now.

I am looking forward to receiving more of your "favorite" trashed out metadata.




DaltonST

[DaltonST]

Version 1.6.0 - 15 October 2014 New "Tags To Purge When Found" Table; Revised Instructions; New Scrubbing Rules


Remember to always run the "After Version Upgrade: Create New SQLite Objects" job after every version upgrade. Otherwise, other jobs might fail due to "table or view not found" types of fatal database errors.



DaltonST

[DaltonST]

Version 1.6.1 - 17 October 2014 New Scrubbing Rules


Remember to always run the "After Version Upgrade: Create New SQLite Objects" job.


New users (only) must also download the .jar file (that is really a .zip file) from the original post, and follow the user instructions.



DaltonST

[DaltonST]

Released: Version 1.6.2 - 18 October 2014 New Scrubbing Rules; New Global Authors for Validation


As always, run the "After Upgrade" job first thing. It will also add new Global Authors that were sourced from the top 100 bestselling authors as of this morning at Amazon (they get updated hourly by Amazon). That brings the total number of Global Authors available to this plugin to 14,316 or thereabouts. The number of your personal Pristine Authors is solely based on the number you imported into Q&S from your Pristine Library.


Remember to always standardize your Q&S Author Names to FIRSTNAME LASTNAME and their initials to the format of A.B. Smith so that validation can be maximized. After scrubbing, the formats can be changed to whatever you wish prior to moving the books to your Pristine Library.


DaltonST

[DaltonST]

New Release: Version 1.6.3 - 20 October 2014 New Scrubbing Rules; Revised Instructions; and bug fixes.

[stanking]

Shouldn't about 20 of these posts just be a changelog in a spoiler link on the original post?

[eschwartz]

Originally Posted by stanking

Shouldn't about 20 of these posts just be a changelog in a spoiler link on the original post?

While I do admit to some amusement at how many updates one plugin gets in such a short time it is fairly common to make a post with the update as well as using the changelog. And people subscribed to the thread will receive a notification.

Do not worry about what someone else posts in their own thread unless it impacts you.

(At least he isn't making a new thread about the update. )
(There is someone who posts dozens of new threads a day in the deals forum. In case you were wondering what I meant.)

[DaltonST]

Originally Posted by eschwartz

While I do admit to some amusement at how many updates one plugin gets in such a short time...

I frequently receive examples of problematic metadata (misplaced or malformed author, title, series, series index, tags, ISBN) attached to PMs that my user base sends me. I analyze them, add/change Scrubbing Rules as necessary, and issue a new release. Hence, the frequency of new releases is directly proportional to the frequency of new problematic metadata examples that I receive from my users.

This is an add-on with a plugin for its user interface. In no way can it be compared to "normal" plugins that use standard Calibre and rarely need updates because what they do is rather static. This add-on is the opposite of static, which is reflected in its update frequency.

I also update it periodically for new authors found on Amazon and Wikipedia, which are used to sniff out author names that are not where they belong in the metadata. The add-on already has over 16,000 global author names, and I am working on another 3,000 that I will include in an upcoming new release.

In summary, my hard-core users are not amused by, but rather thankful for, the frequent releases. Even so, I am happy that my add-on can provide some amusement to brighten the day of others.

Best wishes,


DaltonST

[eschwartz]

Perhaps it is possible to be both amused and appreciative of your hard work.

Although I do wonder whether it might be more efficient to unbundle the rulesets and have the plugin download the updated rules at runtime.

[DaltonST]

Version 1.6.4 - 22 October 2014 Additional Global Authors; Improvements in Copying Work Tags to Real Tags; and bug fixes.


Remember to run the "After Upgrade" job first thing after upgrading to any new release. It will add new Global Authors, new tables and new views whenever needed.

[DaltonST]

Version 2.0.0 - 24 October 2014 New User-Maintained (via a GUI) "Tag Rules Table" that can use regex to scrub (change or delete) tags. GUI is by http://sqlitebrowser.org/ that is designed for frequent end-user table maintenance.

Release 2.0.0 now includes full Tag Scrubber functionality. It provides an end-user SQLite table called "_tag_rules" that allows changes and deletions of Work Tags using vanilla simple matches by tag, or using complex Regular Expressions to match to Work Tags and then to either change them or to delete them.

Example: a regex of /sci.*[f][iy].*/ is pre-provided as a rule to cause any matching Work Tag (e.g. scifi, scify, science fiction, SCI FY, etc.) to be changed to a standardized "Fiction:Science". Since the table rules are maintained by end-users, the rule could easily be changed to output "Science Fiction" (or anything else) instead of "Fiction:Science".

The end-user tool for this table maintenance is QT-based "DB Browser for SQLite" from http://sqlitebrowser.org/ . Free. Easy and efficient to use for routine end-user SQLite table maintenance, and is much easier to use for high-volume end-user table changes than the SQLite Manager tool that is an add-in to Firefox.

Refer to the revised User Instructions both attached to the Original Post and available as a menu item within the plugin itself.

Remember to always run the "Update Version" job on the menu after upgrading to any new version of Q&S.


DaltonST