Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 08-03-2014, 05:11 PM   #616
Vortex
Connoisseur
Vortex began at the beginning.
 
Posts: 81
Karma: 10
Join Date: Dec 2008
Device: Panasonic Toughbook CF18 + uBook
They're what's left after sorting and cleaning a huge ebook collection, nearly all old formats like txt, html, rar, rft, doc, so have no metadata other than what Calibre tried to glean from the file names.

Try a random text search in Google books or Amazon, you'll be really surprised how accurate they are, there's no need for fancy AI. Here's an example:

https://www.google.com/search?tbo=p&...=10&gws_rd=ssl

The best google books search page is this one: http://books.google.com/advanced_book_search paste the random text from your unknown book into the 'Exact Phrase' box and search.

For Amazon the best search page is: http://www.amazon.com/Advanced-Searc...node=241582011 paste your random text (inside quotation marks) into the 'Keywords' box and search.

This same technique can also be used in Bookfinder: http://www.bookfinder.com/?mode=adva...=&currency=EUR

Could this not be automated the same as the search for Metadata and Covers?
Vortex is offline   Reply With Quote
Old 08-03-2014, 06:35 PM   #617
BetterRed
null operator
BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.
 
Posts: 3,624
Karma: 2183656
Join Date: Mar 2012
Location: NSW Australia
Device: none
@Vortex If you chose the text on which to search then it's highly likely that its not truly random - you would have used your intuitive good sense. I noticed your example used a complete sentence. I tried a fragment of 9 words from Bleak House and Google failed, when I expanded it to a complete sentence it succeeded.

I suspect a PI with some heuristics to extract the first sentence would probably have a pretty good chance of finding books at Google.

The Amazon and Bookfinder links did not present me with a place to enter a sentence.

BR

Last edited by BetterRed; 08-03-2014 at 06:38 PM.
BetterRed is online now   Reply With Quote
 
Enthusiast
Old 08-03-2014, 09:21 PM   #618
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 37,707
Karma: 18475502
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Sony Reader PRS-650, iPad, nook STR
Quote:
Originally Posted by Vortex View Post
They're what's left after sorting and cleaning a huge ebook collection, nearly all old formats like txt, html, rar, rft, doc, so have no metadata other than what Calibre tried to glean from the file names.
I have never seen legal eBooks with no usable metadata. This random collection sounds fishy to me. Are these in fact legal eBooks?
JSWolf is offline   Reply With Quote
Old 08-03-2014, 10:50 PM   #619
DoctorOhh
US Navy, Retired
DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.
 
DoctorOhh's Avatar
 
Posts: 8,861
Karma: 12755553
Join Date: Feb 2009
Location: North Carolina
Device: Nexus 7
Quote:
Originally Posted by JSWolf View Post
Quote:
Originally Posted by Vortex View Post
They're what's left after sorting and cleaning a huge ebook collection, nearly all old formats like txt, html, rar, rft, doc, so have no metadata other than what Calibre tried to glean from the file names.
I have never seen legal eBooks with no usable metadata. This random collection sounds fishy to me. Are these in fact legal eBooks?
I was wondering this too, but since Mobileread isn't a place to talk about cleaning up or editing illegal books I'm sure his collection is legit.
DoctorOhh is offline   Reply With Quote
Old 08-04-2014, 01:54 PM   #620
Vortex
Connoisseur
Vortex began at the beginning.
 
Posts: 81
Karma: 10
Join Date: Dec 2008
Device: Panasonic Toughbook CF18 + uBook
Quote:
Originally Posted by BetterRed View Post
@Vortex If you chose the text on which to search then it's highly likely that its not truly random - you would have used your intuitive good sense. I noticed your example used a complete sentence. I tried a fragment of 9 words from Bleak House and Google failed, when I expanded it to a complete sentence it succeeded.

I suspect a PI with some heuristics to extract the first sentence would probably have a pretty good chance of finding books at Google.
BR
Longer sentences are more successful. Shouldn't be to difficult to automate picking a random sentence of a minimum length. I found the first sentence isn't the best to use because it is often quoted in other places which can make the results confusing, also how would a program know what's the first sentence, many books have other stuff like reviews for the authors other books at the beginning.

Quote:
Originally Posted by BetterRed View Post
@Vortex
The Amazon and Bookfinder links did not present me with a place to enter a sentence.
Quote:
Originally Posted by Vortex View Post
For Amazon the best search page is: http://www.amazon.com/Advanced-Searc...node=241582011 paste your random text (inside quotation marks) into the 'Keywords' box and search.

This same technique can also be used in Bookfinder: http://www.bookfinder.com/?mode=adva...=&currency=EUR
Vortex is offline   Reply With Quote
Old 08-04-2014, 07:33 PM   #621
BetterRed
null operator
BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.
 
Posts: 3,624
Karma: 2183656
Join Date: Mar 2012
Location: NSW Australia
Device: none
Quote:
Originally Posted by Vortex View Post
Longer sentences are more successful. Shouldn't be to difficult to automate picking a random sentence of a minimum length. I found the first sentence isn't the best to use because it is often quoted in other places which can make the results confusing, also how would a program know what's the first sentence, many books have other stuff like reviews for the authors other books at the beginning.
Maybe a two step process. First step would find a sentence based on 'bullt-in' heuristics and some configuration settings, it would put the selected sentences in a custom text column. User would 'examine' the selected sentences to see if they 'pass muster', if not then user can cut and paste a manually selected sentence. Second step would use the sentence to do the search.

my bad, I missed the '(inside quotation marks)'

BR

Last edited by BetterRed; 08-04-2014 at 08:06 PM.
BetterRed is online now   Reply With Quote
Old 08-04-2014, 07:44 PM   #622
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 37,707
Karma: 18475502
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Sony Reader PRS-650, iPad, nook STR
Quote:
Originally Posted by DoctorOhh View Post
I was wondering this too, but since Mobileread isn't a place to talk about cleaning up or editing illegal books I'm sure his collection is legit.
Could be, but when it feels suspicious, I want to know if it is legal or not.


Vortex, is this collection of eBooks legal?
JSWolf is offline   Reply With Quote
Old 08-05-2014, 01:15 PM   #623
DNSB
Bibliophagist
DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.
 
DNSB's Avatar
 
Posts: 2,240
Karma: 6127887
Join Date: Jul 2010
Location: Vancouver
Device: Kobo Aura HD, Glo, Nexus 7 HD, iPad Air
Quote:
Originally Posted by JSWolf View Post
I have never seen legal eBooks with no usable metadata. This random collection sounds fishy to me. Are these in fact legal eBooks?
Yes. Back in the bad old days, I collected quite a few legal ebooks in .txt and .rtf format. Neither of those formats has any place to store metadata. You also ran into artifacts in the .txt ebooks such as using _word_ to indicate an italicized word which looked a bit odd when displayed on your screen.

I also had some older .epub ebooks which did not include metadata but are legally obtained.

Regards,
David
DNSB is offline   Reply With Quote
Old 08-05-2014, 06:22 PM   #624
BetterRed
null operator
BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.
 
Posts: 3,624
Karma: 2183656
Join Date: Mar 2012
Location: NSW Australia
Device: none
Quote:
Originally Posted by JSWolf View Post
Could be, but when it feels suspicious, I want to know if it is legal or not.

Vortex, is this collection of eBooks legal?
@JSWolf - In most (all ?) liberal democracies the onus of proof is placed on the prosecutor in the case of criminal matters, and on the plaintiff in the case of civil matters.

Your accusatory tone might be seen as defamatory/libellous, and in many liberal democracies that can be unlawful.

BR

Last edited by BetterRed; 08-05-2014 at 06:50 PM.
BetterRed is online now   Reply With Quote
Old 08-08-2014, 04:29 PM   #625
ymmv
Member
ymmv can name that song in three notesymmv can name that song in three notesymmv can name that song in three notesymmv can name that song in three notesymmv can name that song in three notesymmv can name that song in three notesymmv can name that song in three notesymmv can name that song in three notesymmv can name that song in three notesymmv can name that song in three notesymmv can name that song in three notes
 
Posts: 21
Karma: 24736
Join Date: Aug 2013
Device: Sony PRS-T1
Quote:
Originally Posted by JSWolf View Post
I have never seen legal eBooks with no usable metadata. This random collection sounds fishy to me. Are these in fact legal eBooks?
I've downloaded thousands of short stories from Usenet and the web that were 100% legal. I bet you've never been to sites where amateur authors upload fan fiction. The amount of free material offered there is absolutely staggering. And yes, almost everything in those days was in TXT, HTML and sometimes RTF/DOC. A site I used to visit currently has close to 25,000 free stories, all written by amateur authors, all free, 100% legal.
ymmv is offline   Reply With Quote
Old 08-10-2014, 09:26 PM   #626
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 37,707
Karma: 18475502
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Sony Reader PRS-650, iPad, nook STR
The reason I ask is because in a lot of cases, a collection like what was described would not be legal and the user would be asking for help with it even though it's not legal. I ask so I know it's legal and if I can help, I will. But as we've not had an answer from the OP, I'll wait until the OP replies.
JSWolf is offline   Reply With Quote
Old 08-10-2014, 09:40 PM   #627
eschwartz
Irrational Optimist
eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.
 
Posts: 6,538
Karma: 10990232
Join Date: Nov 2012
Location: The Beaten Path, USA, Roundworld, This Side of Infinity
Device: Kindle Touch fw5.3.7 (Wifi only)
Quote:
Originally Posted by JSWolf View Post
The reason I ask is because in a lot of cases, a collection like what was described would not be legal and the user would be asking for help with it even though it's not legal. I ask so I know it's legal and if I can help, I will. But as we've not had an answer from the OP, I'll wait until the OP replies.
Sure -- just so long as you understand that what you are doing is known as "guilty until proven innocent".

Also, I hope you troll MobileRead asking people if they will distribute books illegally before advising them to seek Apprentice Alf.
eschwartz is offline   Reply With Quote
Old 08-10-2014, 09:57 PM   #628
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 37,707
Karma: 18475502
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Sony Reader PRS-650, iPad, nook STR
Quote:
Originally Posted by eschwartz View Post
Sure -- just so long as you understand that what you are doing is known as "guilty until proven innocent".

Also, I hope you troll MobileRead asking people if they will distribute books illegally before advising them to seek Apprentice Alf.
When there is possible evidence of wrongdoing, there's no harm in asking.
JSWolf is offline   Reply With Quote
Old 08-10-2014, 11:35 PM   #629
theducks
Grand Sorcerer
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 14,870
Karma: 5654321
Join Date: Aug 2009
Location: (The original) Silicon Valley, USA
Device: Galaxy Tab 2, Astak Pocket Pro, K4NT
Quote:
Originally Posted by JSWolf View Post
When there is possible evidence of wrongdoing, there's no harm in asking.
There is no evidence.

There is suspicion based upon stated quantity.
That is not proof.

The two are Way...Way different.
theducks is offline   Reply With Quote
Old 08-22-2014, 07:58 PM   #630
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 37,707
Karma: 18475502
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Sony Reader PRS-650, iPad, nook STR
Quote:
Originally Posted by theducks View Post
There is no evidence.

There is suspicion based upon stated quantity.
That is not proof.

The two are Way...Way different.
My experience is proof enough. I'd rather ask and get an answer that all is well then risk helping someone that might be asking about illegal eBooks.
JSWolf is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
PRS-505 Any ideas what this might be? Neupy Sony Reader 4 07-03-2012 07:19 AM
New Plugin Type Idea: Library Plugin cgranade Plugins 3 09-15-2010 12:11 PM
Ideas? mike_bike_kite Which one should I buy? 10 06-13-2010 03:37 PM
Ideas F1Wild Amazon Kindle 4 07-10-2009 06:01 AM


All times are GMT -4. The time now is 06:49 PM.


MobileRead.com is a privately owned, operated and funded community.