MobileRead Forums
Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Marvin
Reload this Page Broken support for "soft hyphen" (SHY)

Notices

Reply
Page 1 of 2 1 2
 
Thread Tools Search this Thread
Old 06-21-2016, 02:42 AM   #1
quiris
Groupie
quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'
 
quiris's Avatar
 
Posts: 195
Karma: 42216
Join Date: Oct 2013
Location: Poland
Device: Kindles: KOA1, KV
Broken support for "soft hyphen" (SHY)
Marvin 2 and also the latest 3.0 has broken support for soft hyphens (SHY):

1) It incorrectly selects word if I want for example check a dictionary entry for a specific word. For example if I try to select a word "hippo-potamus" Marvin marks only the first part of the word "hippo" or the second part of the word "potamus". It is an incorrect behavior. Marvin should ignore "soft-hyphen" and select the entire word "hippopotamus".
2) Searching for a specific word in entire book is also broken. Marvin displays no results if I type in a search input box "hippopotamus".

You can check problems in the attached EPUB book.
Attached Files
File Type: epub Tadeusz Dolega-Mostowicz - Pamietnik pani Hanki_moh.epub (1.16 MB, 676 views)
Last edited by quiris; 06-21-2016 at 05:57 AM.
quiris is offline   Reply With Quote
Old 06-21-2016, 05:54 AM   #2
kguil
Addict
kguil ought to be getting tired of karma fortunes by now.kguil ought to be getting tired of karma fortunes by now.kguil ought to be getting tired of karma fortunes by now.kguil ought to be getting tired of karma fortunes by now.kguil ought to be getting tired of karma fortunes by now.kguil ought to be getting tired of karma fortunes by now.kguil ought to be getting tired of karma fortunes by now.kguil ought to be getting tired of karma fortunes by now.kguil ought to be getting tired of karma fortunes by now.kguil ought to be getting tired of karma fortunes by now.kguil ought to be getting tired of karma fortunes by now.
 
kguil's Avatar
 
Posts: 1,215
Karma: 1836966
Join Date: Feb 2010
Location: Malta, Europe
Device: Marvin for iOS
@quiris Thanks for the report. I'll look into it.
kguil is offline   Reply With Quote
Old 06-21-2016, 06:06 AM   #3
kguil
Addict
kguil ought to be getting tired of karma fortunes by now.kguil ought to be getting tired of karma fortunes by now.kguil ought to be getting tired of karma fortunes by now.kguil ought to be getting tired of karma fortunes by now.kguil ought to be getting tired of karma fortunes by now.kguil ought to be getting tired of karma fortunes by now.kguil ought to be getting tired of karma fortunes by now.kguil ought to be getting tired of karma fortunes by now.kguil ought to be getting tired of karma fortunes by now.kguil ought to be getting tired of karma fortunes by now.kguil ought to be getting tired of karma fortunes by now.
 
kguil's Avatar
 
Posts: 1,215
Karma: 1836966
Join Date: Feb 2010
Location: Malta, Europe
Device: Marvin for iOS
@quiris - I can confirm that (1) is occurring here too (I'll try and fix this), but (2) seems to be working well. Can you give me a specific example in the book you posted so I can test it?
kguil is offline   Reply With Quote
Old 06-21-2016, 06:18 AM   #4
quiris
Groupie
quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'
 
quiris's Avatar
 
Posts: 195
Karma: 42216
Join Date: Oct 2013
Location: Poland
Device: Kindles: KOA1, KV
To replicate bug (2) you have to type searched word. If you copy and paste the word from a book into a search input box Marvin displays the results because iOS copies also a hidden SHY marks.

1) From Tools menu choose "Search" option.
2) Type into a search input box "Hanki" and click "Search" button on keyboard.
Last edited by quiris; 06-21-2016 at 06:36 AM.
quiris is offline   Reply With Quote
Old 06-22-2016, 08:03 AM   #5
quiris
Groupie
quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'
 
quiris's Avatar
 
Posts: 195
Karma: 42216
Join Date: Oct 2013
Location: Poland
Device: Kindles: KOA1, KV
Another probably SHY related bug. Check attached screenshots. The problem is visible with Bitter font and sideloaded Literata font.
Attached Thumbnails
Click image for larger version Name: IMG_1357.PNG Views: 585 Size: 264.1 KB ID: 149579   Click image for larger version Name: IMG_1355.PNG Views: 572 Size: 277.7 KB ID: 149580   Click image for larger version Name: IMG_1354.PNG Views: 590 Size: 280.7 KB ID: 149581   Click image for larger version Name: IMG_1353.PNG Views: 572 Size: 245.6 KB ID: 149582  
Last edited by quiris; 06-22-2016 at 08:05 AM.
quiris is offline   Reply With Quote
Old 07-05-2016, 03:17 AM   #6
quiris
Groupie
quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'
 
quiris's Avatar
 
Posts: 195
Karma: 42216
Join Date: Oct 2013
Location: Poland
Device: Kindles: KOA1, KV
Any progress in this matter?
quiris is offline   Reply With Quote
Old 07-05-2016, 05:23 AM   #7
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 80,677
Karma: 150249619
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
The thing is, Marvin supports hyphenation. There is no need for soft hyphens in ePub.
JSWolf is offline   Reply With Quote
Old 07-05-2016, 05:33 AM   #8
quiris
Groupie
quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'
 
quiris's Avatar
 
Posts: 195
Karma: 42216
Join Date: Oct 2013
Location: Poland
Device: Kindles: KOA1, KV
Quote:
Originally Posted by JSWolf View Post
The thing is, Marvin supports hyphenation. There is no need for soft hyphens in ePub.
Marvin supports hyphenation for a small number of languages already supported by iOS. Polish language isn't supported actually. So proper support for SOFT-HYPHEN is important to me. In my opinion the best support for SOFT-HYPHEN is in Kindle. I wish to get similar experience in Marvin.

PS. According Apple docs hyphenation data is available only for certain languages, currently English (US and GB), French, German, Italian, Spanish, Dutch, and Russian.
Last edited by quiris; 07-05-2016 at 05:37 AM.
quiris is offline   Reply With Quote
Old 07-05-2016, 05:35 AM   #9
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 80,677
Karma: 150249619
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
Quote:
Originally Posted by quiris View Post
Marvin supports hyphenation for a small number of languages already supported by iOS. Polish language isn't supported actually. So proper support for SOFT-HYPHEN is important to me. In my opinion the best support for SOFT-HYPHEN is in Kindle. I wish to get similar experience in Marvin.
I agree that the Kindle does have very good soft-hyphen support.
JSWolf is offline   Reply With Quote
Old 07-05-2016, 05:50 AM   #10
quiris
Groupie
quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'
 
quiris's Avatar
 
Posts: 195
Karma: 42216
Join Date: Oct 2013
Location: Poland
Device: Kindles: KOA1, KV
Standard HTML4 on this subject:

Quote:
In HTML, there are two types of hyphens: the plain hyphen and the soft hyphen. The plain hyphen should be interpreted by a user agent as just another character. The soft hyphen tells the user agent where a line break can occur. Those browsers that interpret soft hyphens must observe the following semantics. If a line is broken at a soft hyphen, a hyphen character must be displayed at the end of the first line. If a line is not broken at a soft hyphen, the user agent must not display a hyphen character. For operations such as searching and sorting, the soft hyphen should always be ignored.
http://www.w3.org/TR/html401/struct/text.html#h-9.3.3

RFC 2070 - Internationalization of the Hypertext Markup Language on this matter: http://www.faqs.org/rfcs/rfc2070.html

Quote:
NOTE - the soft hyphen character (U+00AD) needs special attention from user-agent implementers. It is present in many character sets (including the whole ISO 8859 series and, of course, ISO 10646), and can always be included by means of the reference *. Its semantics are different from the plain hyphen: it indicates a point in a word where a line break is allowed. If the line is indeed broken there, a hyphen must be displayed at the end of the first line. If not, the character is not displayed at all. In operations like searching and sorting, it must always be ignored.
Last edited by quiris; 07-05-2016 at 06:17 AM.
quiris is offline   Reply With Quote
Old 07-05-2016, 11:26 AM   #11
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 80,677
Karma: 150249619
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
ePub does not use HTML4.
JSWolf is offline   Reply With Quote
Old 07-05-2016, 12:10 PM   #12
quiris
Groupie
quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'
 
quiris's Avatar
 
Posts: 195
Karma: 42216
Join Date: Oct 2013
Location: Poland
Device: Kindles: KOA1, KV
Quote:
Originally Posted by JSWolf View Post
ePub does not use HTML4.
Sure, it uses XHTML which is based on HTML4:
Quote:
XHTML is a family of current and future document types and modules that reproduce, subset, and extend HTML 4.
http://www.w3.org/TR/xhtml1/#xhtml
Last edited by quiris; 07-05-2016 at 12:38 PM.
quiris is offline   Reply With Quote
Old 07-05-2016, 01:29 PM   #13
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 80,677
Karma: 150249619
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
Soft hyphens are not part of the ePub standard. So any program not supporting soft hyphens with ePub is not breaking any rules.
JSWolf is offline   Reply With Quote
Old 07-06-2016, 03:13 AM   #14
quiris
Groupie
quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'quiris understands when you whisper 'The dog barks at midnight.'
 
quiris's Avatar
 
Posts: 195
Karma: 42216
Join Date: Oct 2013
Location: Poland
Device: Kindles: KOA1, KV
Quote:
Originally Posted by JSWolf View Post
Soft hyphens are not part of the ePub standard. So any program not supporting soft hyphens with ePub is not breaking any rules.
Are you serious? Let's see...

http://www.idpf.org/epub/30/spec/epu...relations-html
Quote:
1.2.1 Relationship to HTML5

The XHTML document type defined by this specification is based on W3C [HTML5], and inherits all definitions of semantics, structure and processing behaviors from the HTML5 specification unless otherwise specified.
http://www.w3.org/TR/html5-diff/

Quote:
"HTML5 Differences from HTML4" describes the differences of the HTML5 specification from those of HTML4.

1.4 Backward Compatibility

HTML is defined in a way that is backward compatible with the way user agents handle content. To keep the language relatively simple for Web developers, several older elements and attributes are not included, as outlined in the other sections of this document, such as presentational elements that are better handled using CSS.

User agents, however, will always have to support these older elements and attributes. This is why the HTML specification clearly separates requirements for Web developers (referred to as "authors" in the specification) and user agents; for instance, this means that Web developers cannot use the isindex or the plaintext element, but user agents are required to support them in a way that is compatible with how these elements need to behave for compatibility with Web content.
Moreover - SOFT-HYPHEN is part of Unicode standard and must be supported by user agents: http://www.idpf.org/epub/30/spec/epu...ml#refUnicode5
Last edited by quiris; 07-06-2016 at 03:26 AM.
quiris is offline   Reply With Quote
Old 07-06-2016, 05:28 PM   #15
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 80,677
Karma: 150249619
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
Quote:
Originally Posted by quiris View Post
And Marvin is for ePub 2. So your soft hyphens are not part of the ePub 2 spec.
JSWolf is offline   Reply With Quote
Reply
Page 1 of 2 1 2

« Previous Thread | Next Thread »
Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Recipes of "Berliner Zeitung" and "Tagesspiegel" broken axlben Recipes 2 04-29-2016 04:52 AM
Soft Hyphen lhuxley Editor 3 03-23-2015 08:02 PM
Soft hyphen Kumabjorn Writers' Corner 32 07-13-2014 12:00 AM
PRS-600 Touchscreen "soft" spot fugue Sony Reader 6 01-16-2010 01:20 AM


All times are GMT -4. The time now is 01:51 AM.

Contact Us - FAQ - Guidelines - Privacy - Top

MobileRead.com is a privately owned, operated and funded community.