Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 02-19-2018, 12:01 PM   #2611
theit8514
Junior Member
theit8514 began at the beginning.
 
Posts: 2
Karma: 10
Join Date: Jun 2017
Device: none
Is there a known issue with unicode and Windows? I am running into a problem with post_process_cmd on Windows with titles that contain unicode characters.

For example, the title on https://archiveofourown.org/works/300125 is En Flambé, but when it comes out of post_process_cmd it appears as En Flambé. Windows runs into problems passing this value around, otherwise I wouldn't care too much and just change it in Calibre.

Is there a setting to change to allow this to work properly? I tried changing the website_encodings around without any success.

Thanks!
theit8514 is offline   Reply With Quote
Advert
Old 02-19-2018, 12:51 PM   #2612
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,294
Karma: 589194
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Quote:
Originally Posted by theit8514 View Post
Is there a known issue with unicode and Windows? I am running into a problem with post_process_cmd on Windows with titles that contain unicode characters.
Unicode issues get very messy very quickly. What works on one OS frequently breaks on another. And the settings for each individual user (and sometimes individual window) can make a difference.

The post_process_safepattern personal.ini setting is specifically for helping work around those issues by replacing anything that matches in any metadata entries with '_'. The example given is defaults.ini is:

Code:
post_process_safepattern:(^\.|/\.|[^a-zA-Z0-9_\. \[\]\(\)&'-]+)
This solution is rather English-language-centric and brute force, but I don't generally have OSes configured in other languages available to test with.
JimmXinu is offline   Reply With Quote
Old 02-22-2018, 06:19 PM   #2613
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,294
Karma: 589194
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
New Test Version Posted

2018-02-22
- Make Get URLs from Page work better with TtH is_adult.
JimmXinu is offline   Reply With Quote
Old 02-23-2018, 07:47 AM   #2614
Tharos
Member
Tharos began at the beginning.
 
Posts: 18
Karma: 10
Join Date: Jul 2010
Device: Kindle Oasis 2, Moon+ Reader pro
If I see it correctly, FFF use the ID url:https://www.fanfiction.net/s/12307781/1/ in the metadata. Is it possible to use a different ID? For example calibre:https://www.fanfiction.net/s/12307781/1/? or fff:https://www.fanfiction.net/s/12307781/1/?

I use as ID for example already mal: wiki: isbn: aS: reddit:

Last edited by Tharos; 02-23-2018 at 07:47 AM. Reason: new url
Tharos is offline   Reply With Quote
Old 02-23-2018, 08:45 AM   #2615
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,294
Karma: 589194
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Quote:
Originally Posted by Tharos View Post
If I see it correctly, FFF use the ID url:https://www.fanfiction.net/s/12307781/1/ in the metadata. Is it possible to use a different ID? For example calibre:https://www.fanfiction.net/s/12307781/1/? or fff:https://www.fanfiction.net/s/12307781/1/?

I use as ID for example already mal: wiki: isbn: aS: reddit:
(Emphasis added.)

The FFF code as it is written today is hard coded to use identifier url:. (It also looks for uri: because calibre used to prefer that years ago.)

In theory, I suppose FFF could be made to configurably use a different identifier tag, but I don't really see the point to it--the story URL is the definitive URL for where that story came from.
JimmXinu is offline   Reply With Quote
Old 02-23-2018, 10:05 AM   #2616
Tharos
Member
Tharos began at the beginning.
 
Posts: 18
Karma: 10
Join Date: Jul 2010
Device: Kindle Oasis 2, Moon+ Reader pro
A really hard point does not exist. Maybe a small example of my IDs says more:
Code:
no:https://www.novelupdates.com/series/a-story-name
gt:http://gravitytales.com/novel/a-story-name
url:http://lightnovelgate.com/novel/a-story-name
db:http://lndb.info/light_novel/a-story-name
rln:https://www.readlightnovel.org/a-story-name
In the end, it was just an idea to make it a little easier for me.
Tharos is offline   Reply With Quote
Old 02-23-2018, 07:36 PM   #2617
davidfor
Grand Sorcerer
davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.
 
Posts: 14,506
Karma: 24607224
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo: Touch, Glo, Aura H2O, Glo HD, Aura ONE
Quote:
Originally Posted by Tharos View Post
A really hard point does not exist. Maybe a small example of my IDs says more:
Code:
no:https://www.novelupdates.com/series/a-story-name
gt:http://gravitytales.com/novel/a-story-name
url:http://lightnovelgate.com/novel/a-story-name
db:http://lndb.info/light_novel/a-story-name
rln:https://www.readlightnovel.org/a-story-name
In the end, it was just an idea to make it a little easier for me.
I like your suggestion and I understand why JimmXinu isn't likely to adopt it. But, I do use some custom ids. These are defined using the custom identifier rules (Preferences, Book Details and the Create rules button). For one of the above, I would add:

Code:
Key: no
Name: Novel Updates
Template: https://www.novelupdates.com/series/{id}
With that, you get "Novel Updates" in the details pane rather than the domain.

For FFF downloaded stories, these get added via a personal plugin that fiddles with the book and formats it the way I like them. I will sometimes remove the URL if I want to make sure I don't accidentally update a book.
davidfor is offline   Reply With Quote
Old 02-24-2018, 10:28 AM   #2618
edeniz
Zealot
edeniz began at the beginning.
 
Posts: 106
Karma: 10
Join Date: Oct 2015
Device: Sony Reader, Tolino Shine, Samsung Galaxy S3
A quick question:

What could be the reason for why ships2chars fails? I mean, I know that if the characters field (or any field for that matter) does not have at least one entry, it's unreasonable to expect it, so that's not what I mean. In the example cases I have noticed, the characters field *does* have an entry, but ships2chars fails. In fact, I have tested it with stories where previously ships2chars *had* worked without trouble, so that's why I know I must have messed it up somewhere along the line.

I tried it with literally only this in replace_metadata.txt:

Spoiler:
Code:
 ships2chars=>[ ]*/[ ]*=>/
 ships2chars=>[ ]*&[ ]*=>/
 ships2chars=>([^/]+)/([^/]+)/([^/]+)/(.+)=>\1\,\2\,\3\,\4
 ships2chars=>([^/]+)/([^/]+)/(.+)=>\1\,\2\,\3
 ships2chars=>([^/]+)/(.+)=>\1\,\2
 ships=>([ ]*) And ([ ]*)=>\1/\2


So it can't be that the replaced metadata is the source, right? What am I missing? What did I unwittingly mess up? Because at one point it worked without problems. So where in the ini should I look for the error?

Example url to try it out:
https://archiveofourown.org/works/12793047

And this one is the link to a story where it had split the ships into chars without problems way back when: http://archiveofourown.org/works/2123949


Below is the relevant .ini attached.


Thank you kindly for any and all help.
Attached Files
File Type: txt ini for forum.txt (7.1 KB, 43 views)
edeniz is offline   Reply With Quote
Old 02-24-2018, 10:52 AM   #2619
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,294
Karma: 589194
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
@edeniz:

Your problem is that you have two add_to_extra_valid_entries entries in the [defaults] section:
Code:
[defaults]
add_to_extra_valid_entries:,ships2chars
...
add_to_extra_valid_entries:,rawgenre,rawcategory,rawcharacters,rawships
The INI parser only uses the last entry in a section for the same key word. So ships2chars is ignored. (The add_to_ mechanism is for adding to other sections.)

Combine those two into one line and it should be good again:
Code:
[defaults]
add_to_extra_valid_entries:,ships2chars,rawgenre,rawcategory,rawcharacters,rawships
JimmXinu is offline   Reply With Quote
Old 02-24-2018, 11:24 AM   #2620
edeniz
Zealot
edeniz began at the beginning.
 
Posts: 106
Karma: 10
Join Date: Oct 2015
Device: Sony Reader, Tolino Shine, Samsung Galaxy S3
Quote:
Originally Posted by JimmXinu View Post
@edeniz:

Your problem is that you have two add_to_extra_valid_entries entries in the [defaults] section:
Code:
[defaults]
add_to_extra_valid_entries:,ships2chars
...
add_to_extra_valid_entries:,rawgenre,rawcategory,rawcharacters,rawships
The INI parser only uses the last entry in a section for the same key word. So ships2chars is ignored. (The add_to_ mechanism is for adding to other sections.)

Combine those two into one line and it should be good again:
Code:
[defaults]
add_to_extra_valid_entries:,ships2chars,rawgenre,rawcategory,rawcharacters,rawships



Thank you very kindly! I knew I messed up somewhere when I was trying to make the ini easier to navigate for me, but simply couldn't see where, much to my frustration.
edeniz is offline   Reply With Quote
Old 02-24-2018, 12:59 PM   #2621
Firedancer885
Occassional Beta Tester
Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.
 
Posts: 276
Karma: 3516
Join Date: Nov 2010
Location: Hungary
Device: Samsung Galaxy Tab 4 (wifi only)
Hi Jimm,
I just got the following error. Is this a temporary problem, or something changed in AO3?
<urlopen error [Errno -2] A név vagy a szolgáltatás nem ismert>
https://archiveofourown.org/works/13769718
Firedancer885 is offline   Reply With Quote
Old 02-24-2018, 01:03 PM   #2622
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,294
Karma: 589194
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Quote:
Originally Posted by Firedancer885 View Post
Hi Jimm,
I just got the following error. Is this a temporary problem, or something changed in AO3?
<urlopen error [Errno -2] A név vagy a szolgáltatás nem ismert>
https://archiveofourown.org/works/13769718
Assuming translate.google.com is correct that the error message reads "The name or service is not known" and given that I was able to download it, it's probably a temporary problem, possibly with your DNS.
JimmXinu is offline   Reply With Quote
Old 02-24-2018, 01:06 PM   #2623
Firedancer885
Occassional Beta Tester
Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.Firedancer885 can teach chickens to fly.
 
Posts: 276
Karma: 3516
Join Date: Nov 2010
Location: Hungary
Device: Samsung Galaxy Tab 4 (wifi only)
Thanks
Firedancer885 is offline   Reply With Quote
Old 02-24-2018, 02:24 PM   #2624
scarlettruin
Connoisseur
scarlettruin began at the beginning.
 
Posts: 56
Karma: 10
Join Date: May 2014
Device: Nook (Simple Touch) and Samsung Galaxy Tab 3.0
Hi,
When I go to update any of my fics, it's not working. It shows an error message with just 'URLError:'.

calibre, version 3.14.0
ERROR: Unhandled exception: <b>URLError</b>:<urlopen error [Errno 11001] getaddrinfo failed>

calibre 3.14 embedded-python: True is64bit: False
Windows-10-10.0.16299-SP0 Windows ('32bit', 'WindowsPE')
32bit process running on 64bit windows
('Windows', '10', '10.0.16299')
Python 2.7.12+
Windows: ('10', '10.0.16299', 'SP0', u'Multiprocessor Free')
Interface language: en_GB
Successfully initialized third party plugins: DeDRM (6, 5, 2) && View Manager (1, 4, 3) && SmartEject (2, 0, 7) && NormComment (0, 0, 2) && Modify ePub (1, 3, 13) && Count Pages (1, 8, 0) && Search The Internet (1, 7, 6) && Goodreads (1, 1, 13) && Generate Cover (1, 5, 21) && FanFicFare (2, 22, 0) && Author Book Count (2, 1, 5) && Read MP3 AudioBook metadata (1, 0, 79) && Prettify Cover 0.9.12 && Find Duplicates (1, 6, 3) && EpubMerge (2, 1, 1) && Quality Check (1, 9, 11) && Save Composite Custom Columns (1, 1, 0) && EpubSplit (2, 3, 0)
Traceback (most recent call last):
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 810, in update_anthology
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 568, in get_urls_from_page
File "calibre_plugins.fanficfare_plugin.fanficfare.getu rls", line 59, in get_urls_from_page
File "calibre_plugins.fanficfare_plugin.fanficfare.conf igurable", line 1221, in _fetchUrl
File "calibre_plugins.fanficfare_plugin.fanficfare.conf igurable", line 1210, in _fetchUrlOpened
File "calibre_plugins.fanficfare_plugin.fanficfare.conf igurable", line 1111, in _fetchUrlOpened
URLError: <urlopen error [Errno 11001] getaddrinfo failed>

Any ideas please?
scarlettruin is offline   Reply With Quote
Old 02-24-2018, 02:30 PM   #2625
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,294
Karma: 589194
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
FFF isn't able to resolve the host name. Could be a problem with your network, your proxy settings (or proxy), or a firewall/security program blocking calibre from making outbound connections.

If you can still see the story page on the same computer using your browser (and don't use a proxy), a firewall program is the most likely cause.
JimmXinu is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] KindleUnpack - The Plugin DiapDealer Plugins 412 04-24-2018 06:07 PM
[GUI Plugin] Open With kiwidude Plugins 328 08-20-2017 11:34 PM
[GUI Plugin] Marvin XD Philantrop Plugins 126 01-29-2017 12:48 PM
[GUI Plugin] KiNotes -axel- Plugins 0 07-14-2013 06:39 PM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 12:27 PM


All times are GMT -4. The time now is 01:30 PM.


MobileRead.com is a privately owned, operated and funded community.