Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 01-09-2017, 02:31 PM   #1726
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,993
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by Tanjamuse View Post
Do you take requests for new sites?
This has been asked and answered many times. You may request new sites, but whether they are added or not depends on the difficulty of doing so and the interest of the developers.

I also accept code contributions from users who want to add new sites themselves.
JimmXinu is offline   Reply With Quote
Old 01-09-2017, 02:33 PM   #1727
Tanjamuse
Wizard
Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!
 
Posts: 1,327
Karma: 5306
Join Date: Jan 2014
Device: none
Then I would like to request support for this site:

http://lcfanfic.com/index.html
Tanjamuse is offline   Reply With Quote
Old 01-09-2017, 02:41 PM   #1728
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,993
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by Tanjamuse View Post
Then I would like to request support for this site:

http://lcfanfic.com/index.html
Yes, I saw that earlier. Now we wait and see if any developers express interest.
JimmXinu is offline   Reply With Quote
Old 01-09-2017, 07:10 PM   #1729
Atherton25
Zealot
Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.
 
Posts: 124
Karma: 3804
Join Date: May 2016
Device: Kindle Oasis 2
I know you can add <url>[1,5] to specify chapters 1-5 or similar... is there a way to skip a chapter?

I'm running into a problem where http://royalroadl.com/fiction/9497 the 'suggestions' chapter is causing an issue 'http://royalroadl.com/fiction/chapter/109834' has some stupid html issues in it causing it to error out. If I could skip the chapter, I could download the book, even if it forced a duplicate chapter later.

I tried manually adding a chapter to force it to skip the chapter, but got nowhere.

Edit: I did a pretty extensive search through the thread and the old one, trying to find the answer before posting, I'm sorry if there's a place that discusses this previously.

Last edited by Atherton25; 01-09-2017 at 07:14 PM.
Atherton25 is offline   Reply With Quote
Old 01-09-2017, 09:10 PM   #1730
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,993
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by Atherton25 View Post
I know you can add <url>[1,5] to specify chapters 1-5 or similar... is there a way to skip a chapter?
The square bracket notation only does ranges, not exclusions. The most straightforward way to deal with it is to just do two downloads, one with URL[1-8] and then URL[10-] to skip the bad chapter 9 (assuming I counted correctly).

However, you'd have to to URL[10-] again every time you wanted to update (assuming an in-progress story), otherwise FFF would try to get the bad/missing chapters.

Quote:
Originally Posted by Atherton25 View Post
I tried manually adding a chapter to force it to skip the chapter, but got nowhere.
That's possible, but you'd want to start by doing URL[1-8], then editing the epub to add file0009.xhtml. Then you'd need to copy the <head> metadata data from file0008 (or other file) and edit the hidden tag <meta name="chapterurl" content="http://blahblahblah/chapter/url/"></meta> to contain the chapter URL for the bad chapter. Then FFF would not try to download it again.

If you see more different chapters that fail, let me know. We may want to try and do something more about it.
JimmXinu is offline   Reply With Quote
Old 01-09-2017, 10:03 PM   #1731
Atherton25
Zealot
Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.
 
Posts: 124
Karma: 3804
Join Date: May 2016
Device: Kindle Oasis 2
I had done everything except edit the metaname, I couldn't figure out why it kept trying to download chapter 9 when I had a chapter in there (blank) that was chapter 9. I'd copied 8 and deleted all content but html info, I didn't realize that I had to actually edit the chapter url for it to pick it up. Works perfectly now.

It's funny I read a little bit of this with the original download and probably wont even get far enough for chapter 9 to matter, but oh well.

Now I know how to do it in the future, if needed. Thanks.

As for anything else, wuxia works great I've downloaded everybook. The only issue is that stupid way the author prepublish links to blank chapters in a couple books, and the the empty book that I had mentioned previously. Thanks for fixing the https links so they work!
Atherton25 is offline   Reply With Quote
Old 01-10-2017, 12:18 AM   #1732
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,993
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by Atherton25 View Post
...
It's funny I read a little bit of this with the original download and probably wont even get far enough for chapter 9 to matter, but oh well.
For extra long stories that I'm not sure I'm going to like, I will sometimes use the chapter range to specifically limit the download size/time and then later get the rest if I like it.
JimmXinu is offline   Reply With Quote
Old 01-10-2017, 02:39 PM   #1733
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,993
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
New test version posted (direct link)

2017-01-10
- Generalize continue_on_chapter_error so all adapters can use it.
- Adding chapter_title_error_mark for continue_on_chapter_error, force errors to always retry on update.
- Update translations.
- Bump test version.

Due to the recent issue with royalroadl.com and wuxia needing it, I've generalized continue_on_chapter_error to work with any site or story. wuxiaworld.com is the only site it is on by default. I suggest only turning it on for specific stories if possible.

When continue_on_chapter_error:true, if a chapter fails to download for any reason, FFF will instead insert a boilerplate text for the chapter giving the chapter URL and the error. (No, this boilerplate is not configurable at this time.)

FFF will also append a mark to the chapter title so you can easily see failed chapters in TOC. You can change what it says (including making it empty), but it currently always is appended at the end. Default: chapter_title_error_mark: (CHAPTER ERROR)

Failed chapters are stored such that, while they will not trigger an update themselves, they will be retried whenever there is an update.
Spoiler:

Default ini:
Code:
## Because some adapters can pull chapter URLs from human posts, the
## odds of errors in the chapter URLs can be higher for some
## sites/stories.  You can set continue_on_chapter_error:true to
## continue on after failing to download a chapter and instead record
## an error message in the ebook for that chapter.
continue_on_chapter_error:false

## Append this to chapter titles that errored.  Only used with
## continue_on_chapter_error:true
## Set empty to not mark failed chapters.
chapter_title_error_mark:(CHAPTER ERROR)
Example boilerplate:
Quote:
Error

FanFicFare failed to download this chapter. Because continue_on_chapter_error is set to true, the download continued.

Chapter URL:
https://baddomain.com/posts/18285533/

Error:
Code:
Traceback (most recent call last):
  File "calibre_plugins.fanficfare_plugin.fanficfare.adapters.base_adapter", line 394, in getStory
  File "calibre_plugins.fanficfare_plugin.fanficfare.adapters.base_adapter", line 542, in getChapterTextNum
  File "calibre_plugins.fanficfare_plugin.fanficfare.adapters.adapter_test1", line 364, in getChapterText
  File "calibre_plugins.fanficfare_plugin.fanficfare.adapters.base_adapter", line 346, in _fetchUrlOpened
URLError: <urlopen error [Errno 11001] getaddrinfo failed>
JimmXinu is offline   Reply With Quote
Old 01-10-2017, 05:08 PM   #1734
Atherton25
Zealot
Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.Atherton25 can teach chickens to fly.
 
Posts: 124
Karma: 3804
Join Date: May 2016
Device: Kindle Oasis 2
Nice! I like the change.

As for long stories? I have this compulsion to have it. I download a story, and I have it, so later on if it disappears? I still have it.

I lost a few stories I was reading years and years ago when ff.net did their mass cleansing ... I used a different fanfic download program back then, but I still read directly often too. It was pre-kindle/smartphone days when I used a PDA for reading and oh Microsoft Lit format. Heck, I'm not even sure calibre was out at the time, and it wasn't popular if it was. But I didn't download the one I was reading, and I'd read a couple I loved, but hadn't downloaded. Still haven't found some (though i do have others).

Anyway, lost a few stories and ever since then I've been a sort of digital pack-rat when it comes to fanfiction, or web novels lately. If I have interest I get it and it's there for me when I want to read. They stories don't take up much space and I have a wealth of space.
Atherton25 is offline   Reply With Quote
Old 01-10-2017, 05:39 PM   #1735
crich70
Grand Sorcerer
crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.
 
crich70's Avatar
 
Posts: 11,310
Karma: 43993832
Join Date: Feb 2010
Location: Monroe Wisconsin
Device: K3, Kindle Paperwhite, Calibre, and Mobipocket for Pc (netbook)
Quote:
Originally Posted by Atherton25 View Post
Nice! I like the change.

As for long stories? I have this compulsion to have it. I download a story, and I have it, so later on if it disappears? I still have it.

I lost a few stories I was reading years and years ago when ff.net did their mass cleansing ... I used a different fanfic download program back then, but I still read directly often too. It was pre-kindle/smartphone days when I used a PDA for reading and oh Microsoft Lit format. Heck, I'm not even sure calibre was out at the time, and it wasn't popular if it was. But I didn't download the one I was reading, and I'd read a couple I loved, but hadn't downloaded. Still haven't found some (though i do have others).

Anyway, lost a few stories and ever since then I've been a sort of digital pack-rat when it comes to fanfiction, or web novels lately. If I have interest I get it and it's there for me when I want to read. They stories don't take up much space and I have a wealth of space.
I've had that happen too. Not fun to find that a story has vanished into cyber limbo.
crich70 is offline   Reply With Quote
Old 01-11-2017, 09:12 PM   #1736
cawilliams1
Member
cawilliams1 began at the beginning.
 
Posts: 12
Karma: 10
Join Date: Jul 2012
Device: kindle
Before twcslibrary moved to starlibrary, when I downloaded a story in epub I would get the story photo as the cover. Since they moved to the new site, I'm no longer picking up photos. There haven't been any changes in my personal.ini. Example story: http://www.starslibrary.net/viewstory.php?sid=11460
cawilliams1 is offline   Reply With Quote
Old 01-11-2017, 10:10 PM   #1737
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,993
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by cawilliams1 View Post
Before twcslibrary moved to starlibrary, when I downloaded a story in epub I would get the story photo as the cover. Since they moved to the new site, I'm no longer picking up photos. There haven't been any changes in my personal.ini. Example story: http://www.starslibrary.net/viewstory.php?sid=11460
When switched to starslibrary.net, it became a base_efiction adapter. The base_efiction code doesn't handle images (or even HTML) in summary/description. I will investigate if it's possible.
JimmXinu is offline   Reply With Quote
Old 01-12-2017, 06:11 AM   #1738
Sojiro888
Junior Member
Sojiro888 began at the beginning.
 
Posts: 3
Karma: 10
Join Date: Jan 2017
Device: kobo aura
I've spent a while trying and failing to download stories from Twisting the Hellmouth (http://www.tthfanfic.org/). Eventually I tried something that worked, and managed to pinpoint the issue.

Whenever I get a link on this site, it's in secure http: https://www.tthfanfic.org/Story-XXXX
That additional 's' prevents fanficfare from registering the link as valid, so I have to edit it out manually. Would it be possible to update FanFicFare to accept both http and https?

Also, I tried using the config file to put my username and password on tthfanfic, so that I wouldn't have to type it in manually. Turns out that doing that prompted FanFicFare to ask me to type my login twice for each requested story, and then abort the job because it fails to connect. Removing my login information from the ini file fixed that. This is a bit weird, but I'm assuming I did something wrong.
Sojiro888 is offline   Reply With Quote
Old 01-12-2017, 10:58 AM   #1739
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,993
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by Sojiro888 View Post
I've spent a while trying and failing to download stories from Twisting the Hellmouth (http://www.tthfanfic.org/). Eventually I tried something that worked, and managed to pinpoint the issue.
...
Already fixed in the posted test version.
JimmXinu is offline   Reply With Quote
Old 01-12-2017, 03:43 PM   #1740
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,993
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
New Version Released

New version released:

Version 2.8.0 - 12 Jan 2017
- Changes to adapter_wwwarea52hkhnet from GComyn.
- Minor fix to adapter_squidgeorgpeja from GComyn.
- New site by GComyn: fanficauthors.net
- New site by GComyn: www.lushstories.com
- New site by GComyn: www.wuxiaworld.com
- New site by GComyn: trekfanfiction.net
- New site by GComyn: archive.shriftweb.org
- New site by GComyn: firefly.populli.org
- New site by GComyn: sebklaine.net
- New site by GComyn: www.utopiastories.com
- New site by GComyn: www.fireflyfans.net
- Replace twcslibrary.net with starslibrary.net
- No covers from smilies on royalroadl plus label debug output from royalroadl.
- Fix resetting confirm dialog checks.
- Add 'Delete on Reject by Default' option.
- Fixes for extended/accented chars in URLs for adapter_wwwlushstoriescom.
- Add iso-8859-1 to default decode list.
- Fixes for utf8 in desc for adapter_wuxiaworldcom
- Fix for adapter_spikeluvercom desc containing extra stuff.
- NEW - Experimental support for more than one adapter under the same domain name:
- New Site: sinful-dreams.com/wicked/temptation
- New Site: sinful-dreams.com/whispered/muse
- New Site: sinful-dreams.com/unicorn/fic
- Fix for tthfanfic.org change from http to https
- Add chapter URL normalization to adapter_tthfanficorg for http to https change to recognize pre-existing chapters. Also protects against title changes.
- Strip 'Crossover' prefix from SV titles--base_xenforoforum_adapter.
- Get non-label rating for base_efiction adapter_darksolaceorg.
- Fixes for wuxiaworld.com chapter URLs.
- Metadata fixes for adapter_wwwlushstoriescom from GComyn.
- Adding chapter_title_error_mark for continue_on_chapter_error, force errors to always retry on update.
- Generalize continue_on_chapter_error so all adapters can use it.
- Update translations.
JimmXinu is offline   Reply With Quote
Reply

Tags
fanfiction


Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] KindleUnpack - The Plugin DiapDealer Plugins 523 07-15-2025 06:45 PM
[GUI Plugin] Open With kiwidude Plugins 404 02-21-2025 05:42 AM
[GUI Plugin] Marvin XD Philantrop Plugins 126 01-29-2017 12:48 PM
[GUI Plugin] KiNotes -axel- Plugins 0 07-14-2013 06:39 PM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 12:27 PM


All times are GMT -4. The time now is 09:25 AM.


MobileRead.com is a privately owned, operated and funded community.