[GUI Plugin] FanFicFare

[Tharos]

Originally Posted by JimmXinu

Do you have specific arguments for it?

No, the new Calibre Version just made me curious.

Edit book: Add a tool to upgrade books from EPUB 2 to EPUB 3 (Tools->Upgrade book internals)
Automatically upgrades metadata, converts the NCX table of contents and adds required manifest annotations

How would FFF react if I make an update to a fanfiction story that I've previously converted? That would actually have to do problems.

[JimmXinu]

That update hadn't popped up for me yet.

Some epub3 output code I can borrow from a trusted source increases the chances I'll implement it.

But it looks like epub3 still isn't added to Calibre's Convert output, implying it's not the 'preferred' epub version yet. So I'm not going to leap into it right now.

[soak]

Hello, long time lurker here on mobilereads, but only just discovered this plugin. Is there a tutorial for beginning users who don't know anything about fanfiction sites or this plugin? I have explored the wiki and searched this thread and still have no idea what I'm doing.
What URL am I supposed to enter to download? The table of contents/homepage of a story? The first chapter? Is it normal for my download of a story to sit at 1% for 30 minutes when I entered the URL for a first chapter? I thought maybe I could use 'Get URLs from Web Page' and enter the table of contents URL to download all chapters of a story, but it only returns one (and not the first). I'm really confused, and that's unlike me. I thought I'd gotten pretty good with Calibre over the last couple years, but now I'm feeling pretty ignorant.

[JimmXinu]

Tutorial:
There isn't any tutorial that I know of, but the wiki is open if anybody wants to write one. I'm singularly ill suited to it because FanFicFare generally operates in whatever way seems most intuitive to me.

Story URLs:
What URL are you supposed to use depends on the site. For most sites you can give the URL to any chapter and it will work; but some sites require a specific story URL instead (because the story URL cannot be derived from the chapter URL). The Supported Sites page gives some examples of acceptable story URLs for all supported sites.

Percent Done:
The percentage done counts by stories not chapters. So if you're downloading only one story, it will stay at 1% until it finishes and jumps to 100%.

Download Time:
Many sites are configured or coded to take several seconds per page request (to not overwhelm the site servers). So if you start a download of a 1000 chapter story on forums.spacebattles.com for example, that's going to be at least 4000 seconds or over an hour. If you've set a slow_down_sleep_time value in your personal.ini settings it could also have an effect.

If, on the other hand, you have a short (<10 chapters) story taking that long, I'd like to know the story URL.

Get URLs from Web Page:
That feature is for getting multiple story URLs from a page, like a series page on sites that support them, an author's story list page, or any generic web page with a list of valid story URLs. If pointed to a story's TOC page, I would expect it to only find the one story URL. You only need one URL for it, after all, not one per chapter.

If you're still having trouble, please post (or PM if NSFW) URLs to a few of the stories you're trying to download.

[soak]

Thanks for the awesome reply and for the plugin. I've also been using ePubMerge for a while, it's wonderful. I started up a test download from Royal Road earlier after looking at the URL example in the Supported Sites list. It's 2200 pages in 94 chapters, so after your post I was prepared for a long download. Anyway, the jobs dialog says it's been 3 hours, 43 minutes, and still going. Does that sound right? I'm on an old netbook with a weak processor... maybe I should switch to my desktop and try?

[JimmXinu]

That sounds long, but without the story URL, I cannot say for sure.

Please try a short (<10 but preferably 1 chapter) story to make sure it works at all.

Also, you should always post your story URLs when reporting difficulties (unless NSFW, then use Private Messages).

[soak]

Well, I gave up and shut off that download last night at the 5 hour mark. Tried the same URL tonight on my desktop and it finished in 38 minutes. I think I was just asking too much of my old netbook. It did work for a smaller test story, though. Anyway, thanks for all the help and for your patience!

[Mandabar]

Hey again Jimm. I was wondering if there has been a change in the Xenforo adapter? I know after you got hooked on reading some stories at SB/SV (Join the club hah), that you made this adapter work on post link for in post TOC, and later also added the threadmark option.

Was the post link TOC search removed? Or is something hinky going on?

I have a story that is an older one that I was going to download, reading it seems that while it does have thread marks, it only marks the first post of multiple posts in sequence for a chapter. Of course Kclcmdr is a bro and does his own ToC post. But I'm getting the following error when doing it by the post link (https://forums.spacebattles.com/posts/7290742/).
Error: [ 'NoneType' object has no attribute 'name' ]

Perhaps the post logic is getting screwed up with another link to the threadmarks in his post perhaps? Bit frustrating the author didn't do a full threadmarking.

Anyways just wanted to poke ya about it.

[JimmXinu]

@Mandabar - Do you have the latest version or test version installed? I'm not getting an error using that post.

If you run in debug and post a log, that would help debugging.

[JimmXinu]

New Version Released

Changes:

- Fix adapter_hpfanficarchivecom to not take author from banner by mistake.
- New Site www.novelall.com - Thanks rikkitp!
- Fix downloading illustrated stories from literotica. (#295) - Thanks davidfor
- Add remove_spoilers & legend_spoilers options to royalroadl.com for Issue #287
- Fix author URL/Id fetch for adapter_wwwlushstoriescom.
- Fix www.webnovel.com adapter with volumes (#293) - Thanks rikkitp
- Added status metadata to wuxiaworld and royalroadl (#289) - Thanks rikkitp
- Add reformating option fix_excess_space to lightnovelgate (#291) - Thanks rikkitp
- Change ficwad.com to https.
- Fixes for tables, add keep_empty_tags,td,th and add to keep_html_attrs colspan,rowspan.
- Allow domain sufficientvelocity.com for forums.sufficientvelocity.com.
- Fix for wuxiaworld adapter when image is null (#288) - Thanks rikkitp

[Mandabar]

Originally Posted by JimmXinu

@Mandabar - Do you have the latest version or test version installed? I'm not getting an error using that post.

If you run in debug and post a log, that would help debugging.

Double Checking it appears I'm currently running the latest version before this update today, FFF v2.24.0

I see you released v2.25.0 so after updating and restarting Calibre I'll give that run too even if I don't think there was a change for this.
Nope, same error comment with v2.25.0.

I don't know if this may be an issue but sometimes I lag behind Calibre updates itself (they just come out so often!) and I don't think it would be a problem but just to cross that off my current Calibre (64bit) is 3.14 and it seems latest is 3.22.1. I'll give a Calibre update a try and see if that resolves anything.

All right let me do a debug log for ya. Ok I did one for Calibre versions 3.14 and 3.22.1. No joy on either.

Both are attached.

[JimmXinu]

Okay, I see what's happening now.

You were correct to suspect the threadmarks link. Because I had continue_on_chapter_error:true set I didn't see it unless I looked inside the resulting ebook.


New Test Version Posted

2018-04-29
- base_xenforoforum_adapter: exclude threadmarks URL as chapter URL.

[Mandabar]

Well that worked out much better. The only thing is it ignored the first 4 chapter links since they link to a threadmarked post, while it ignores the first link properely now since it links to the threadmark index I suppose.

The odd thing is those first 4 chapters ( 01a 02a-c) are actually links to posts not threadmarks, but those posts ARE threadmarked. The first chapters of the later sections (some of them) are also threadmarked but not skipped. It's odd the disparity. Well this is good enough for me at the moment since I'm past those three chapters but I figured this is something I should still point out, though there might be no solution.

Thanks Jimm for the work you do on this magnificent plugin!

[JimmXinu]

Originally Posted by Mandabar

...The odd thing is those first 4 chapters ( 01a 02a-c) are actually links to posts not threadmarks, but those posts ARE threadmarked.
...

Those links are hard coded as forum.spacebattles.com instead of forumS--that's why they don't work.

There's a limit to how many not-quite-right URLs I'm willing to search for, sorry.

[Mandabar]

Originally Posted by JimmXinu

Those links are hard coded as forum.spacebattles.com instead of forumS--that's why they don't work.

There's a limit to how many not-quite-right URLs I'm willing to search for, sorry.

That's fine. Just on my quick glance at them they seemed correct and the link worked. I suppose there is a redirect there. No worries Jimm!