[GUI Plugin] FanFicFare

[Atherton25]

Originally Posted by JimmXinu

I think your slow downs and other download issues had to do with throttling and large numbers of images. I've added a default slow_down_sleep_time for wattpad.

BTW, yes, I generally appreciate debug logs with problems, but +500M of log is a bit excessive when editing quotes. At least attach it as a file next time it's that large, please.

Uhm, sorry? I did purposefully hide it in a spoiler and code tag so it didn't take up a lot of room in the post (just the email likely). I didn't really look at how long it was, just copied it over. Next time I'll keep that in mind about adding as an attachment.

As for the slow downs, I will look at what I do for the next couple days. I actually flipped mine to 4 anyway, as I don't have any urgent need for the stories, I've read them and it's a lot more towards archival. There's a couple I'm interested in reading right away I haven't got around to, but then I've also got a pretty good sized queue with everything else I have. Since I primarily read on my kindle, all the webnovel sites we've gotten access to download in the last few months has just enlarged my queue. I'm working my way through them. Plus, though they're not too difficult to read anymore translated webnovels take a little more time for me, something about my mind having to work a little harder to understand some of the stuff post-translation.

Originally Posted by JimmXinu

replace_metadata is your friend. You might consider sharing your solution when you have one you are happy with.

Yeah, I think what I end up doing will probably be picking out the worse offenders and fixing them, I will share it once I've got them taking care of.

Originally Posted by JimmXinu

I've added a comma_entries ini option. I'll default wattpad reads to use it. Not sure why I haven't done that before.

Thanks! There was something in the past that had a similar issue, I just don't remember what it was, and it wasn't as apparent as this one, so I just ignored it for the most part.

I don't know if I say it often enough, but thanks for the addon and all the time/effort you put in to help others. It's probably saved me a lot of time manually downling things. Even with all the options available now, it's still a lot more time consuming than FFF.

There've been 3-4 programs for ff.net I used in the past but this one is by far the best, and all the other sites make it head and shoulder above any other offer available.

I do wish the webtoepub project had a calibre plugin so there was more management/update ability. That program is a bit different, allowing you to specify the web page downloads - which means any page, and you can 'edit' the pages, including order. There's a trial and error, plus sometimes a lot of editing involved. They just dont have any post-download management, so no ability to reopen an epub and add a few more chapters. There are work around within calibre to add them but it'd be easier to manage all in one. Ah well.

Anyway, sorry got off on a tangent.

The point is. FFF is awesome, and it's done a lot to improve my life. I mean that. Thank you.

[Atherton25]

I found a bug in gravity tales. At the moment I've only found one fic that's affected, and it was heartbreaking.
http://gravitytales.com/novel/shuras-wrath

Apparently, the story downloads everything twice. I was at the halfway point thinking I had another 750k words to go before I had caught up, only to find out that no... I was caught up, the chapters started again from the beginning.

I cried a little.

Anyway, it's not exactly a major bug or anything, just wanted to report it. If I find any others on gravity tales that do the same thing I'll note it if needed.

[JimmXinu]

http://gravitytales.com/novel/a-dragons-curiosity does the same thing. In both cases, there's a section called 'Chapters' with chapters, then named sub-book sections that again contain the same chapters--in the case of a-dragons-curiosity, the sub-books don't contain all the chapters in 'Chapters'.

OTOH, the other 5 on the drop down at the top of the page under 'Original Tales' and a handful spot checked from 'Translated Tales' don't have a 'Chapters' section and don't appear to have any duplicates.

So my assumption is that authors did that on purpose for some reason, rather than it being a bug as such.

If it's a common thing, I suppose code to prevent duplicate chapters could be added to the adapter. I don't remember it being an issue before.

[Tanjamuse]

I'm having trouble picking up the ratings for at least these two sites: Stories of Arda, STARS Library.

This is what I have in my personal.ini

[www.starslibrary.net]
join_string_characters:\s&\s
join_string_ships:\s&\s
join_string_category:\s&\s
keep_in_order_ships:true
keep_in_order_category:true
keep_in_order_characters:true
include_subject_tags:genre
add_genre_when_multi_category: Crossover
replace_metadata:
    genre=>Hurt-Comfort=>Hurt/Comfort
    rating=>M=>Adults Only
    rating=>NC-17=>Mature
    rating=>T=>Teen
    rating=>K$=>Kids

[www.storiesofarda.com]
is_adult:true
replace_metadata:
    rating=>R$=>Mature
    rating=>G$=>Kids
    rating=>PG=>Older Kids
    rating=>PG-13=>Teen

Here are 2 links:

http://www.starslibrary.net/viewstory.php?sid=11380

http://www.storiesofarda.com/chapter...w.asp?SID=7548

[JimmXinu]

Originally Posted by Tanjamuse

I'm having trouble picking up the ratings for at least these two sites: Stories of Arda, STARS Library.

...
http://www.starslibrary.net/viewstory.php?sid=11380

http://www.storiesofarda.com/chapter...w.asp?SID=7548

starslibrary.net doesn't currently collect ratings because they're not included in the print page. I'll look into getting it from the index page.

I don't have any problems getting rating from storiesofarda.com and using your arda settings worked fine for me.

[JimmXinu]

New test version posted

2017-05-28
- Add rating for starslibrarynet, fix [www.starslibrary.net] as section name.
- Add apocrypha_to_omake option for base_xenforoforum_adapter threadmark category.

[BaldTrout]

I've noticed that FanFicFare downloads stories from archiveofourown.org with a http connection rather than https. Could the next update for the plugin download stories via https?
Thanks!

[JimmXinu]

@BaldTrout - I don't usually change an adapter to use https while http still works on the site. Is there a particular reason you want it?

[Atherton25]

Originally Posted by JimmXinu

http://gravitytales.com/novel/a-dragons-curiosity does the same thing. ...

If it's a common thing, I suppose code to prevent duplicate chapters could be added to the adapter. I don't remember it being an issue before.

It's not a common thing.

In fact, I went through all the stories I had on gravitytales, which is most of them, and checked to see if they had the issue. The only other story I could find with the problem was Dragon's Curiosity. I never finished the story, it was alright just didn't really catch my interest when I started it, so I didn't notice it.

That site has a couple quirks anyway, some authors (~8 stories on the site) put up 'teasers' which means they have to be deleted directly from the epub before the real chapter can be properly downloaded. It basically means that before I update a story I go in and manually remove any teaser chapters.

[BaldTrout]

Originally Posted by JimmXinu

@BaldTrout - I don't usually change an adapter to use https while http still works on the site. Is there a particular reason you want it?

Privacy and security primarily. While I can see reason for a 'if it works why change it' mentality, I'd like to think that the enhancements that https provide would be worth the change if a site supports it. Could there be a way offer the user a choice in the settings for the plugin? Or, maybe default to https and if it fails fall back to http?

If the change is unlikely to happen, is there a way to change the adapter myself?

[JimmXinu]

New test version posted

2017-05-31
- Reduce debug output from replace_br_with_p.
- Apply minimum_threadmarks in base_xenforoforum based on all threadmarks, not marks per category.
- Change AO3 to https, normalize chapter URLs, remove view_adult from chapter URLs.
- Update translations.

[Atherton25]

@gcomyn (and JimmXinu too I suppose)

webnovel.com made some changes to the ToC today (or late last night) and no longer is functioning. I thought I'd drop that info. I'm reading a pretty long book so I'm not in any rush to get updates personally, but I doubt I'll be the only one that'll notice.

[Tanjamuse]

Is it possible to extract the Story ID number by Regex in S&R?

The number is the one I've marked in bold in the following link.

https://www.fanfiction.net/s/12513450/1/

[Atherton25]

@Tanjamuse
That's relatively simply, here's what I use. There may be other methods, but this one works just fine for me.

Search mode:Regular Expression
Search Field: Identifiers
Identifier Type: URL
Search for:http(s?)://www.fanfiction.net/s/(.*?)/1/
Replace with:\2
Destination Field: (your pick)

[Tanjamuse]

Could this be done if the author or story link where made like this:

<a class='authorlink' href='https://www.fanfiction.net/u/5209593/Star-streak-writer'>Star streak writer</a>