[GUI Plugin] FanFicFare

[Tanjamuse]

Can I convert this to epub and get FFF to collect the metadata?

[taratears]

Originally Posted by JimmXinu

I had a minute, so I just checked--a downloaded EPUB from AO3 for a recently updated story contained a normal story URL that existing FFF could find just fine.

So if you have example(s) of epubs or pages where this download.archiveofourown.org domain is used, I'd like to see them.

I lost access to a computer for awhile, so I'm just getting back to you on this.

[JimmXinu]

Originally Posted by gcomyn

I haven't been able to figure out how to do a partial download with Calibre, so I've had to download the entire book to test it.

Add a chapter range in square brackets after the URL. Only works with "Download by URL", but you can enter URLs for existing books.

http://www.wuxiaworld.com/wmw-index/[90-105]
http://www.wuxiaworld.com/wmw-index/[90-]
http://www.wuxiaworld.com/wmw-index/[-5]
http://www.wuxiaworld.com/wmw-index/[102]

[JimmXinu]

Originally Posted by Tanjamuse

Can I convert this to epub and get FFF to collect the metadata?

Converting text to epub is a Calibre function.

FanFicFare will not find the story URL in the text file, but if you enter the story URL into calibre's Identifiers field as url:http://www.fanfiction.net/s/2620848/1/ you can use FFF's 'Update Calibre Metadata from Web Site' feature.

[JimmXinu]

Originally Posted by taratears

I lost access to a computer for awhile, so I'm just getting back to you on this.

I can't say I remembered anything about this, but it has been like 8 months.

I've added download.archiveofourown.org as an acceptable domain for AO3. It will be in the next test version.

[JimmXinu]

Need a check from some users.

GComyn has kindly written code to add the site deandamage.com. The problem is, I can't see it from my home network--it comes up 'Forbidden' by the site. But I can see it from my cell network.

So who can see this site and who gets forbidden? You can PM me if you'd rather not speak up publicly.

http://deandamage.com/
http://deandamage.com/viewstory.php?sid=169

Thanks!

[JimmXinu]

New Test Version Posted

2017-04-21
- Add Story Notes to base_efiction_adapter.
- Don't send Referer:None -- hpfanficarchive.com doesn't like it.
- New site www.webnovel.com - thanks GComyn
- Additional tags collected for wuxiaworld--thanks GComyn
- Add download.archiveofourown.org for AO3 due to old downloaded AO3 epubs
- Fix for author including <b>Updated</b> in desc in adapter_ashwindersycophanthexcom.
- Fix "got more than 100 headers"-issue adapter_royalroadl.py only.
- Fix ffnet referer for cover images.

[Atherton25]

@gcomyn
Again thank you! Wuxiaworld has recently added a whole lot more fics.
As for the Wuxuiaworld adapter, there were some updates after my post that were made, I believe JimmXinu made those changes them. This corrected all of the problems I had if I remember right, one of them was implementing an empty-chapter setup which allowed for empty chapters and then fills them in later when the fic updates. The other was allowing for the https links that were in some of the indexes. And I'm not sure what caused the absolute choice index problem, but it got fixed as well.

I love translated webfiction sites, and I often have to use webtoepub Firefox plugin to get them easily downloaded on my kindle. It's a clunky program, but it works a whole lot better than manual downloads. I just wish they provided a way to 'update' their downloaded epubs rather than having to
1. Download new chapters and read them separately or merge them into an old download with epubmerge or
2. Re-download the whole story.

@JimmXinu
I can see the site deandamage.com just fine at home and I can see it fine on my VPN IP as well. Using both firefox and chrome in both cases. That... is a strange site based on their front page description of what it contains. However, if I go through Tor I get 403 Forbidden error.

Also, if you integrated gcomyn's changes adding those fixes by gcomyn, they... didn't come through. I just updated the adapter and then downloaded a couple of fics (new downloads) and didn't get the fixes he described in the earlier post. I got neither the chapter fix or description.

I'm not entirely sure how long this has been going on, but *any* stories on hpfanficarchive, by lostfanfiction gets the error: "HTTP Error 400: Bad Behavior" http://hpfanficarchive.com/stories/v...riesby&uid=283 is the author link. I tried downloading any of the stories on page 1 and every single one got the same error.

[JimmXinu]

New Test Version Posted

2017-04-21 (again)
- New sites from GComyn:
- gravitytales.com
- imrightbehindyou.com
- mtt.just-once.net
- obidala.net
- sword.borderline-angel.com
- tasteofpoison.inkubation.net
- unknowableroom.org
- www.13hours.org
- www.aneroticstory.com
- www.deandamage.com
- www.fiction.thebrokenworld.org
- www.narutofic.org
- www.starskyhutcharchive.net
- www.thedelphicexpanse.com
- www.thundercatsfans.org

[JimmXinu]

Originally Posted by Atherton25

@JimmXinu
I can see the site deandamage.com just fine at home and I can see it fine on my VPN IP as well. Using both firefox and chrome in both cases. That... is a strange site based on their front page description of what it contains.

I've included that site in the latest test version. However, I'm strongly leaning towards removing it before the next release if it's blocked for others.

Originally Posted by Atherton25

Also, if you integrated gcomyn's changes adding those fixes by gcomyn, they... didn't come through. I just updated the adapter and then downloaded a couple of fics (new downloads) and didn't get the fixes he described in the earlier post. I got neither the chapter fix or description.

Unless I've done something wrong, the latest two test versions should have had those changes. Make sure you have FFF v2.10.3.

Originally Posted by Atherton25

I'm not entirely sure how long this has been going on, but *any* stories on hpfanficarchive, by lostfanfiction gets the error: "HTTP Error 400: Bad Behavior" http://hpfanficarchive.com/stories/v...riesby&uid=283 is the author link. I tried downloading any of the stories on page 1 and every single one got the same error.

Fixed in v2.10.3.

[Atherton25]

@JimmXinu
I had updated it... and apparently my version wasn't the latest version, it was 2.10.2... I'm not entirely sure how that happened, because I rename the zip with the date when I download it. When I did update it everything worked fine.

As for the site that doesn't work for everyone... my personal opinion is why don't you add it in with a proviso on the website and here that this may not work for everyone due to a website problem. Although I won't be use it, that's no reason to limit others who may use it. Having the option is better than limiting it.

@gcomyn
Wow, all those new sites, you've been busy.

And GravityTales! Awesome, BUT I found a problem with some of the ones I wanted to download. A few of them had flat out errors because I had the exact same title/author and it error'ed, I took care of those. However, beyond that, there was some that had the following error:
"local variable 'synopsis' referenced before assignment"
the list of the ones that i had happened on:
http://gravitytales.com/novel/aethernea
http://gravitytales.com/novel/how-to...-a-daily-basis
http://gravitytales.com/novel/the-ex...the-crazy-lich
http://gravitytales.com/novel/dungeon-hunter
http://gravitytales.com/novel/reincarnator

There may be more, but those are the ones that I tried that gave me an error.

[gcomyn]

Originally Posted by Atherton25

And GravityTales! Awesome, BUT I found a problem with some of the ones I wanted to download. A few of them had flat out errors because I had the exact same title/author and it error'ed, I took care of those. However, beyond that, there was some that had the following error:
"local variable 'synopsis' referenced before assignment"
the list of the ones that i had happened on:
http://gravitytales.com/novel/aethernea
http://gravitytales.com/novel/how-to...-a-daily-basis
http://gravitytales.com/novel/the-ex...the-crazy-lich
http://gravitytales.com/novel/dungeon-hunter
http://gravitytales.com/novel/reincarnator

There may be more, but those are the ones that I tried that gave me an error.

I'll look at it... there is no easy HTML seperation for the synopsis, and each author seems to title it differently... I'll figure something out.

GComyn

[miceandmen]

Hi,

is it possible to add the site https://noveltrove.com? It's an erotic stories website, with almost 1k stories.

[gcomyn]

Originally Posted by Atherton25

And GravityTales! Awesome, BUT I found a problem with some of the ones I wanted to download. {--cut--}

I've sent an updated adapter to Jim. I basically changed it so that the title and author are only gotten from the headers, and any title or author listed are added to the synopsis (description/summary)...

Also, I commented out the code that retrieves the cover page, because everyone I tried got a 403: Forbidden error, but other images will be retrieved.

GComyn

[gcomyn]

Originally Posted by miceandmen

Hi,

is it possible to add the site https://noveltrove.com? It's an erotic stories website, with almost 1k stories.

It has the title, author, authorURL, submission date, and categories in a specified division, and the body of the story seems easy to get... so it shouldn't be too hard.

It's also a 1 story/page site, so any multi-chapter stories would have to be downloaded one chapter at a time.

I'm working on another right now, when I get it done, I'll work on this one. It may take a few days, or be done later today... not sure.

GComyn