[GUI Plugin] FanFicFare

[Atherton25]

Originally Posted by gcomyn

I'll take a look at the request.. I'm working part time right now, so I have time to look and code right now.

I'm always on the look out for more site to peruse, so any suggestions would be helpful.
GComyn

In that case there's one more of immediate interest that I've been having to do some manual downloads from. It's very very similar to wuxiaworld, but it doesn't have many stories maybe a few dozen but I figured because of how similar it is it might be a structural duplicate or close. volarenovels.com is the site.

Edit: One more that I personally visit regularly for a few stories is moonbunnycafe.com not a huge amount of novels, wuxia/xanxia translations sites never seem to with only one or two exceptions, but some good ones.

[cryzed]

Those are wordpress blogs, structurally not similar at all unfortunately. I doubt that implementing an adapter that works for every story on the sites will be possible, unless the author or authors paid very close attention to be consistent. The newer stories seem to be consistent, but you never know with these kind of content management systems -- older stories might be structured differently. Just a heads up to gcomyn or anyone else who is planning on taking a go at this.

[PandathePanda]

Originally Posted by JimmXinu

@PandathePanda --

Think some gremlin corrupted my personal.ini file, removed it, and it now work

[Chrystalline]

Originally Posted by JimmXinu

I've included that site in the latest test version. However, I'm strongly leaning towards removing it before the next release if it's blocked for others.

I get the email digest for this forum, and the "Forbidden" thing caught my attention. The DeanDamage website loads fine on my Firefox at work (haven't tried from home yet) but points out that it is not secured. Attempting to force secure connection gets a "Record Too Long" error.

Grabbed the test version and tried a few so I could report how it behaved for me. Downloaded without trouble, though it only gets the first author for multi-author, and it doesn't get the Rating. If I keep any of these, I'll probably need to figure out how to customize personal.ini to make the Category always Supernatural so it sorts better with my Fandom-based Categories. (I have the vague idea that at least one more site I use needs that customization, but I can't remember it right now. Something in Star Trek fandom? or Stargate fandom? I can't remember...)

It does look like the site is mostly dead, though - the Most Recent are blatant spam and the latest news is from 2009. Hope this helps.

[JimmXinu]

Originally Posted by Chrystalline

I get the email digest for this forum, and the "Forbidden" thing caught my attention. The DeanDamage website loads fine on my Firefox at work (haven't tried from home yet) but points out that it is not secured. Attempting to force secure connection gets a "Record Too Long" error.

So nobody else has seen the site come up as blocked? Just me?

(We're not trying to use https with it, so I'm not concerned about that error--but I do see it too.)

Originally Posted by Chrystalline

...
I'll probably need to figure out how to customize personal.ini to make the Category always Supernatural so it sorts better with my Fandom-based Categories. (I have the vague idea that at least one more site I use needs that customization, but I can't remember it right now. Something in Star Trek fandom? or Stargate fandom? I can't remember...)

We do try to put categories etc like that in the defaults.ini. I'll add Supernatural to extracategories for that site and review the other recent adds.

[Atherton25]

@JimmXinu
Found a small bug. I tried this with a clean database (blank personal.ini) to verify before posting and it still happened. Tried it with 3 different sites, they all did it.

When the box 'New Only' under Configure FFF, Standard Columns,Author(s) is checked it doesn't change the author, but it does change Author Sort. I can't find anywhere where to change that as an option, and would assume it would be covered with Author.

One thing I have checked even in my (almost) default setting that I didn't think to check was it is set/checked to Force Author into Author Sort. I didn't think about looking if that affected it when doing my check.

[JimmXinu]

Originally Posted by Atherton25

...
One thing I have checked even in my (almost) default setting that I didn't think to check was it is set/checked to Force Author into Author Sort. I didn't think about looking if that affected it when doing my check.

On the contrary, "Force Author into Author Sort" checked is exactly what is causing what you see. Without it, author_sort is unchanged when standard column Author is checked 'New Only'. I'm glad you mentioned it, otherwise I'd not have found the problem.

I'll have a fix for this corner case (and the equivalent Force Title Sort) in the next test version.

[Chrystalline]

Originally Posted by JimmXinu

We do try to put categories etc like that in the defaults.ini. I'll add Supernatural to extracategories for that site and review the other recent adds.

Found it. It was Wraithbait. When I originally downloaded the stories I had, it wasn't putting Stargate Atlantis in the Categories column. Now it adds that, though it still keeps the other categories (ship pairings, character names) as well, so I may need to use the replace to force it. It'll take several lines, but that I can do. Thanks for all you do!

[JDesat]

Not sure if this is something I did in settings (I haven't really changed anything so I doubt it) or if something has changed with the storiesonline.net website, but I just downloaded a story that had been previously downloaded with FFF fine, including pics, and the new epub has no pics, just a little box where the pic should be showing a square with a question mark in it.

I'm sure SOL isn't a major site, and very few of the stories there have pics so I doubt this will be a priority, but if you ever get time to look into it that would be great.

[davidfor]

Originally Posted by JDesat

Not sure if this is something I did in settings (I haven't really changed anything so I doubt it) or if something has changed with the storiesonline.net website, but I just downloaded a story that had been previously downloaded with FFF fine, including pics, and the new epub has no pics, just a little box where the pic should be showing a square with a question mark in it.

I'm sure SOL isn't a major site, and very few of the stories there have pics so I doubt this will be a priority, but if you ever get time to look into it that would be great.

I just did a test on a couple of illustrated stories I have. The pictures dowloaded with no problems. It's possible it is problem with a particular story, if so, I need a URL to test. PM the link to me. Or it a could have been a network issue at the time. In that case, try again and see what happens.

[iakovl]

quick question
i have a fanfic that was redone under same url
so there is the old V1 i have an epub with using calibre with 22 chapters
and there is the new V2 who only has 2 chapters, anyway to make then into two files and not forcing calibre to overwrite the v1?

[ILB]

@iakovl
You can download V2 as a new book.
Choose "Add New Book" at "Show Download Options" - see attached.

Only Problem: You can´t update with the normal menu. It get´s the error message
"More than one identical book by Identifier URL or title/author(s)--can't tell which book to update/overwrite."
But you can manually choose V2 and use "Update existing FanFiction Books"

[JimmXinu]

Originally Posted by ILB

@iakovl
You can download V2 as a new book.
Choose "Add New Book" at "Show Download Options" - see attached.

Only Problem: You can´t update with the normal menu. It get´s the error message
"More than one identical book by Identifier URL or title/author(s)--can't tell which book to update/overwrite."
But you can manually choose V2 and use "Update existing FanFiction Books"

True. But you can also remove the URL Identifier from the first version. I also change the title so if you check "Search by Title/Author" and update by email/from URL, FFF doesn't find it anymore.

[JimmXinu]

New Test Version Posted

New AO3 performance feature: use_view_full_work option which is true by default. One hit to get the whole story instead of one per chapter.

This version updates the included dependencies. I haven't seen any bad interactions yet.

New site: alternatehistory.com - Requires both a user account and to wait for it to be verified to even see the subforum with stories in it.

2017-04-29
- New site alternatehistory.com as a base_xenforoforum_adapter. Plus base_xenforoforum_adapter fixes.
- Add site specific extracategories to new sites.
- Fix for PI suppressauthorsort/suppresstitlesort interacting wrong with Author/Title New Only. (PI only)
- Fix CLI -f option help for text vs txt.
- Add AO3 feature use_view_full_work -- true by default.
- Update included dependency packages
- Update html5lib from 0.9x7 to 0.9x9.
- Update to BeautifulSoup 4.5.3.
- Update six.py to 1.10.0.
- Update chardet to 3.0.2.
- Update html2text to (2016, 9, 19).
- Add chardet_confidence_limit option for 'auto' encoding setting.
- Add webencodings to included_dependencies. Needed by in web service with newer html5lib.
- Don't include html5lib(and webencodings) and six in PI zip--uses calibre's versions anyway.

[Atherton25]

Originally Posted by cryzed

Those are wordpress blogs, structurally not similar at all unfortunately. I doubt that implementing an adapter that works for every story on the sites will be possible, unless the author or authors paid very close attention to be consistent. The newer stories seem to be consistent, but you never know with these kind of content management systems -- older stories might be structured differently. Just a heads up to gcomyn or anyone else who is planning on taking a go at this.

Yeah, I was only look at the face of volarenovels, not the code. I can see the difference. I tried taking a shot at it myself but after an hour of trying to make it work I decided I'm not familiar enough with python to understand all the references and make the correct changes in an adapter to make it work. If I had something that was closer to Wordpress structure I could probably muddle my way through making one.

I know that Wordpress blog isn't supported, but without me going through every adapter to check (if I'd even be able to recognize it), do one of you that make the adapters normally know if there any specific in there that are wordpress specifically? And simple, with no hidden metadata for the author/title, like WuxiaWorld has. Something I could get a base to start from and see how to pick out the author/title/chapters from just the visible information? I am willing to give it a go, even if it's just for me and barely works.

If there isn't, that's alright, I was just curious.