[GUI Plugin] FanFicFare

[edeniz]

Hi, Jim

I need help finding a workaround or something to two problems I have:

1) When I download a series, the anthology is created pretty well, but an error check with calibre's "edit ebook" gives out the following:

Spoiler:

WARNING: The file 1/content.opf has a mimetype that does not match its extension****[content.opf]
WARNING: The file 1/toc.ncx has a mimetype that does not match its extension****[content.opf]
WARNING: The file 2/toc.ncx has a mimetype that does not match its extension****[content.opf]
WARNING: The file 2/content.opf has a mimetype that does not match its extension****[content.opf]

Normally I ignore it or just use the auto correct errors option, and it's over and done with. But I have been wondering if this is one of those things for which the solution is in front of my face and I'm just not seeing it. I wonder simply because my ebook readers have a history of refusing to read a book or even crashing down for spectacularly stupid reasons such as a harmless stylesheet entry or a docfile type line it does not like. While I've not seen a problem with those anthology books before, the worry is there. So if there is a workaround, it'd be great.

Example link for a series: https://archiveofourown.org/series/525844
(Sorry, couldn't find a shorter series.)



2) A side effect of fanficfare stripping html tags from the stories, apparently:

When it deletes the tags, it also deletes the content sometimes. Example:

Spoiler:

</span>
</p><p class="p1">
  <span class="s1">‘Oh, okay.’<span class="Apple-converted-space">  </span>

In the example above, the unnecessary but harmless p class p1 and the span class s1 get kept, but the span class apple-converted-space gets deleted and the space that is inside the tag gets also deleted, and then we get ugly mashed up sentences.

Is there anything to be done about it? I mean, it's great that these useless tags get deleted, but I'd rather the content doesn't, you know?

Example link: https://archiveofourown.org/works/14103627[1]
(There was a better example, with deleted text inside and not just space, but I couldn't find the link anymore.)



I've attached my ini file in case it's relevant.

Thank you kindly for the help.

[Tanjamuse]

I've added the following to my personal.ini for Stories of Arda, but it doesn't get changed to the html link instead of text. It's both story and author url.

custom_columns_settings:
    authorHTML=>#author_url
    titleHTML=>#story_url

This is what it is:

http://www.storiesofarda.com/author.asp?AuthID=1011

and this is what I want:

Katzilla

(with the link hidden behind).

And here's a story-link:

http://www.storiesofarda.com/chapter...w.asp?SID=7581

This is what I have:

http://www.storiesofarda.com/chapterlistview.asp?SID=7581

and this is what I want:

A Red Sun Rises

(with the link hidden behind).

[JimmXinu]

@edeniz -

Re: Anthologies: Those files are there as part of EpubMerge's 'UnMerge' feature, which is how FFF makes Anthologies that it can update. There is currently no way in FFF to remove them. If you can prove that the extra files cause a problem, I will look into making it optional. One option now is to not use the Anthology feature in FFF and instead download individual stories and then manually use EpubMerge with 'Keep UnMerge Data' turned off.

Re: Stripping tags: Removing whitespace only containing tags that aren't 'p','td','th' is functioning as designed. If you want, you adjust the value of keep_empty_tags to add more tags to keep when empty.

I'm going to need to see an example of actual text being removed accidentally before I can troubleshoot that. Plus, you have replace_br_with_p set true, which introduces a bunch of heuristic tag editing. I would guess that you found an example of poor input HTML being handled badly.

[JimmXinu]

@Tanjamuse -

Putting titleHTML and authorHTML into custom columns works for me as long as the column type is Long Text with it's "Interpret this column as" set to HTML.

[edeniz]

Originally Posted by JimmXinu

@edeniz -

Re: Anthologies: Those files are there as part of EpubMerge's 'UnMerge' feature, which is how FFF makes Anthologies that it can update. There is currently no way in FFF to remove them. If you can prove that the extra files cause a problem, I will look into making it optional. One option now is to not use the Anthology feature in FFF and instead download individual stories and then manually use EpubMerge with 'Keep UnMerge Data' turned off.

Re: Stripping tags: Removing whitespace only containing tags that aren't 'p','td','th' is functioning as designed. If you want, you adjust the value of keep_empty_tags to add more tags to keep when empty.

I'm going to need to see an example of actual text being removed accidentally before I can troubleshoot that. Plus, you have replace_br_with_p set true, which introduces a bunch of heuristic tag editing. I would guess that you found an example of poor input HTML being handled badly.

Thank you kindly, Jim! This reply helps a lot actually.

My main issue was that there might have been something I was doing wrong or overlooking the obvious or something. I have a long history of doing just so especially with fanficfare, so this time I thought I'd head it off at the beginning.

I don't have a link to a story with the text removal at the moment (it was months ago and I don't remember now which story it was), but I'll report it if it happens again, thank you.

And yeah, in the cases I mentioned, with the spaces enclosed in tags, it was mainly due to bad uploading on the part of the authors in question, so there is that to consider as well, you're right.

[JimmXinu]

New Test Version Posted

2018-05-02
- Fix some metadata collection in adapter_webnovelcom. (#299)
- adapter_webnovelcom - use_pagecache - mostly for debugging.

[hairymuggle]

Hi Jimm!

Thanks so much for the updated version.

I've been meaning to ask - there seems to be an ongoing problem getting stories from whofic.com. Whenever I enter a URL (e.g: https://www.whofic.com/viewstory.php?sid=XXXX) I get an error message which says "No valid story URLs entered", even though the link is in the correct format (I hope).

It's been a problem for a few months now, though I managed to download a few stores from there in January. I've tried to download using the same URLs which worked before to no avail.

I have the latest Calibre and FanFicFare versions.

I'd appreciate any advice you can give me; Thanks!

[JimmXinu]

Originally Posted by hairymuggle

I've been meaning to ask - there seems to be an ongoing problem getting stories from whofic.com. Whenever I enter a URL (e.g: https://www.whofic.com/viewstory.php?sid=XXXX) I get an error message which says "No valid story URLs entered", even though the link is in the correct format (I hope).

Glad you like it.

That issue is the site now using https vs http. The next test version (probably later today) will have a fix for it.

[JimmXinu]

New Test Version Posted

2018-05-03
- Change adapter_whoficcom to https.
- Add rating and sitetags to adapter_webnovelcom.

[Tanjamuse]

Originally Posted by JimmXinu

@Tanjamuse -

Putting titleHTML and authorHTML into custom columns works for me as long as the column type is Long Text with it's "Interpret this column as" set to HTML.

I've looked at the columns in that library and they are set to html (see attached screenshot).

Also, can anyone see if there's an error in the coding on this site from AO3?

It only shows 19 stories instead of the 20 it's supposed to.

https://archiveofourown.org/tags/Assassin's%20Creed%20-%20All%20Media%20Types/works?commit=Sort+and+Filter&page=49&utf8=%E2%9C%9 3&work_search%5Bcomplete%5D=0&work_search%5Blangua ge_id%5D=&work_search%5Bother_tag_names%5D=&work_s earch%5Bquery%5D=restricted%3Afalse&work_search%5B sort_column%5D=revised_at

[hairymuggle]

Originally Posted by JimmXinu

New Test Version Posted

2018-05-03
- Change adapter_whoficcom to https.
- Add rating and sitetags to adapter_webnovelcom.

Brilliant! The update worked great! Thanks so much for the quick help!

[JimmXinu]

Originally Posted by Tanjamuse

I've looked at the columns in that library and they are set to html (see attached screenshot).

I don't know what's going on then. As far as I can tell, what I see is what you asked for.

Originally Posted by Tanjamuse

Also, can anyone see if there's an error in the coding on this site from AO3?

It only shows 19 stories instead of the 20 it's supposed to.

long url

Does it matter? It's a bit off-topic for this thread.

[Tanjamuse]

Sorry, I was just wondering if anyone could tell me if it was my fault or the coding for the site in general.

[JimmXinu]

Defunct Sites Roundup

I was checking all the sites and found only one that needed fixing this time (dates for gluttonyfiction.com), but there are a number that aren't working.

Sites broken or off line:

• dramione.org - Domain is there, but no site. Was also broken in Nov 2017
• fanfiction.mugglenet.com - mugglenet.com still there, but fanfiction.mugglenet.com not resolving
• fanfiction.tenhawkpresents.com - No Domain found
• imrightbehindyou.com - Generic "HostGator" page
• national-library.net - reports "I cannot connect to the database."
• nocturnal-light.net - Domain parked
• tolkienfanfiction.com - Domain is there, but no software running
• writing.whimsicalwanderings.net - No Domain found
• www.area52hkh.net - efiction appears offline. Was also broken in Nov 2017
• www.destinysgateway.com - Generic "HostGator" page
• www.fiction.thebrokenworld.org - reports "This Account has been suspended."

I'm less quick to remove defunct sites than I once was after having some come back, but clearly they don't work right now. If you want any of them back, you'll need to somehow contact the admin for that particular site.

Definitely removing:

• www.thealphagate.com - now redirects to AO3
• www.harrypotterfanfiction.com - now redirects to a page saying the site closed April 28 2018

[thoai69]

Hi, I've just got this space problem, for example "Sorry,Iwasjustwonderingifanyonecould..."
What can I do??