[GUI Plugin] FanFicFare

[DuskyRose]

I'm getting an error on downloads from Archive of Our Own (AO3). I'm trying to batch download stories, and it seems that some stories won't download at all. Same ones, usually the first on the web page.

On the stories with a problem, the log shows...

"Error - Crawling Home - Sarah Problem (SarahProblem), SarahProblem - 'basic_cachefile - https://archiveofourown.org/works/9903398'"

When I try to download it by itself from outside the story, I get the same error.

When I try to download it by itself from inside the story, same error.

[new info: 9:58 am]

I just ran Caliber in Debug Mode, and the story then downloaded correctly. Went back to regular Caliber, and the story now downloads correctly.

[firefoxxy]

Originally Posted by JimmXinu

I have no idea either--it's coming from somewhere down inside the network code.

If you can run in debug mode (under Calibre's Preferences dropdown) and catch a debug log of it I might be able to tell more.

I tried it again in debug mode and it didn't work, no surprise.
The log file is attached.

[JimmXinu]

Turn off use_ssl_unverified_context--at least for fanfiction.net.

Apparently it doesn't work correctly with cloudscraper. I have no idea why not. I will investigate, but since fanfiction.net doesn't actually have SSL problems, it's not a huge priority.

[firefoxxy]

Originally Posted by JimmXinu

Turn off use_ssl_unverified_context--at least for fanfiction.net.

Apparently it doesn't work correctly with cloudscraper. I have no idea why not. I will investigate, but since fanfiction.net doesn't actually have SSL problems, it's not a huge priority.

Thank you, Jimm, it works now.

[ownedbycats]

Originally Posted by JimmXinu

I will investigate, but since fanfiction.net doesn't actually have SSL problems, it's not a huge priority.

Until a proper fix is found, perhaps it could become a defaults.ini setting under ffnet overrides.

EDIT: I made a pull request for that.

[darth1]

can anyone point me to the start of the cache style download an maybe jim could put it in the first posts?

[ownedbycats]

https://github.com/JimmXinu/FanFicFa...erCacheFeature

[firefox26]

Originally Posted by davidfor

A test worked here. There was a change on the site recently with the themes. You need to visit the site and choose the "Classic" theme. The adapter does not work with the other themes.

Thanks, its working now for me :-)

[idiom6]

On Ao3, this fic looks fine. (https://archiveofourown.org/works/19040326) But whenever I try to download it via FFF, there are italics everywhere starting with the passage that goes

And because no one has ever asked him that question.”

“I don’t think I picked up all of that,” Steve said, turning to Bucky.

I thought it might be a single misplaced < i > or < / i >, but the download is littered with them and there doesn't seem to be a quick fix. Is this a coding issue by the fic writer or is FFF doing something hinky?

[ravendm5]

Originally Posted by JimmXinu

Turn off use_ssl_unverified_context--at least for fanfiction.net.

Apparently it doesn't work correctly with cloudscraper. I have no idea why not. I will investigate, but since fanfiction.net doesn't actually have SSL problems, it's not a huge priority.

How exactly do I turn this off? Having the same issue with downloads erroring out.

Thank you!

[firefoxxy]

Originally Posted by ravendm5

How exactly do I turn this off? Having the same issue with downloads erroring out.

Thank you!

You have to open the FFF menu and select 'Configure FanFicFare'. (Sorry, using non-English version)

A new window opens inside calibre. Navigate to the tab 'personal.ini'. There, klick on the first button (personal.ini).

Copy "use_ssl_unverified_context" into the field and hit 'search'. This takes you to the entry in your ini, where you change

use_ssl_unverified_context:true

to

use_ssl_unverified_context:false

[JimmXinu]

New Test Version Posted

2021-02-25
- Remove some dup imports/code, thanks akshgpt7. Closes #663
- use_ssl_unverified_context:true ignored when use_clouadscraper:true

Originally Posted by ravendm5

How exactly do I turn this off? Having the same issue with downloads erroring out.

Follow firefoxxy's advice or install the new test version.

Originally Posted by idiom6

On Ao3, this fic looks fine. (https://archiveofourown.org/works/19040326) But whenever I try to download it via FFF, there are italics everywhere starting with the passage that goes
...
I thought it might be a single misplaced < i > or < / i >, but the download is littered with them and there doesn't seem to be a quick fix. Is this a coding issue by the fic writer or is FFF doing something hinky?

It's a coding issue by the fic writer. Or more likely, their editor program.

It's not hugely difficult to use Calibre's Edit Book and a couple find-and-replace's to fix it.

I'm a bit baffled why the browsers are choosing to interpret nested <i> tags as not italic. Is it that common an HTML error?

[ownedbycats]

Originally Posted by JimmXinu

It's a coding issue by the fic writer. Or more likely, their editor program.

I'm thinking it's likely the author wrote it in Google Docs (or another word processor that produces yucky garbage code) then copy-pasted it into AO3's rich text editor. That's known to result in a lot of weird formatting issues. I need to clean up the code of my own fanfic sometime.

Originally Posted by JimmXinu

I'm a bit baffled why the browsers are choosing to interpret nested <i> tags as not italic. Is it that common an HTML error?

Nested <i> tags are technically legal, though a bit odd. I try to explain:

HTML5 uses heavy use of what's caled semantic HTML. So while <em> is used for convey "stress emphasis" (e.g. noting something is very important ), <i> is supposed to convey an "alternate voice or mood" (e.g. technical terms, character thoughts, etc). The semantic distinction is mostly for users of screenreaders— <em> changes inflection, but <i> doesn't.

So while nesting <em> is meant to be even greater emphasis, there's no real definitive of what a nested <i> is actually supposed to convey. But it does create a separate element and italics can't be made more italic (unlike strong/bold text), so it's not surprising that they would be de-italicized instead.

[idiom6]

Originally Posted by JimmXinu

New Test Version Posted

It's not hugely difficult to use Calibre's Edit Book and a couple find-and-replace's to fix it.

Guess I'll have to. There are literally hundreds of these tags throughout the fic text.

[ravendm5]

Originally Posted by firefoxxy

You have to open the FFF menu and select 'Configure FanFicFare'. (Sorry, using non-English version)

A new window opens inside calibre. Navigate to the tab 'personal.ini'. There, klick on the first button (personal.ini).

Copy "use_ssl_unverified_context" into the field and hit 'search'. This takes you to the entry in your ini, where you change

use_ssl_unverified_context:true

to

use_ssl_unverified_context:false

Thank you for your help with this. I don't even see that line in the personal.ini but it seems like a previous comment about restarting in debug mode is working for now.