[GUI Plugin] FanFicFare

[JimmXinu]

Originally Posted by SilentShadow123

I'm continuing to get this error " 'NoneType' object has no attribute 'get_text' " whenever I try downloading fanfiction from AO3. Never seen this happen before, and it's only happening to a few fanfictions that I'm using the correct links for. Any way I can resolve this?

We've recently fixed an error with that description. Have you tried the posted test version? Link in my sig.

[JimmXinu]

New Version Released

Version 4.27.0 - 2023-09-01
- AO3: Real fix for adult string change, revert earlier attempted fixes.


Small release to get back on beginning of the month schedule and get this AO3 fix out.

[SilentShadow123]

Originally Posted by JimmXinu

We've recently fixed an error with that description. Have you tried the posted test version? Link in my sig.

Sorry, I see now that it's Version 4.27.0? I'm still unsure how to install this though, since I've only done FanficFare updates through calibre itself, and not through a zip file. I'm reading installation instructions but I can't wrap my head around it and would I need to re-configure all my settings and the personal.ini file?

[JimmXinu]

Originally Posted by SilentShadow123

Sorry, I see now that it's Version 4.27.0? I'm still unsure how to install this though, since I've only done FanficFare updates through calibre itself, and not through a zip file. I'm reading installation instructions but I can't wrap my head around it and would I need to re-configure all my settings and the personal.ini file?

In that case I would suggest you install the latest released version through Calibre. It's available now.

[John Maverick]

Today I updated FanFicFare to the current version (v4.27.0). When trying to update a story from ff.net, after minutes of trying to get the metadata, the update fails with the following error message:

Connection to flaresolverr proxy server failed.  Is flaresolverr started?

But FlareSolverr seem running fine and in the correct port (see the screenshot attached)

While I can't be 100% sure if the problem comes from FFF, yesterday I can use FFF with FlareSolverr normally.

I tested going back to version v4.26.0 of FFF, but he same problems keep happening.

My setup is the following:
OS: Linux Mint 21.1 x86_64
Calibre version: v6.25
FanFicFare version: v4.27.0
FlareSolverr version: v3.3.2

Like always thanks in advance.

[ownedbycats]

Previous versions can be getted here: https://github.com/JimmXinu/FanFicFare/releases

[Emerald_Lilies]

Originally Posted by JimmXinu

New Test Version Posted

2023-07-22
- AO3 fix for protected email addr in chapter name breaking chapter datetime

Reported over on the FFF google list.

I have a few fics downloaded from AO3 where email addresses (that are part of the story) have been replaced with [email protected]. I see from here that there's nothing that can be done about that? So I wouldn't bring this up, but I noticed that one of my fics still has the emails in it, everywhere except the summary.

Any idea why the emails in the body of the fic would have been kept when the ones in the summary were caught with the [email protected]? The fic is NSFW so I won't link to it, but I did attach SFW pictures that show what I'm talking about.

Side note, in trying to find other fics to try to duplicate this I did run into this amusing example where you end up with [email protected] in the fic title.
https://archiveofourown.org/works/14269212

[ownedbycats]

I found the story you screenshotted and took a look at the page source. Cloudflare adds some email protection to keep bots from scraping them:

<blockquote class="userstuff">
<hr/><p>from: <a href="/cdn-cgi/l/email-protection" class="__cf_email__" data-cfemail="3e4a4c5b504a105d4c5753537e4a565b57505a5b4e5b505a5b504a105d51104b55">[email*protected]</a><br/>to: <a href="/cdn-cgi/l/email-protection" class="__cf_email__" data-cfemail="ee828f9d9d819a8b8b8aae978f868181c08d8183">[email*protected]</a><br/>subject: Re: what the heck spell check</p><p>Coach Lasso,</p><p>I can assure you that my transfer has nothing to do with your club's relegation, nor is there anything that Richmond has done in error. Rather, I have spoken with my editors and we’ve agreed that this is the most appropriate course of action.</p><p>I wish you all the best in the season.<br/> <br/>-Trent Crimm<br/>+44 3032 723956<br/><a href="/cdn-cgi/l/email-protection" class="__cf_email__" data-cfemail="136761767d673d70617a7e7e53677b767a7d777663767d77767d673d707c3d6678">[email*protected]</a><br/>The Independent<br/>Northcliffe House<br/>2 Derry St<br/>London<br/>W8 5TT<br/>UK</p><hr/>
</blockquote>

If you follow the cdn-cgi link, you get this page which mentions javascript required.

Weirdly, the ones in the body are also protected. I suspect there's some slightly different processing going on there.

[JimmXinu]

Originally Posted by John Maverick

Today I updated FanFicFare to the current version (v4.27.0). When trying to update a story from ff.net, after minutes of trying to get the metadata, the update fails with the following error message:

Connection to flaresolverr proxy server failed.  Is flaresolverr started?

But FlareSolverr seem running fine and in the correct port (see the screenshot attached)

I just tried it and what I saw was flaresolverr failed to crack the protection and returned an error (I was using FS v3.3.3).

FFF doesn't differentiate between connection failed and FS failed. I don't believe that it can. But the FS output makes it apparent and FFF will fail more quickly if FS isn't reachable.

Originally Posted by Emerald_Lilies

I have a few fics downloaded from AO3 where email addresses (that are part of the story) have been replaced with [email protected]. I see from here that there's nothing that can be done about that? So I wouldn't bring this up, but I noticed that one of my fics still has the emails in it, everywhere except the summary.

I've looked into this before and as I recall, it was a significant pain to try and decode the protected emails--which is their intention.

I honestly have no idea how you got clear emails in the one story--I don't when searched for it and downloaded it. Did you perhaps manually correct them in past and forgot? I've done that to a few of my downloads.

FYI, despite the 'cf' in the var name, I don't think this has anything to do with CloudFlare. I don't believe AO3 used CF until very recently and this email thing has been there a long time. Or I guess it is. Nevermind.

[John Maverick]

Originally Posted by ownedbycats

Previous versions can be getted here: https://github.com/JimmXinu/FanFicFare/releases

Thanks for the link to the previous versions FFF.

Originally Posted by JimmXinu

I just tried it and what I saw was flaresolverr failed to crack the protection and returned an error (I was using FS v3.3.3).

FFF doesn't differentiate between connection failed and FS failed. I don't believe that it can. But the FS output makes it apparent and FFF will fail more quickly if FS isn't reachable.

I tested with the version of FF that I had yesterday, and the same errors happens. So it isn't the version of FFF.

Thanks for checking this JimmXinu.

[ownedbycats]

Originally Posted by JimmXinu

FYI, despite the 'cf' in the var name, I don't think this has anything to do with CloudFlare. I don't believe AO3 used CF until very recently and this email thing has been there a long time. Or I guess it is. Nevermind.

They only implemented the CF during the DDoS in July, but they might've been using something similiar before.

[DavidBrookes]

Sorry to bother everyone but could you please help me get Calibre/FanFicFare to work with FlareSolverr as I just can't get it to work under Windows 10? I am getting the following:

2023-09-02 14:53:26 DEBUG ReqId 6480 Started executable: `C:\Users\David Brookes\appdata\roaming\undetected_chromedriver\ch romedriver.exe` in a child process with pid: 2156
2023-09-02 14:53:27 DEBUG ReqId 6480 New instance of webdriver has been created to perform the request
2023-09-02 14:53:27 DEBUG ReqId 12380 Navigating to... https://www.fanfiction.net/s/14262626/1/Happy-Birthday
2023-09-02 14:53:27 INFO ReqId 12380 Challenge detected. Title found: Just a moment...
2023-09-02 14:53:27 DEBUG ReqId 12380 Waiting for title (attempt 1): Just a moment...
2023-09-02 14:53:28 DEBUG ReqId 12380 Timeout waiting for selector
2023-09-02 14:53:28 DEBUG ReqId 12380 Try to find the Cloudflare verify checkbox...
2023-09-02 14:53:28 DEBUG ReqId 12380 Cloudflare verify checkbox not found on the page.
2023-09-02 14:53:28 DEBUG ReqId 12380 Try to find the Cloudflare 'Verify you are human' button...
2023-09-02 14:53:29 DEBUG ReqId 12380 The Cloudflare 'Verify you are human' button not found on the page.
2023-09-02 14:53:31 DEBUG ReqId 12380 Waiting for title (attempt 2): Just a moment...
2023-09-02 14:53:32 DEBUG ReqId 12380 Timeout waiting for selector
2023-09-02 14:53:32 DEBUG ReqId 12380 Try to find the Cloudflare verify checkbox...
2023-09-02 14:53:32 DEBUG ReqId 12380 Cloudflare verify checkbox not found on the page.
2023-09-02 14:53:32 DEBUG ReqId 12380 Try to find the Cloudflare 'Verify you are human' button...
2023-09-02 14:53:32 DEBUG ReqId 12380 The Cloudflare 'Verify you are human' button not found on the page.

[ownedbycats]

See post 8859. Flaresolverr isn't working . There probably isn't much Jim can do about it. Use the cache method.

[DavidBrookes]

New version of Flaresolver has been released in the last few hours - 3.3.4 and it seems to be working.

[Emerald_Lilies]

Originally Posted by JimmXinu

I honestly have no idea how you got clear emails in the one story--I don't when searched for it and downloaded it. Did you perhaps manually correct them in past and forgot? I've done that to a few of my downloads.

I know I definitely didn't manually edit them, I've never done that before. I actually don't even know how lol- I'm going to go figure out how to do that now though. I'll just call it a weird fluke and move on

Thanks for looking into it (and everything else you do!)