[GUI Plugin] FanFicFare

[ackomb]

Is anyone else experiencing problems with FF-Net and flaresolver, or is it just me? I've installed the latest version, but I keep getting the error question if I have started flaresolver.

[ownedbycats]

I successfully used Flaresolverr a few days ago.

Assuming that it's enabled in the setting (can't hurt to check; I once accidentally deleted the line) once in a while FFF just doesn't see that it's running. In that case restarting both Calibre and Flaresolverr fixed it.

[ackomb]

I found the issue is with Flaresolver, I start the program but after testing the connection it discontinues the program. I don't know why yet, I've tried re-installing but it's not working. However that is not an FFF issue so I'll have to take this issue elsewhere.

[estherflails]

Thank you for your suggestions.

Originally Posted by JimmXinu

BTW, doing both .text and stripHTML() is redundant. I prefer stripHTML() because it does some other stuff and definitely gets all sub tags.

I tried it with only stripHTML() but with that the metadata lacked spaces ("Inspired byTitlebyAuthor.") so I added the .text back.

Originally Posted by JimmXinu

I haven't tested it recently, but as I recall, it worked to populate a long text(HTML) custom column using yourentryHTML in custom_columns_settings.

I tried yourentryHTML but I couldn't get it to work, it ends up not fetching anything. Here are the relevant parts from my personal.ini:

Spoiler:

extra_valid_entries:inspired, seetheend, inspiredHTML

add_to_custom_columns_settings:
seetheend=>#inspired,r
inspiredHTML=>#inspired,r

I assume I'm doing something wrong here? 😅 I added the 'https://' + self.getSiteDomain() + alink['href'] part to the code too but it made no difference.

        inspired = metasoup.find('div',{'id':'children'})
        seetheend = metasoup.find('a',text='other works inspired by this one')
        if inspired:
            for alink in inspired.find_all('a'):
                if 'http' not in alink['href']:
                    alink['href']='https://' + self.getSiteDomain() + alink['href']
            self.story.setMetadata('inspired',stripHTML(inspired.text))
        elif seetheend:
            self.story.setMetadata('seetheend','See the end of the work for other works inspired by this one.')

[estherflails]

Originally Posted by ackomb

I found the issue is with Flaresolver, I start the program but after testing the connection it discontinues the program. I don't know why yet, I've tried re-installing but it's not working. However that is not an FFF issue so I'll have to take this issue elsewhere.

I tried 2.2.4 today and it is indeed not working. If you open it in command prompt it doesn't close and shows you the error, if you're interested in seeing it.

I downloaded 2.2.6 and that one works. I don't know which version you're using but if it's not the newest, it should solve the problem.

[JimmXinu]

Originally Posted by estherflails

I tried yourentryHTML but I couldn't get it to work, it ends up not fetching anything. Here are the relevant parts from my personal.ini:
...

Rather than go back and forth more times, here is an implementation that works for me for what I think you want.

Is this something other users would like included in FFF?

add_to_extra_valid_entries:,inspired, inspiredUrl, inspiredHTML, endnotes, endnotesUrl, endnotesHTML
add_to_make_linkhtml_entries:,inspired, endnotes
add_to_extra_titlepage_entries:,inspiredHTML,endnotesHTML
add_to_custom_columns_settings:
 inspiredHTML=>#long_text1
 endnotesHTML=>#long_text2

        notesdiv = metasoup.find('div', {'class' : "notes module"})
        if notesdiv:
            endnotesurl = notesdiv.find('a',href=re.compile('#work_endnotes$'))
            if endnotesurl:
                self.story.setMetadata('endnotesUrl',self.url+'?view_full_work=true'+'#work_endnotes')
                self.story.setMetadata('endnotes','Story has end notes')
            # logger.debug(self.story.getMetadata('endnotesUrl'))
            inspiredurl = notesdiv.find('a',href=re.compile('#children$'))
            if inspiredurl:
                self.story.setMetadata('inspiredUrl',self.url+'?view_full_work=true'+'#children')
                self.story.setMetadata('inspired','Story has inspired works')
            # logger.debug(self.story.getMetadata('inspiredUrl'))

[ackomb]

Originally Posted by estherflails

I tried 2.2.4 today and it is indeed not working. If you open it in command prompt it doesn't close and shows you the error, if you're interested in seeing it.

I downloaded 2.2.6 and that one works. I don't know which version you're using but if it's not the newest, it should solve the problem.

Thx, I was sure I had downloaded the latest version this afternoon but after reading this I just removed everything and downloaded it again and now it works again so apparently I had not.

[JimmXinu]

New Test Version Posted

2022-08-09
- adapter_adultfanfictionorg: http->https Closes #870

[JimmXinu]

New Version Released

Version 4.15.0 - 2022-08-11
- adapter_adultfanfictionorg: http->https Closes #870
- Fix for win10/qt6 progbar not displaying initially.
- Add get_section_url() for adapter_royalroadcom for longer story URL [sections]
- adapter_storiesonlinenet: Single chapter stories slightly different. Also scifistories and finestories. Closes #867
- Use cal6 icon theme system to allow plugin icon customization.

[ownedbycats]

Question: Is anyone else finding themselves unable to drag and drop from Thunderbird's email list to FFF's download URL window?

Somewhere between Windows, Calibre, and FFF all updating at once, it's not working anymore and giving me a crossed-out circle cursor. Dragging from the browser's address bar works as expected.

[JimmXinu]

It's working for me right now.

But I have seen for several years times when I would have to drag emails or links back and forth over the border of an area I'd made droppable several times before it would change cursors and allow it. As I recall, Kovid attributed it to qt issues when I asked.

[ownedbycats]

Unfortunately, I can't seem to get it working... restarted Calibre, restarted Thunderbird, restarted the computer.

4.14.3 is behaving the same, so it's likely a change in either Calibre or Windows.

[JimmXinu]

I just updated Thunderbird to the latest, and already updated calibre today; it still works for me.

Win10 says there's an update for me, but is stalled at "Downloading 0%". I'll check again if/when it finishes.

[ackomb]

Hey,

For the last +/- 24 hours I've been having issues using FFF in combination with Flaresolver.

FFF give the following error: HTTP Error in FFF '500 Server Error: Internal Server Error for url: http://localhost:8191/v1'(500) which I learned is a timeout error.

This is the flaresolver report:

PHP Code:

2022-08-13T12:17:43+02:00 INFO FlareSolverr v2.2.6
2022-08-13T12:17:43+02:00 INFO Testing web browser installation...
2022-08-13T12:17:45+02:00 INFO FlareSolverr User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:105.0) Gecko/20100101 Firefox/105.0
2022-08-13T12:17:45+02:00 INFO Test successful
2022-08-13T12:17:45+02:00 INFO Listening on http://0.0.0.0:8191
2022-08-13T12:19:51+02:00 INFO REQ-1 Incoming request => POST /v1 body: {"cmd":"request.get","url":"https://www.fanfiction.net/s/14108484/1/The-Regina-Parable","maxTimeout":30000,"cookies":[],"postData":null}
2022-08-13T12:19:52+02:00 INFO REQ-1 Cloudflare detected
2022-08-13T12:20:16+02:00 INFO REQ-1 Challenge solved
2022-08-13T12:20:22+02:00 WARN REQ-1 Page not reloaded (do not report!): Cause: Error: Protocol error (Page.navigate): Session closed. Most likely the page has been closed.
2022-08-13T12:20:22+02:00 ERROR REQ-1 Unexpected error: Error: Protocol error (Network.getCookies): Session closed. Most likely the page has been closed.
2022-08-13T12:20:22+02:00 ERROR REQ-1 Error: Unable to process browser request. Error: Maximum timeout reached. maxTimeout=30000 (ms)
2022-08-13T12:20:22+02:00 INFO REQ-1 Response in 31.614 s
2022-08-13T12:20:22+02:00 INFO REQ-2 Incoming request => POST /v1 body: {"cmd":"request.get","url":"https://www.fanfiction.net/s/14108484/1/The-Regina-Parable","maxTimeout":30000,"cookies":[],"postData":null}
2022-08-13T12:20:44+02:00 ERROR REQ-2 Unexpected error: TimeoutError: Navigation timeout of 10000 ms exceeded
2022-08-13T12:20:44+02:00 ERROR REQ-2 Error: Unable to process browser request. TimeoutError: Navigation timeout of 10000 ms exceeded
2022-08-13T12:20:44+02:00 INFO REQ-2 Response in 21.573 s
2022-08-13T12:20:48+02:00 INFO REQ-3 Incoming request => POST /v1 body: {"cmd":"request.get","url":"https://www.fanfiction.net/s/14108484/1/The-Regina-Parable","maxTimeout":30000,"cookies":[],"postData":null}
2022-08-13T12:21:10+02:00 ERROR REQ-3 Unexpected error: TimeoutError: Navigation timeout of 10000 ms exceeded
2022-08-13T12:21:10+02:00 ERROR REQ-3 Error: Unable to process browser request. TimeoutError: Navigation timeout of 10000 ms exceeded
2022-08-13T12:21:10+02:00 INFO REQ-3 Response in 21.96 s
2022-08-13T12:21:20+02:00 INFO REQ-4 Incoming request => POST /v1 body: {"cmd":"request.get","url":"https://www.fanfiction.net/s/14108484/1/The-Regina-Parable","maxTimeout":30000,"cookies":[],"postData":null}
2022-08-13T12:21:37+02:00 INFO REQ-4 Cloudflare detected
2022-08-13T12:21:52+02:00 ERROR REQ-4 Unexpected error: Error: Protocol error (Network.getCookies): Session closed. Most likely the page has been closed.
2022-08-13T12:21:52+02:00 ERROR REQ-4 Error: Unable to process browser request. Error: Maximum timeout reached. maxTimeout=30000 (ms)
2022-08-13T12:21:52+02:00 INFO REQ-4 Response in 32.007 s
2022-08-13T12:22:10+02:00 INFO REQ-5 Incoming request => POST /v1 body: {"cmd":"request.get","url":"https://www.fanfiction.net/s/14108484/1/The-Regina-Parable","maxTimeout":30000,"cookies":[],"postData":null}
2022-08-13T12:22:12+02:00 INFO REQ-5 Cloudflare detected
2022-08-13T12:22:41+02:00 ERROR REQ-5 Error: Unable to process browser request. Error: Maximum timeout reached. maxTimeout=30000 (ms)
2022-08-13T12:22:41+02:00 INFO REQ-5 Response in 31.606 s
2022-08-13T12:22:42+02:00 ERROR REQ-5 Unexpected error: Error: Protocol error (Network.getCookies): Session closed. Most likely the page has been closed. 


Is there anything I can do to solve this problem, or just wait it out?

[JimmXinu]

Originally Posted by ackomb

Hey,

For the last +/- 24 hours I've been having issues using FFF in combination with Flaresolver.

FFF give the following error: HTTP Error in FFF '500 Server Error: Internal Server Error for url: http://localhost:8191/v1'(500) which I learned is a timeout error.

...

Is there anything I can do to solve this problem, or just wait it out?

I've been seeing different cloudflare pages in browser while loading cache the last few days. I would speculate that ffnet has increased the level of screening again.

Honestly, I stopped using Flaresolverr and just use browser cache--along with basically not using ffnet for finding new stories anymore.