Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 02-10-2023, 04:37 PM   #8041
jklly12
Member
jklly12 began at the beginning.
 
Posts: 21
Karma: 10
Join Date: Feb 2015
Device: Kindle
Quote:
Originally Posted by riothamus View Post
So I've been using FFF browser cache with FanFictionDownloader for a while now with few issues. I've just had to stop doing a bulk text file and do one fic at a time. However, today after updating to the latest versions of Calibre and FFF I'm getting the following error:

Code:
HTTP Error in FFF 'Page not found or expired in Browser Cache (see FFF setting browser_cache_age_limit)'(428) URL:'https://www.fanfiction.net/s/13983713/1/Wizards-of-the-Caribbean'
Any help would be appreciated as I didn't change any settings. This happened with 2 different fics.
I have been getting this same issue to. Though I'm using WebtoEpub Extension. I clear the cache but it keeps happening, it seems to happen with the older stories in my library
jklly12 is offline   Reply With Quote
Old 02-10-2023, 06:44 PM   #8042
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,973
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by fanfictioneer View Post
I attached the FFF log I got (removed the email address, not that I use it for anything else than FFF).

EDIT: I log in with the specified username and password without a problem, so I don't see why it doesn't work with FFF. :/
No useful info in the log this time.

What Style do you use to view SV? (It's in your Account Preferences.) I generally only support the default style/skin/view for a site and sometimes it makes a difference.

Are you sure you have the correct username & password in the correct section of personal.ini?

Do you have a '%' char in your password? Those need to be escaped by using '%%'. I've run into that one myself.
JimmXinu is offline   Reply With Quote
Advert
Old 02-10-2023, 06:48 PM   #8043
ownedbycats
Custom User Title
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 10,988
Karma: 75337983
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
For future reference, is needing to escape '%' specific to SV?
ownedbycats is online now   Reply With Quote
Old 02-10-2023, 06:50 PM   #8044
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,973
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by jklly12 View Post
I have been getting this same issue to. Though I'm using WebtoEpub Extension. I clear the cache but it keeps happening, it seems to happen with the older stories in my library
WebToEpub works differently than FanFictionDownloader. I did test with WebToEpub but not in all that many combinations.

It would be helpful to know what browser/os you use and a story URL or two since you think it's variable between different stories.
JimmXinu is offline   Reply With Quote
Old 02-10-2023, 06:51 PM   #8045
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,973
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by ownedbycats View Post
For future reference, is needing to escape '%' specific to SV?
No. It generally comes up with dates. From defaults.ini:

Code:
## dateUpdated/datePublished don't usually have time, but they do on this site.
## http://docs.python.org/library/datetime.html#strftime-strptime-behavior
## Note that ini format requires % to be escaped as %%.
dateUpdated_format:%%Y-%%m-%%d %%H:%%M:%%S
datePublished_format:%%Y-%%m-%%d %%H:%%M:%%S
JimmXinu is offline   Reply With Quote
Advert
Old 02-10-2023, 07:27 PM   #8046
fanfictioneer
Enthusiast
fanfictioneer doesn't litterfanfictioneer doesn't litter
 
Posts: 26
Karma: 110
Join Date: Oct 2018
Device: Kindle
Quote:
Originally Posted by JimmXinu View Post
No useful info in the log this time.

What Style do you use to view SV? (It's in your Account Preferences.) I generally only support the default style/skin/view for a site and sometimes it makes a difference.

Are you sure you have the correct username & password in the correct section of personal.ini?

Do you have a '%' char in your password? Those need to be escaped by using '%%'. I've run into that one myself.
Default style. I have a # sign in the password, though.

However, I just found that there's some sort of "detect possible compromised passwords thing" (from logging in with a private browser) that probably prevents FFF logging into the account successfully (the prompt is suppressed on my main browser, probably some sort of cookie).

After changing my password, it works. Sorry to waste your time!
fanfictioneer is offline   Reply With Quote
Old 02-10-2023, 10:09 PM   #8047
ownedbycats
Custom User Title
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 10,988
Karma: 75337983
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
Question: For Count Pages, does FFF override an unchecked "always overwrite an existing count" option? (I know there's the option for the word count to get from metadata.) I have it checked specifically for fanfics but I am not sure if it's necessary.
ownedbycats is online now   Reply With Quote
Old 02-11-2023, 07:59 AM   #8048
jklly12
Member
jklly12 began at the beginning.
 
Posts: 21
Karma: 10
Join Date: Feb 2015
Device: Kindle
Quote:
Originally Posted by JimmXinu View Post
WebToEpub works differently than FanFictionDownloader. I did test with WebToEpub but not in all that many combinations.

It would be helpful to know what browser/os you use and a story URL or two since you think it's variable between different stories.


The Browser I use is Chrome and the os is windows 11 and here is the story url i was using https://www.fanfiction.net/s/13671983/1/ which hadn't been updated sin April of 2022. Now when i removed the story and redownload it worked.
jklly12 is offline   Reply With Quote
Old 02-11-2023, 10:33 AM   #8049
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,973
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by ownedbycats View Post
Question: For Count Pages, does FFF override an unchecked "always overwrite an existing count" option? (I know there's the option for the word count to get from metadata.) I have it checked specifically for fanfics but I am not sure if it's necessary.
There's no such checkbox in FFF. There's a dropdown for when to run Count Pages with three pretty self-descriptive options.

Quote:
Originally Posted by jklly12 View Post
The Browser I use is Chrome and the os is windows 11 and here is the story url i was using https://www.fanfiction.net/s/13671983/1/ which hadn't been updated sin April of 2022. Now when i removed the story and redownload it worked.
I tested this with Chrome on my win10 and the only issue I ran into is that you need to use the full story URL with title now (https://www.fanfiction.net/s/1367198...e-Cursed-Arrow) instead of just .../1/. That's because the Browser Cache feature now looks in the cache by exact URL instead of scanning all entries and keeping matches.
JimmXinu is offline   Reply With Quote
Old 02-11-2023, 11:51 AM   #8050
jklly12
Member
jklly12 began at the beginning.
 
Posts: 21
Karma: 10
Join Date: Feb 2015
Device: Kindle
Quote:
Originally Posted by JimmXinu View Post
There's no such checkbox in FFF. There's a dropdown for when to run Count Pages with three pretty self-descriptive options.



I tested this with Chrome on my win10 and the only issue I ran into is that you need to use the full story URL with title now (https://www.fanfiction.net/s/1367198...e-Cursed-Arrow) instead of just .../1/. That's because the Browser Cache feature now looks in the cache by exact URL instead of scanning all entries and keeping matches.
I see the problem I just need to delete the old url and replace it with the one that has the actual title in it. Thanks that worked
jklly12 is offline   Reply With Quote
Old 02-11-2023, 12:03 PM   #8051
ownedbycats
Custom User Title
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 10,988
Karma: 75337983
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
Quote:
Originally Posted by JimmXinu View Post
There's no such checkbox in FFF. There's a dropdown for when to run Count Pages with three pretty self-descriptive options.
The 'always overwrite' option is from the Count Pages options. I know it override a checked option and doesn't overwrite the wordcount.

Does it also override an unchecked option and overwrite the pagecount?
Attached Thumbnails
Click image for larger version

Name:	2023-02-11 13_03_33-Customize Count Pages.png
Views:	300
Size:	24.8 KB
ID:	199644  

Last edited by ownedbycats; 02-11-2023 at 12:54 PM.
ownedbycats is online now   Reply With Quote
Old 02-11-2023, 02:07 PM   #8052
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,973
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by ownedbycats View Post
The 'always overwrite' option is from the Count Pages options. I know it override a checked option and doesn't overwrite the wordcount.

Does it also override an unchecked option and overwrite the pagecount?
FFF calls Count Page's count_statistics() method. See https://github.com/kiwidude68/calibr...action.py#L168

It looks to me like CP will apply its settings. Personally, I'd just try it and see.

I'd forgotten about it, but there is an important difference between 'Calculate Word Count' option on FFF's General tab and the settings on the FFF Count Pages tab.

'Calculate Word Count' uses Calibre's internal word count mechanism during the download phase and sets numWords as if that number had come from the site. Affects titlepage and if you are setting a word count column from FFF, either on Custom Columns tab or from custom_columns_settings.

The FFF Count Pages tab settings only control whether CP is called and with what count algorithms. After that it's all on CP.
JimmXinu is offline   Reply With Quote
Old 02-11-2023, 02:35 PM   #8053
ackomb
Zealot
ackomb has a spectacular aura aboutackomb has a spectacular aura aboutackomb has a spectacular aura aboutackomb has a spectacular aura aboutackomb has a spectacular aura aboutackomb has a spectacular aura aboutackomb has a spectacular aura aboutackomb has a spectacular aura aboutackomb has a spectacular aura aboutackomb has a spectacular aura aboutackomb has a spectacular aura about
 
Posts: 106
Karma: 4486
Join Date: Mar 2020
Location: Netherlands
Device: i-pad
Quote:
Originally Posted by culytera View Post
It doesn't seem to be registering 5000 as a smaller number than 10000, like it's just sorting by the first digit. I added a space before 5000 as a workaround.
I tried your style, in one of my own set-up custom columns in a test library and get different results. The last thing I can think of is the type of custom column used. I use a Comma separated text, like tags, shown in text browser type of column.

What type are you using?
Attached Thumbnails
Click image for larger version

Name:	Schermafbeelding 2023-02-11 203203.jpg
Views:	327
Size:	10.7 KB
ID:	199652  
ackomb is offline   Reply With Quote
Old 02-11-2023, 02:47 PM   #8054
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,973
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
New Test Version Posted

2023-02-11
- adapter_thesietchcom: Fix for site more closely following XenForo2
JimmXinu is offline   Reply With Quote
Old 02-11-2023, 02:56 PM   #8055
ownedbycats
Custom User Title
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 10,988
Karma: 75337983
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
Quote:
Originally Posted by JimmXinu View Post
FFF calls Count Page's count_statistics() method. See https://github.com/kiwidude68/calibr...action.py#L168

It looks to me like CP will apply its settings. Personally, I'd just try it and see.

I'd forgotten about it, but there is an important difference between 'Calculate Word Count' option on FFF's General tab and the settings on the FFF Count Pages tab.

'Calculate Word Count' uses Calibre's internal word count mechanism during the download phase and sets numWords as if that number had come from the site. Affects titlepage and if you are setting a word count column from FFF, either on Custom Columns tab or from custom_columns_settings.

The FFF Count Pages tab settings only control whether CP is called and with what count algorithms. After that it's all on CP.
That makes sense.

I did a few tests of my own. I disabled the 'always overwrite' option in Count Pages.

I ran 'update always' on a book with an existing pagecount. I got a message about it being not able to update it because "Book already has all statistics and overwrite is turned off."

For additional testing: can custom_column_settings be used to set a column to undefined?

I tried to set ''=>#pagecount to see if nulling out the column would allow Count Pages to re-populate it, but it didn't work.

Last edited by ownedbycats; 02-11-2023 at 04:08 PM. Reason: correcting mistake
ownedbycats is online now   Reply With Quote
Reply

Tags
fanfiction


Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] KindleUnpack - The Plugin DiapDealer Plugins 523 07-15-2025 06:45 PM
[GUI Plugin] Open With kiwidude Plugins 404 02-21-2025 05:42 AM
[GUI Plugin] Marvin XD Philantrop Plugins 126 01-29-2017 12:48 PM
[GUI Plugin] KiNotes -axel- Plugins 0 07-14-2013 06:39 PM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 12:27 PM


All times are GMT -4. The time now is 11:58 PM.


MobileRead.com is a privately owned, operated and funded community.