Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 10-21-2021, 04:03 PM   #6571
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 5,067
Karma: 876022
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Quote:
Originally Posted by Tiggy626 View Post
I'm not sure if this is the right way to request this, but I'd like to be able to download from http://www.blackraptor.net/.

On a related note, is there a way for me to look at this ENORMOUS thread to see if there are questions already answered about my issue?
I did look, that's not a very good candidate site--it looks like it's flat page site without any significant metadata or automated organization. I would also direct you to the first FAQ.

There's a 'Search this thread' function, although is the third different 'search' on the page. And Google does index mobileread.
JimmXinu is offline   Reply With Quote
Old 10-21-2021, 04:11 PM   #6572
ownedbycats
Wizard
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 3,176
Karma: 13476454
Join Date: Oct 2018
Device: Kobo Aura HD
Quote:
Originally Posted by Tiggy626 View Post
On a related note, is there a way for me to look at this ENORMOUS thread to see if there are questions already answered about my issue?
There's the "search this thread," but it can be a bit fussy and sometimes arbitrarily reject words. So when that fails I use Google with site:mobileread.com "fanficfare" my search terms.
ownedbycats is online now   Reply With Quote
Old 10-22-2021, 02:01 AM   #6573
Ser4nb2LUY6e
Enthusiast
Ser4nb2LUY6e began at the beginning.
 
Posts: 38
Karma: 10
Join Date: Jun 2017
Device: Moon+ Reader Pro on Android
Would it be possible to add a custom column that records how long the last download/update of a book took?
Ser4nb2LUY6e is offline   Reply With Quote
Old 10-22-2021, 04:02 AM   #6574
Ser4nb2LUY6e
Enthusiast
Ser4nb2LUY6e began at the beginning.
 
Posts: 38
Karma: 10
Join Date: Jun 2017
Device: Moon+ Reader Pro on Android
Quote:
Originally Posted by Ser4nb2LUY6e View Post
Would it be possible to add a custom column that records how long the last download/update of a book took?
Maybe also 3 columns that count successful (there was a change), unsuccessful (no change) and failed (error other than "no change) updates?
Ser4nb2LUY6e is offline   Reply With Quote
Old 10-22-2021, 12:32 PM   #6575
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 5,067
Karma: 876022
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Quote:
Originally Posted by Ser4nb2LUY6e View Post
Would it be possible to add a custom column that records how long the last download/update of a book took?
It's a bit complicated to break out story by story with all the foreground/background processing and caching that goes on.

If counted from the initial start with foreground metadata fetching, the time spent on other downloads' metadata fetch would also be counted. If counted from the start of background processing, metadata cached from FG fetching would discount that time.

And should end time be counted before the output file is written (so it can be included in logpage/titlepage) or after the output file is written? Which can be several to many seconds for large stories.

Existing dateCreated metadata is a datetime set on adapter create in the BG task for plugin.

I think I could add a dateDownloadFinished metadata entry set at the end of download (but before output write) pretty easily. Is there a way for Calibre to look up the output file's modified timestamp? That would give you time after output write.

I'm not really interested in trying to profile anymore accurately than that at a user level.

Quote:
Originally Posted by Ser4nb2LUY6e View Post
Maybe also 3 columns that count successful (there was a change), unsuccessful (no change) and failed (error other than "no change) updates?
I believe the existing 'error' column, with 'Save All Errors' checked, already covers that. Split it out as you like with custom columns.
JimmXinu is offline   Reply With Quote
Old 10-22-2021, 06:57 PM   #6576
ownedbycats
Wizard
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 3,176
Karma: 13476454
Join Date: Oct 2018
Device: Kobo Aura HD
FlareSolverr updated, but there's a lot of changes so it won't work with FFF. So use an older version (1.2.9) if you were planning to.

Last edited by ownedbycats; 10-22-2021 at 07:03 PM.
ownedbycats is online now   Reply With Quote
Old 10-22-2021, 07:01 PM   #6577
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 5,067
Karma: 876022
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Flaresolverr v2.0.0 is a complete rewrite, which says that it removes the download option that FFF uses.

I make no promises the new version will work.

EDIT: FusionFF specifically mentions the new Flaresolverr doesn't work with FFF. Seems to me an important detail when passing it on to a primarily user oriented forum...

Last edited by JimmXinu; 10-22-2021 at 07:04 PM.
JimmXinu is offline   Reply With Quote
Old 10-22-2021, 07:06 PM   #6578
ownedbycats
Wizard
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 3,176
Karma: 13476454
Join Date: Oct 2018
Device: Kobo Aura HD
That's what I was afraid of. I edited my post to make it a bit more clear that the new version won't work and to use 1.2.9.
ownedbycats is online now   Reply With Quote
Old 10-23-2021, 12:24 AM   #6579
Ser4nb2LUY6e
Enthusiast
Ser4nb2LUY6e began at the beginning.
 
Posts: 38
Karma: 10
Join Date: Jun 2017
Device: Moon+ Reader Pro on Android
Quote:
Originally Posted by JimmXinu View Post
It's a bit complicated to break out story by story with all the foreground/background processing and caching that goes on.

If counted from the initial start with foreground metadata fetching, the time spent on other downloads' metadata fetch would also be counted. If counted from the start of background processing, metadata cached from FG fetching would discount that time.

And should end time be counted before the output file is written (so it can be included in logpage/titlepage) or after the output file is written? Which can be several to many seconds for large stories.

Existing dateCreated metadata is a datetime set on adapter create in the BG task for plugin.

I think I could add a dateDownloadFinished metadata entry set at the end of download (but before output write) pretty easily. Is there a way for Calibre to look up the output file's modified timestamp? That would give you time after output write.

I'm not really interested in trying to profile anymore accurately than that at a user level.
I'm using the "Background Metadata" option if that makes a difference. (In my experience, for some reason, the total time for the update I daily run on 50 or so stories is always shorter with "background metadata" instead of metadata in the foreground and then download in the background).

With "Background Metadata", there should be a specific time window start to finish for each story?

Quote:
Originally Posted by JimmXinu View Post
I believe the existing 'error' column, with 'Save All Errors' checked, already covers that. Split it out as you like with custom columns.
I already have that column, but I'm not sure how that would give me what I want: three integer columns, one of which (depending on outcome) gets incremented by one every time FFF updates that story?
Ser4nb2LUY6e is offline   Reply With Quote
Old 10-24-2021, 11:46 AM   #6580
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 5,067
Karma: 876022
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
New Test Version Posted

2021-10-24
- adapter_wwwutopiastoriescom: Add siterating_votes,siterating,siterank_of,siterank,v iews #750
JimmXinu is offline   Reply With Quote
Old 10-25-2021, 01:32 PM   #6581
MrKonan
Member
MrKonan began at the beginning.
 
Posts: 13
Karma: 10
Join Date: Sep 2017
Device: iPad/Kindle App
Looks like SOL updated something that broke FFF. Getting 'NoneType' object is not subscriptable error when trying to update book(s) in library.
Spoiler:


FFF: DEBUG: 2021-10-25 12:15:08,815: fetcher.py(234):
========== MISS (GET) BasicCache
https://storiesonline.net/s/24816:i
FFF: DEBUG: 2021-10-25 12:15:08,815: fetcher.py(462):
---------- REQ (GET) RequestsFetcher
https://storiesonline.net/s/24816:i
FFF: DEBUG: 2021-10-25 12:15:09,019: fetcher.py(469): response code:200
FFF: DEBUG: 2021-10-25 12:15:09,019: fetcher.py(156): random sleep(1.00-3.00):1.53
FFF: DEBUG: 2021-10-25 12:15:10,549: requestable.py(50): Encoding:utf8
FFF: DEBUG: 2021-10-25 12:15:10,549: adapter_storiesonlinenet.py(108): Will now login to URL (https://storiesonline.net/sol-secure/login.php) as (xxxxx@xxxxx.com)
FFF: DEBUG: 2021-10-25 12:15:10,549: fetcher.py(234):
========== MISS (GET) BasicCache
https://storiesonline.net/sol-secure/login.php
FFF: DEBUG: 2021-10-25 12:15:10,549: fetcher.py(462):
---------- REQ (GET) RequestsFetcher
https://storiesonline.net/sol-secure/login.php
FFF: DEBUG: 2021-10-25 12:15:14,787: fetcher.py(469): response code:200
FFF: DEBUG: 2021-10-25 12:15:14,787: fetcher.py(156): random sleep(1.00-3.00):2.67
FFF: DEBUG: 2021-10-25 12:15:17,455: requestable.py(50): Encoding:utf8
FFF: ERROR: 2021-10-25 12:15:17,460: calibre_plugins.fanficfare_plugin.dialogs(721): Exception: {'title': 'Variation on a Theme, Book 2', 'author_sort': 'Grey Wolf', 'author': ['Grey Wolf'], 'comments': '', 'good': False, 'status': 'Error', 'showerror': True, 'calibre_id': 26134, 'begin': None, 'end': None, 'comment': "'NoneType' object is not subscriptable", 'url': 'https://storiesonline.net/s/24816', 'site': 'storiesonline.net', 'series': '', 'added': False, 'pubdate': None, 'publisher': 'storiesonline.net', 'listorder': 0, 'collision': 'Update EPUB if New Chapters'}:'NoneType' object is not subscriptable
Traceback (most recent call last):
File "calibre_plugins.fanficfare_plugin.dialogs", line 708, in do_loop
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 1330, in prep_download_loop
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 1202, in get_story_metadata_only
File "C:\Users\xxxxx\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\adapters\base_adapter.py", line 308, in getStoryMetadataOnly
File "C:\Users\xxxxx\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\adapters\adapter_storieson linenet.py", line 171, in doExtractChapterUrlsAndMetadata
File "C:\Users\xxxxx\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\adapters\adapter_storieson linenet.py", line 128, in performLogin
TypeError: 'NoneType' object is not subscriptable

Last edited by theducks; 10-25-2021 at 03:53 PM. Reason: spoilered
MrKonan is offline   Reply With Quote
Old 10-25-2021, 02:50 PM   #6582
mrEd
Junior Member
mrEd shines like a glazed doughnut.mrEd shines like a glazed doughnut.mrEd shines like a glazed doughnut.mrEd shines like a glazed doughnut.mrEd shines like a glazed doughnut.mrEd shines like a glazed doughnut.mrEd shines like a glazed doughnut.mrEd shines like a glazed doughnut.mrEd shines like a glazed doughnut.mrEd shines like a glazed doughnut.mrEd shines like a glazed doughnut.
 
Posts: 7
Karma: 8634
Join Date: Oct 2020
Device: none
I've not found what's causing the SOL issue, but I have found a small thing to tidy up in the login code.

Line 96, "WLPC log in System" should be changed to "WLPC Login".

The first phrase appears on both the login page and the page after logging in, the second only appears on the login page. Doesn't appear to cause any issues, but it might on some edge cases.
mrEd is offline   Reply With Quote
Old 10-25-2021, 03:10 PM   #6583
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 5,067
Karma: 876022
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
New Test Version Posted

2021-10-25
- adapter_storiesonlinenet: Fix for site updates, login and dates.
JimmXinu is offline   Reply With Quote
Old 10-25-2021, 03:17 PM   #6584
Durabys
Junior Member
Durabys began at the beginning.
 
Posts: 3
Karma: 10
Join Date: Oct 2021
Device: Samsung Galaxy Tab S6 Lite w/Calibre Companion+ReadEra
Exclamation Problem with alternatehistory.com/forum/

Okay. This is really weird. Fanficfare works on any of the other subforums but the Alien Space Bats and Other Magic subforum. Where it asks me for a login and password, twice, quickly after each other and then gives me error that it couldn't download the thread/story.

Code:
Status
Title
Author
Comment
URL
Error
Unknown
Unknown
Failed to Login for URL: (https://www.alternatehistory.com/forum/threads/napoleon-ii-the-eaglet-si.518482/) with username: (Durabys)
https://www.alternatehistory.com/forum/threads/napoleon-ii-the-eaglet-si.518482/
Please help. This problem goes on since I tried Fanficfare/Calibre on that subforum back in 2017.
Durabys is offline   Reply With Quote
Old 10-25-2021, 03:33 PM   #6585
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 5,067
Karma: 876022
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Quote:
Originally Posted by Durabys View Post
Okay. This is really weird. Fanficfare works on any of the other subforums but the Alien Space Bats and Other Magic subforum. Where it asks me for a login and password, twice, quickly after each other and then gives me error that it couldn't download the thread/story.

https://www.alternatehistory.com/for...let-si.518482/

Please help. This problem goes on since I tried Fanficfare/Calibre on that subforum back in 2017.
I was just able to download that story with username and password set in personal.ini under [www.alternatehistory.com]...

EDIT: Please post a debug log if you are still having problems.
JimmXinu is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] Open With kiwidude Plugins 386 11-24-2021 01:38 AM
[GUI Plugin] KindleUnpack - The Plugin DiapDealer Plugins 470 10-26-2021 09:15 AM
[GUI Plugin] Marvin XD Philantrop Plugins 126 01-29-2017 01:48 PM
[GUI Plugin] KiNotes -axel- Plugins 0 07-14-2013 07:39 PM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 01:27 PM


All times are GMT -4. The time now is 08:30 PM.


MobileRead.com is a privately owned, operated and funded community.