Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 07-17-2023, 09:38 AM   #8656
julo
Connoisseur
julo began at the beginning.
 
Posts: 72
Karma: 12
Join Date: Apr 2010
Location: Pittsburgh area
Device: prs-505,900,T2
Quote:
Originally Posted by Jager956 View Post
There is more of this chapter...
The source of this story is Storiesonline
To read the complete story you need to be logged in
This has been going on since last year and FFF has been fixed in April '22 to account for that. You may want to update FFF if you haven't yet.
But...
At or around the beginning of this year another sabotage was introduced: In the text after "There is more of this chapter..." of each chapter all "the" are replaced with "a". One can still read it but it seems, and is, weird reading it. I got completely away from SOL for that very reason even though there are unfinished series I started before and probably never will finish.
julo is offline   Reply With Quote
Old 07-17-2023, 03:44 PM   #8657
chicleeblair
Connoisseur
chicleeblair began at the beginning.
 
Posts: 97
Karma: 10
Join Date: Sep 2018
Device: iPad mini
I’ve figured out excluding character tags if they are already in ships, which is wonderful.

However. if a character is in both a “/“ and an “&” ship is there a way to:
1. eliminate the & if the / and & characters are the same
2. Prioritize the “/“ ship and split the “&” ship while only adding the new character? (I include everything in tags, because I use Bookfusion which only uploads tags into its extra metadata).

What I’d like is this:
1. If a fic has both ships a/b and a&b, I’d like to only have a/b show up.

2. if ships are A/B and B&c, I’d want a/b, c in the tags
I sort of know how to start this one. if you replace the “&" with “," you get a/b, b, c. I’d still have to go in and take out the duplicate b.


I think it’s probably a matter of exclude_pre and exclude_post, but my brain doesn’t work in sequences this way.
chicleeblair is offline   Reply With Quote
Old 07-17-2023, 03:45 PM   #8658
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,979
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by Jager956 View Post
There is more of this chapter...
The source of this story is Storiesonline
To read the complete story you need to be logged in:
Do you have a paid account? From Issue #756 from a couple years ago:
Quote:
Paid Storiesonline.net accounts don't see that, and, reportedly, FFF works normally with them.

Given that the site is original fiction, not fanfiction, I'm not inclined to try and work around it. I might add an error message reporting it.
JimmXinu is online now   Reply With Quote
Old 07-18-2023, 09:44 AM   #8659
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,979
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
New Test Version Posted

2023-07-18
- New Site: sunnydaleafterdark.com, thanks inklesspen!

https://github.com/JimmXinu/FanFicFare/pull/978
"This is an EFiction style site, focusing on Buffy the Vampire Slayer fics with the Buffy/Spike ship."
JimmXinu is online now   Reply With Quote
Old 07-18-2023, 10:29 AM   #8660
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,979
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by chicleeblair View Post
What I’d like is this:
1. If a fic has both ships a/b and a&b, I’d like to only have a/b show up.

2. if ships are A/B and B&c, I’d want a/b, c in the tags
I sort of know how to start this one. if you replace the “&" with “," you get a/b, b, c. I’d still have to go in and take out the duplicate b.
As described, I think that may be beyond FFF's capability.

For 1 the best I can think of is to not differentiate / and & ships anymore. Replace & with / (or both with a different char).

Anything operating on ships_LIST bumps into the issue of a/b and a&b possibly having a&c appear in between.

For 2 your partial actually gives you "a/b", "b , c". (Internally, metadata entries are lists of strings until saved.)

It's only by an accident of alphabetization that the 'b's are adjacent. "a/x", "b/c", "x&y" => "a/x", "b/c", "x , y"

Quote:
Originally Posted by chicleeblair View Post
I’ve figured out excluding character tags if they are already in ships, which is wonderful.
That case, if you assume that every char mentioned in ships is also in characters, wouldn't you get basically what you want by just eliminating all & ships?
JimmXinu is online now   Reply With Quote
Old 07-18-2023, 04:06 PM   #8661
chicleeblair
Connoisseur
chicleeblair began at the beginning.
 
Posts: 97
Karma: 10
Join Date: Sep 2018
Device: iPad mini
Okay, It’s manageable. I’m just trying to eliminate as many tags as possible for my bigger fandoms. ASOIAF is going to be a MESS.
chicleeblair is offline   Reply With Quote
Old 07-18-2023, 06:54 PM   #8662
halcyon6116
Junior Member
halcyon6116 began at the beginning.
 
Posts: 3
Karma: 10
Join Date: Jul 2023
Device: calibre
Hello, I'm having an issue downloading from storiesofarda - it's returning some stories with the error "substring not found". Is this a fix on my end? I am using FFF v4.25.0 on calibre 6.22.0.


Here are two examples where i got this error:
http://www.storiesofarda.com/chapter...w.asp?SID=6083
http://www.storiesofarda.com/chapter...w.asp?SID=6379
halcyon6116 is offline   Reply With Quote
Old 07-18-2023, 07:02 PM   #8663
culytera
Zealot
culytera ought to be getting tired of karma fortunes by now.culytera ought to be getting tired of karma fortunes by now.culytera ought to be getting tired of karma fortunes by now.culytera ought to be getting tired of karma fortunes by now.culytera ought to be getting tired of karma fortunes by now.culytera ought to be getting tired of karma fortunes by now.culytera ought to be getting tired of karma fortunes by now.culytera ought to be getting tired of karma fortunes by now.culytera ought to be getting tired of karma fortunes by now.culytera ought to be getting tired of karma fortunes by now.culytera ought to be getting tired of karma fortunes by now.
 
Posts: 125
Karma: 295674
Join Date: Jul 2021
Device: iPhone
Quote:
Originally Posted by chicleeblair View Post
Okay, It’s manageable. I’m just trying to eliminate as many tags as possible for my bigger fandoms. ASOIAF is going to be a MESS.
I find that not including freeformtags (I only use AO3 so idk for other sites) in the subject tags eliminates most of my issues with tag management. I also don’t keep characters since I can see them on the cover page.
culytera is offline   Reply With Quote
Old 07-18-2023, 07:30 PM   #8664
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,979
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by halcyon6116 View Post
Hello, I'm having an issue downloading from storiesofarda - it's returning some stories with the error "substring not found". Is this a fix on my end? I am using FFF v4.25.0 on calibre 6.22.0.


Here are two examples where i got this error:
http://www.storiesofarda.com/chapter...w.asp?SID=6083
http://www.storiesofarda.com/chapter...w.asp?SID=6379
I'm not seeing any errors with those stories.

Can you run Calibre in debug mode (under Calibre's Preferences dropdown) to capture the debug log for full details?
JimmXinu is online now   Reply With Quote
Old 07-18-2023, 07:51 PM   #8665
chicleeblair
Connoisseur
chicleeblair began at the beginning.
 
Posts: 97
Karma: 10
Join Date: Sep 2018
Device: iPad mini
I thought I had this figured out, but I thought it was possible to have a custom column with with the unedited tags downloaded from Archive, not the same tags as I see in the Tags column, once the personal.ini has been run. Or is unedited” only ever that it’s not affected by what I do in the tags browser on calibre, or did I change a setting?
chicleeblair is offline   Reply With Quote
Old 07-18-2023, 08:14 PM   #8666
halcyon6116
Junior Member
halcyon6116 began at the beginning.
 
Posts: 3
Karma: 10
Join Date: Jul 2023
Device: calibre
Quote:
Originally Posted by JimmXinu View Post
I'm not seeing any errors with those stories.

Can you run Calibre in debug mode (under Calibre's Preferences dropdown) to capture the debug log for full details?
Yes! Here is the log for three other stories that got the same error (attached file + text of log):
http://www.storiesofarda.com/chapter...w.asp?SID=6637
http://www.storiesofarda.com/chapter...w.asp?SID=6188
http://www.storiesofarda.com/chapter...w.asp?SID=5817

Spoiler:
Code:
Download 3 FanFiction Book(s)
	FFF: INFO: 2023-07-18 18:07:37,114: calibre_plugins.fanficfare_plugin.jobs(49): CPUs:3
	FFF: INFO: 2023-07-18 18:07:37,115: calibre_plugins.fanficfare_plugin.jobs(52): FanFicFare v4.25.0
	FFF: INFO: 2023-07-18 18:07:37,115: calibre_plugins.fanficfare_plugin.jobs(68): Launch background process for site www.storiesofarda.com:
	http://www.storiesofarda.com/chapterlistview.asp?SID=6637
	http://www.storiesofarda.com/chapterlistview.asp?SID=6188
	http://www.storiesofarda.com/chapterlistview.asp?SID=5817
	FFF: INFO: 2023-07-18 18:07:42,810: calibre_plugins.fanficfare_plugin.jobs(130): 
	
	================================================================================ site:(www.storiesofarda.com)
	FFF: INFO: 2023-07-18 18:07:38,577: calibre_plugins.fanficfare_plugin.jobs(211): 
	
	-------------------------------------------------------------------------------- http://www.storiesofarda.com/chapterlistview.asp?SID=6637
	FFF: DEBUG: 2023-07-18 18:07:38,597: configurable.py(1068): use_browser_cache:
	FFF: DEBUG: 2023-07-18 18:07:38,598: configurable.py(1088): use_basic_cache:False
	FFF: DEBUG: 2023-07-18 18:07:38,599: adapter_storiesofardacom.py(75): URL: http://www.storiesofarda.com/chapterlistview.asp?SID=6637
	FFF: DEBUG: 2023-07-18 18:07:38,599: fetcher_requests.py(114): 
	---------- REQ (GET) RequestsFetcher
	http://www.storiesofarda.com/chapterlistview.asp?SID=6637
	FFF: DEBUG: 2023-07-18 18:07:38,933: fetcher_requests.py(127): response code:200
	FFF: DEBUG: 2023-07-18 18:07:38,933: decorators.py(112): fromcache:False
	FFF: DEBUG: 2023-07-18 18:07:38,934: requestable.py(55): Encoding:Windows-1252
	FFF: DEBUG: 2023-07-18 18:07:38,965: fetcher_requests.py(114): 
	---------- REQ (GET) RequestsFetcher
	http://www.storiesofarda.com/author.asp?AuthID=2706
	FFF: DEBUG: 2023-07-18 18:07:39,155: fetcher_requests.py(127): response code:200
	FFF: DEBUG: 2023-07-18 18:07:39,155: decorators.py(112): fromcache:False
	FFF: DEBUG: 2023-07-18 18:07:39,155: requestable.py(55): Encoding:Windows-1252
	FFF: INFO: 2023-07-18 18:07:39,389: calibre_plugins.fanficfare_plugin.jobs(301): write to /var/folders/_w/b7kxqsqx72790dnj5sm6lwth0000gn/C/calibre_6.22.0_tmp_e0tnjwn_/fanficfare_4fh6b6z4/A Hawk and a Star-Mirach-hq5l_5vz.epub
	FFF: INFO: 2023-07-18 18:07:39,389: base_writer.py(190): Save directly to file: /var/folders/_w/b7kxqsqx72790dnj5sm6lwth0000gn/C/calibre_6.22.0_tmp_e0tnjwn_/fanficfare_4fh6b6z4/A Hawk and a Star-Mirach-hq5l_5vz.epub
	FFF: DEBUG: 2023-07-18 18:07:39,390: adapter_storiesofardacom.py(129): Getting chapter text from: http://www.storiesofarda.com/chapterview.asp?sid=6637&cid=28720
	FFF: DEBUG: 2023-07-18 18:07:39,391: fetcher_requests.py(114): 
	---------- REQ (GET) RequestsFetcher
	http://www.storiesofarda.com/chapterview.asp?sid=6637&cid=28720
	FFF: DEBUG: 2023-07-18 18:07:39,532: fetcher_requests.py(127): response code:200
	FFF: DEBUG: 2023-07-18 18:07:39,532: decorators.py(112): fromcache:False
	FFF: DEBUG: 2023-07-18 18:07:39,533: requestable.py(55): Encoding:Windows-1252
	FFF: DEBUG: 2023-07-18 18:07:39,572: adapter_storiesofardacom.py(129): Getting chapter text from: http://www.storiesofarda.com/chapterview.asp?sid=6637&cid=28766
	FFF: DEBUG: 2023-07-18 18:07:39,573: fetcher_requests.py(114): 
	---------- REQ (GET) RequestsFetcher
	http://www.storiesofarda.com/chapterview.asp?sid=6637&cid=28766
	FFF: DEBUG: 2023-07-18 18:07:39,727: fetcher_requests.py(127): response code:200
	FFF: DEBUG: 2023-07-18 18:07:39,727: decorators.py(112): fromcache:False
	FFF: DEBUG: 2023-07-18 18:07:39,728: requestable.py(55): Encoding:Windows-1252
	FFF: DEBUG: 2023-07-18 18:07:39,772: adapter_storiesofardacom.py(129): Getting chapter text from: http://www.storiesofarda.com/chapterview.asp?sid=6637&cid=28802
	FFF: DEBUG: 2023-07-18 18:07:39,773: fetcher_requests.py(114): 
	---------- REQ (GET) RequestsFetcher
	http://www.storiesofarda.com/chapterview.asp?sid=6637&cid=28802
	FFF: DEBUG: 2023-07-18 18:07:39,923: fetcher_requests.py(127): response code:200
	FFF: DEBUG: 2023-07-18 18:07:39,923: decorators.py(112): fromcache:False
	FFF: DEBUG: 2023-07-18 18:07:39,924: requestable.py(55): Encoding:Windows-1252
	FFF: DEBUG: 2023-07-18 18:07:39,980: adapter_storiesofardacom.py(129): Getting chapter text from: http://www.storiesofarda.com/chapterview.asp?sid=6637&cid=28874
	FFF: DEBUG: 2023-07-18 18:07:39,980: fetcher_requests.py(114): 
	---------- REQ (GET) RequestsFetcher
	http://www.storiesofarda.com/chapterview.asp?sid=6637&cid=28874
	FFF: DEBUG: 2023-07-18 18:07:40,119: fetcher_requests.py(127): response code:200
	FFF: DEBUG: 2023-07-18 18:07:40,119: decorators.py(112): fromcache:False
	FFF: DEBUG: 2023-07-18 18:07:40,120: requestable.py(55): Encoding:Windows-1252
	FFF: DEBUG: 2023-07-18 18:07:40,179: adapter_storiesofardacom.py(129): Getting chapter text from: http://www.storiesofarda.com/chapterview.asp?sid=6637&cid=28892
	FFF: DEBUG: 2023-07-18 18:07:40,180: fetcher_requests.py(114): 
	---------- REQ (GET) RequestsFetcher
	http://www.storiesofarda.com/chapterview.asp?sid=6637&cid=28892
	FFF: DEBUG: 2023-07-18 18:07:40,343: fetcher_requests.py(127): response code:200
	FFF: DEBUG: 2023-07-18 18:07:40,344: decorators.py(112): fromcache:False
	FFF: DEBUG: 2023-07-18 18:07:40,344: requestable.py(55): Encoding:Windows-1252
	FFF: DEBUG: 2023-07-18 18:07:40,411: adapter_storiesofardacom.py(129): Getting chapter text from: http://www.storiesofarda.com/chapterview.asp?sid=6637&cid=28905
	FFF: DEBUG: 2023-07-18 18:07:40,412: fetcher_requests.py(114): 
	---------- REQ (GET) RequestsFetcher
	http://www.storiesofarda.com/chapterview.asp?sid=6637&cid=28905
	FFF: DEBUG: 2023-07-18 18:07:40,542: fetcher_requests.py(127): response code:200
	FFF: DEBUG: 2023-07-18 18:07:40,542: decorators.py(112): fromcache:False
	FFF: DEBUG: 2023-07-18 18:07:40,542: requestable.py(55): Encoding:Windows-1252
	FFF: DEBUG: 2023-07-18 18:07:40,621: adapter_storiesofardacom.py(129): Getting chapter text from: http://www.storiesofarda.com/chapterview.asp?sid=6637&cid=28926
	FFF: DEBUG: 2023-07-18 18:07:40,622: fetcher_requests.py(114): 
	---------- REQ (GET) RequestsFetcher
	http://www.storiesofarda.com/chapterview.asp?sid=6637&cid=28926
	FFF: DEBUG: 2023-07-18 18:07:40,853: fetcher_requests.py(127): response code:200
	FFF: DEBUG: 2023-07-18 18:07:40,853: decorators.py(112): fromcache:False
	FFF: DEBUG: 2023-07-18 18:07:40,853: requestable.py(55): Encoding:Windows-1252
	FFF: INFO: 2023-07-18 18:07:40,854: calibre_plugins.fanficfare_plugin.jobs(434): Exception: {'title': 'A Hawk and a Star', 'author_sort': ['Mirach'], 'author': ['Mirach'], 'comments': '<div colspan="3">A tale about the beginning of the friendship between Eärendil and Eönwë. Darkness lurks somewhere still, and it hungers for light...</div>', 'good': False, 'status': 'Error', 'showerror': True, 'calibre_id': None, 'begin': None, 'end': None, 'comment': 'substring not found', 'url': 'http://www.storiesofarda.com/chapterlistview.asp?SID=6637', 'site': 'www.storiesofarda.com', 'series': '', 'added': False, 'pubdate': datetime.datetime(2010, 8, 20, 0, 0, tzinfo=SafeLocalTimeZone()), 'publisher': 'www.storiesofarda.com', 'uniqueurl': 'http://www.storiesofarda.com/chapterlistview.asp?SID=6637[None-None]', 'listorder': 0, 'collision': 'Update EPUB if New Chapters', 'is_adult': False, 'username': 'NoneGiven', 'password': '', 'icon': 'dialog_error.png', 'all_metadata': {'category': 'Lord of the Rings', 'genre': '', 'characters': '', 'ships': '', 'warnings': '', 'extratags': 'FanFiction', 'author': 'Mirach', 'authorId': '2706', 'authorUrl': 'http://www.storiesofarda.com/author.asp?AuthID=2706', 'lastupdate': 'Last Update Year/Month: 2011/02, Last Update: 2011/02/26', 'series': '', 'seriesUrl': '', 'language': '', 'status': 'Complete', 'datePublished': '2010-08-20', 'dateUpdated': '2011-02-26', 'dateCreated': '2023-07-18 18:07:34', 'rating': 'PG-13', 'numChapters': '14', 'numWords': '', 'words_added': '', 'site': 'www.storiesofarda.com', 'publisher': 'www.storiesofarda.com', 'storyId': '6637', 'title': 'A Hawk and a Star', 'titleHTML': "<a class='titlelink' href='http://www.storiesofarda.com/chapterlistview.asp?SID=6637'>A Hawk and a Star</a>", 'storyUrl': 'http://www.storiesofarda.com/chapterlistview.asp?SID=6637', 'sectionUrl': 'http://www.storiesofarda.com/chapterlistview.asp?SID=6637', 'description': '<div colspan="3">A tale about the beginning of the friendship between Eärendil and Eönwë. Darkness lurks somewhere still, and it hungers for light...</div>', 'formatname': '', 'formatext': '', 'siteabbrev': 'soa', 'version': 'FanFicFare v4.25.0', 'authorHTML': "<a class='authorlink' href='http://www.storiesofarda.com/author.asp?AuthID=2706'>Mirach</a>", 'seriesHTML': '', 'langcode': '', 'output_css': '', 'cover_image': ''}, 'tags': ['FanFiction', 'Lord of the Rings', 'Complete'], 'updatedate': datetime.datetime(2011, 2, 26, 0, 0, tzinfo=SafeLocalTimeZone()), 'timestamp': datetime.datetime(2023, 7, 18, 18, 7, 38, 590912, tzinfo=SafeLocalTimeZone()), 'calibre_columns': {}, 'outfile': '/var/folders/_w/b7kxqsqx72790dnj5sm6lwth0000gn/C/calibre_6.22.0_tmp_e0tnjwn_/fanficfare_4fh6b6z4/A Hawk and a Star-Mirach-hq5l_5vz.epub'}:substring not found
	Traceback (most recent call last):
	  File "calibre_plugins.fanficfare_plugin.jobs", line 303, in do_download_for_worker
	    writer.writeStory(outfilename=outfile,
	  File "/Users/jupiter/Library/Preferences/calibre/plugins/FanFicFare.zip/fanficfare/writers/base_writer.py", line 211, in writeStory
	    self.story = self.adapter.getStory(notification)
	  File "/Users/jupiter/Library/Preferences/calibre/plugins/FanFicFare.zip/fanficfare/adapters/base_adapter.py", line 250, in getStory
	    data = self.getChapterTextNum(url,index)
	  File "/Users/jupiter/Library/Preferences/calibre/plugins/FanFicFare.zip/fanficfare/adapters/base_adapter.py", line 438, in getChapterTextNum
	    return self.getChapterText(url)
	  File "/Users/jupiter/Library/Preferences/calibre/plugins/FanFicFare.zip/fanficfare/adapters/adapter_storiesofardacom.py", line 137, in getChapterText
	    data = data[data.index('<table width="90%" align="center">'):]
	ValueError: substring not found
	FFF: INFO: 2023-07-18 18:07:40,862: calibre_plugins.fanficfare_plugin.jobs(211): 
	
	-------------------------------------------------------------------------------- http://www.storiesofarda.com/chapterlistview.asp?SID=6188
	FFF: DEBUG: 2023-07-18 18:07:40,879: configurable.py(1068): use_browser_cache:
	FFF: DEBUG: 2023-07-18 18:07:40,879: configurable.py(1088): use_basic_cache:False
	FFF: DEBUG: 2023-07-18 18:07:40,879: adapter_storiesofardacom.py(75): URL: http://www.storiesofarda.com/chapterlistview.asp?SID=6188
	FFF: DEBUG: 2023-07-18 18:07:40,880: fetcher_requests.py(114): 
	---------- REQ (GET) RequestsFetcher
	http://www.storiesofarda.com/chapterlistview.asp?SID=6188
	FFF: DEBUG: 2023-07-18 18:07:41,093: fetcher_requests.py(127): response code:200
	FFF: DEBUG: 2023-07-18 18:07:41,093: decorators.py(112): fromcache:False
	FFF: DEBUG: 2023-07-18 18:07:41,094: requestable.py(55): Encoding:Windows-1252
	FFF: DEBUG: 2023-07-18 18:07:41,112: fetcher_requests.py(114): 
	---------- REQ (GET) RequestsFetcher
	http://www.storiesofarda.com/author.asp?AuthID=1966
	FFF: DEBUG: 2023-07-18 18:07:41,433: fetcher_requests.py(127): response code:200
	FFF: DEBUG: 2023-07-18 18:07:41,433: decorators.py(112): fromcache:False
	FFF: DEBUG: 2023-07-18 18:07:41,434: requestable.py(55): Encoding:Windows-1252
	FFF: INFO: 2023-07-18 18:07:41,559: calibre_plugins.fanficfare_plugin.jobs(301): write to /var/folders/_w/b7kxqsqx72790dnj5sm6lwth0000gn/C/calibre_6.22.0_tmp_e0tnjwn_/fanficfare_4fh6b6z4/A Black Evil-Nesta-15bykg71.epub
	FFF: INFO: 2023-07-18 18:07:41,560: base_writer.py(190): Save directly to file: /var/folders/_w/b7kxqsqx72790dnj5sm6lwth0000gn/C/calibre_6.22.0_tmp_e0tnjwn_/fanficfare_4fh6b6z4/A Black Evil-Nesta-15bykg71.epub
	FFF: DEBUG: 2023-07-18 18:07:41,561: adapter_storiesofardacom.py(129): Getting chapter text from: http://www.storiesofarda.com/chapterview.asp?sid=6188&cid=26424
	FFF: DEBUG: 2023-07-18 18:07:41,561: fetcher_requests.py(114): 
	---------- REQ (GET) RequestsFetcher
	http://www.storiesofarda.com/chapterview.asp?sid=6188&cid=26424
	FFF: DEBUG: 2023-07-18 18:07:41,759: fetcher_requests.py(127): response code:200
	FFF: DEBUG: 2023-07-18 18:07:41,759: decorators.py(112): fromcache:False
	FFF: DEBUG: 2023-07-18 18:07:41,759: requestable.py(55): Encoding:Windows-1252
	FFF: INFO: 2023-07-18 18:07:41,760: calibre_plugins.fanficfare_plugin.jobs(434): Exception: {'title': 'A Black Evil', 'author_sort': ['Nesta'], 'author': ['Nesta'], 'comments': '<div colspan="3">A story inspired by a dark corner of Middle Earth that must exist but is never thoroughly explored. </div>', 'good': False, 'status': 'Error', 'showerror': True, 'calibre_id': None, 'begin': None, 'end': None, 'comment': 'substring not found', 'url': 'http://www.storiesofarda.com/chapterlistview.asp?SID=6188', 'site': 'www.storiesofarda.com', 'series': '', 'added': False, 'pubdate': datetime.datetime(2009, 3, 17, 0, 0, tzinfo=SafeLocalTimeZone()), 'publisher': 'www.storiesofarda.com', 'uniqueurl': 'http://www.storiesofarda.com/chapterlistview.asp?SID=6188[None-None]', 'listorder': 1, 'collision': 'Update EPUB if New Chapters', 'is_adult': False, 'username': 'NoneGiven', 'password': '', 'icon': 'dialog_error.png', 'all_metadata': {'category': 'Lord of the Rings', 'genre': '', 'characters': '', 'ships': '', 'warnings': '', 'extratags': 'FanFiction', 'author': 'Nesta', 'authorId': '1966', 'authorUrl': 'http://www.storiesofarda.com/author.asp?AuthID=1966', 'lastupdate': 'Last Update Year/Month: 2009/03, Last Update: 2009/03/17', 'series': '', 'seriesUrl': '', 'language': '', 'status': 'Complete', 'datePublished': '2009-03-17', 'dateUpdated': '2009-03-17', 'dateCreated': '2023-07-18 18:07:35', 'rating': 'G', 'numChapters': '1', 'numWords': '', 'words_added': '', 'site': 'www.storiesofarda.com', 'publisher': 'www.storiesofarda.com', 'storyId': '6188', 'title': 'A Black Evil', 'titleHTML': "<a class='titlelink' href='http://www.storiesofarda.com/chapterlistview.asp?SID=6188'>A Black Evil</a>", 'storyUrl': 'http://www.storiesofarda.com/chapterlistview.asp?SID=6188', 'sectionUrl': 'http://www.storiesofarda.com/chapterlistview.asp?SID=6188', 'description': '<div colspan="3">A story inspired by a dark corner of Middle Earth that must exist but is never thoroughly explored. </div>', 'formatname': '', 'formatext': '', 'siteabbrev': 'soa', 'version': 'FanFicFare v4.25.0', 'authorHTML': "<a class='authorlink' href='http://www.storiesofarda.com/author.asp?AuthID=1966'>Nesta</a>", 'seriesHTML': '', 'langcode': '', 'output_css': '', 'cover_image': ''}, 'tags': ['FanFiction', 'Lord of the Rings', 'Complete'], 'updatedate': datetime.datetime(2009, 3, 17, 0, 0, tzinfo=SafeLocalTimeZone()), 'timestamp': datetime.datetime(2023, 7, 18, 18, 7, 40, 874367, tzinfo=SafeLocalTimeZone()), 'calibre_columns': {}, 'outfile': '/var/folders/_w/b7kxqsqx72790dnj5sm6lwth0000gn/C/calibre_6.22.0_tmp_e0tnjwn_/fanficfare_4fh6b6z4/A Black Evil-Nesta-15bykg71.epub'}:substring not found
	Traceback (most recent call last):
	  File "calibre_plugins.fanficfare_plugin.jobs", line 303, in do_download_for_worker
	    writer.writeStory(outfilename=outfile,
	  File "/Users/jupiter/Library/Preferences/calibre/plugins/FanFicFare.zip/fanficfare/writers/base_writer.py", line 211, in writeStory
	    self.story = self.adapter.getStory(notification)
	  File "/Users/jupiter/Library/Preferences/calibre/plugins/FanFicFare.zip/fanficfare/adapters/base_adapter.py", line 250, in getStory
	    data = self.getChapterTextNum(url,index)
	  File "/Users/jupiter/Library/Preferences/calibre/plugins/FanFicFare.zip/fanficfare/adapters/base_adapter.py", line 438, in getChapterTextNum
	    return self.getChapterText(url)
	  File "/Users/jupiter/Library/Preferences/calibre/plugins/FanFicFare.zip/fanficfare/adapters/adapter_storiesofardacom.py", line 137, in getChapterText
	    data = data[data.index('<table width="90%" align="center">'):]
	ValueError: substring not found
	FFF: INFO: 2023-07-18 18:07:41,764: calibre_plugins.fanficfare_plugin.jobs(211): 
	
	-------------------------------------------------------------------------------- http://www.storiesofarda.com/chapterlistview.asp?SID=5817
	FFF: DEBUG: 2023-07-18 18:07:41,781: configurable.py(1068): use_browser_cache:
	FFF: DEBUG: 2023-07-18 18:07:41,781: configurable.py(1088): use_basic_cache:False
	FFF: DEBUG: 2023-07-18 18:07:41,781: adapter_storiesofardacom.py(75): URL: http://www.storiesofarda.com/chapterlistview.asp?SID=5817
	FFF: DEBUG: 2023-07-18 18:07:41,782: fetcher_requests.py(114): 
	---------- REQ (GET) RequestsFetcher
	http://www.storiesofarda.com/chapterlistview.asp?SID=5817
	FFF: DEBUG: 2023-07-18 18:07:41,999: fetcher_requests.py(127): response code:200
	FFF: DEBUG: 2023-07-18 18:07:41,999: decorators.py(112): fromcache:False
	FFF: DEBUG: 2023-07-18 18:07:41,999: requestable.py(55): Encoding:Windows-1252
	FFF: DEBUG: 2023-07-18 18:07:42,017: fetcher_requests.py(114): 
	---------- REQ (GET) RequestsFetcher
	http://www.storiesofarda.com/author.asp?AuthID=2045
	FFF: DEBUG: 2023-07-18 18:07:42,122: fetcher_requests.py(127): response code:200
	FFF: DEBUG: 2023-07-18 18:07:42,122: decorators.py(112): fromcache:False
	FFF: DEBUG: 2023-07-18 18:07:42,123: requestable.py(55): Encoding:Windows-1252
	FFF: INFO: 2023-07-18 18:07:42,208: calibre_plugins.fanficfare_plugin.jobs(301): write to /var/folders/_w/b7kxqsqx72790dnj5sm6lwth0000gn/C/calibre_6.22.0_tmp_e0tnjwn_/fanficfare_4fh6b6z4/In Dark Places-Peredhil lover-d_6qtpq0.epub
	FFF: INFO: 2023-07-18 18:07:42,208: base_writer.py(190): Save directly to file: /var/folders/_w/b7kxqsqx72790dnj5sm6lwth0000gn/C/calibre_6.22.0_tmp_e0tnjwn_/fanficfare_4fh6b6z4/In Dark Places-Peredhil lover-d_6qtpq0.epub
	FFF: DEBUG: 2023-07-18 18:07:42,210: adapter_storiesofardacom.py(129): Getting chapter text from: http://www.storiesofarda.com/chapterview.asp?sid=5817&cid=24497
	FFF: DEBUG: 2023-07-18 18:07:42,211: fetcher_requests.py(114): 
	---------- REQ (GET) RequestsFetcher
	http://www.storiesofarda.com/chapterview.asp?sid=5817&cid=24497
	FFF: DEBUG: 2023-07-18 18:07:42,423: fetcher_requests.py(127): response code:200
	FFF: DEBUG: 2023-07-18 18:07:42,424: decorators.py(112): fromcache:False
	FFF: DEBUG: 2023-07-18 18:07:42,424: requestable.py(55): Encoding:Windows-1252
	FFF: INFO: 2023-07-18 18:07:42,425: calibre_plugins.fanficfare_plugin.jobs(434): Exception: {'title': 'In Dark Places', 'author_sort': ['Peredhil lover'], 'author': ['Peredhil lover'], 'comments': '<div colspan="3">When Aragorn falls captive to the enemy, he learns that there are fates far worse than death. Though the twins race to free him, will they arrive in time to save not only his body, but also his mind? Warning: dark themes.\n</div>', 'good': False, 'status': 'Error', 'showerror': True, 'calibre_id': None, 'begin': None, 'end': None, 'comment': 'substring not found', 'url': 'http://www.storiesofarda.com/chapterlistview.asp?SID=5817', 'site': 'www.storiesofarda.com', 'series': '', 'added': False, 'pubdate': datetime.datetime(2008, 3, 1, 0, 0, tzinfo=SafeLocalTimeZone()), 'publisher': 'www.storiesofarda.com', 'uniqueurl': 'http://www.storiesofarda.com/chapterlistview.asp?SID=5817[None-None]', 'listorder': 2, 'collision': 'Update EPUB if New Chapters', 'is_adult': False, 'username': 'NoneGiven', 'password': '', 'icon': 'dialog_error.png', 'all_metadata': {'category': 'Lord of the Rings', 'genre': '', 'characters': '', 'ships': '', 'warnings': '', 'extratags': 'FanFiction', 'author': 'Peredhil lover', 'authorId': '2045', 'authorUrl': 'http://www.storiesofarda.com/author.asp?AuthID=2045', 'lastupdate': 'Last Update Year/Month: 2008/03, Last Update: 2008/03/01', 'series': '', 'seriesUrl': '', 'language': '', 'status': 'In Progress', 'datePublished': '2008-03-01', 'dateUpdated': '2008-03-01', 'dateCreated': '2023-07-18 18:07:36', 'rating': 'R', 'numChapters': '1', 'numWords': '', 'words_added': '', 'site': 'www.storiesofarda.com', 'publisher': 'www.storiesofarda.com', 'storyId': '5817', 'title': 'In Dark Places', 'titleHTML': "<a class='titlelink' href='http://www.storiesofarda.com/chapterlistview.asp?SID=5817'>In Dark Places</a>", 'storyUrl': 'http://www.storiesofarda.com/chapterlistview.asp?SID=5817', 'sectionUrl': 'http://www.storiesofarda.com/chapterlistview.asp?SID=5817', 'description': '<div colspan="3">When Aragorn falls captive to the enemy, he learns that there are fates far worse than death. Though the twins race to free him, will they arrive in time to save not only his body, but also his mind? Warning: dark themes.\n</div>', 'formatname': '', 'formatext': '', 'siteabbrev': 'soa', 'version': 'FanFicFare v4.25.0', 'authorHTML': "<a class='authorlink' href='http://www.storiesofarda.com/author.asp?AuthID=2045'>Peredhil lover</a>", 'seriesHTML': '', 'langcode': '', 'output_css': '', 'cover_image': ''}, 'tags': ['FanFiction', 'In Progress', 'Lord of the Rings'], 'updatedate': datetime.datetime(2008, 3, 1, 0, 0, tzinfo=SafeLocalTimeZone()), 'timestamp': datetime.datetime(2023, 7, 18, 18, 7, 41, 776655, tzinfo=SafeLocalTimeZone()), 'calibre_columns': {}, 'outfile': '/var/folders/_w/b7kxqsqx72790dnj5sm6lwth0000gn/C/calibre_6.22.0_tmp_e0tnjwn_/fanficfare_4fh6b6z4/In Dark Places-Peredhil lover-d_6qtpq0.epub'}:substring not found
	Traceback (most recent call last):
	  File "calibre_plugins.fanficfare_plugin.jobs", line 303, in do_download_for_worker
	    writer.writeStory(outfilename=outfile,
	  File "/Users/jupiter/Library/Preferences/calibre/plugins/FanFicFare.zip/fanficfare/writers/base_writer.py", line 211, in writeStory
	    self.story = self.adapter.getStory(notification)
	  File "/Users/jupiter/Library/Preferences/calibre/plugins/FanFicFare.zip/fanficfare/adapters/base_adapter.py", line 250, in getStory
	    data = self.getChapterTextNum(url,index)
	  File "/Users/jupiter/Library/Preferences/calibre/plugins/FanFicFare.zip/fanficfare/adapters/base_adapter.py", line 438, in getChapterTextNum
	    return self.getChapterText(url)
	  File "/Users/jupiter/Library/Preferences/calibre/plugins/FanFicFare.zip/fanficfare/adapters/adapter_storiesofardacom.py", line 137, in getChapterText
	    data = data[data.index('<table width="90%" align="center">'):]
	ValueError: substring not found
	
	FFF: INFO: 2023-07-18 18:07:42,810: calibre_plugins.fanficfare_plugin.jobs(142): 
	Download Results:
	Error http://www.storiesofarda.com/chapterlistview.asp?SID=6637 substring not found
	Error http://www.storiesofarda.com/chapterlistview.asp?SID=6188 substring not found
	Error http://www.storiesofarda.com/chapterlistview.asp?SID=5817 substring not found
	
	FFF: INFO: 2023-07-18 18:07:42,810: calibre_plugins.fanficfare_plugin.jobs(166): 
	Error
	http://www.storiesofarda.com/chapterlistview.asp?SID=6637
	http://www.storiesofarda.com/chapterlistview.asp?SID=6188
	http://www.storiesofarda.com/chapterlistview.asp?SID=5817
	
qt.qpa.fonts: Populating font family aliases took 136 ms. Replace uses of missing font family "Monospace" with one that exists to avoid this cost.
Attached Files
File Type: txt tmpzptds3hh.txt (72.0 KB, 82 views)
halcyon6116 is offline   Reply With Quote
Old 07-18-2023, 08:17 PM   #8667
ownedbycats
Custom User Title
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 10,996
Karma: 75337983
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
Quote:
Originally Posted by chicleeblair View Post
I thought I had this figured out, but I thought it was possible to have a custom column with with the unedited tags downloaded from Archive, not the same tags as I see in the Tags column, once the personal.ini has been run. Or is unedited” only ever that it’s not affected by what I do in the tags browser on calibre, or did I change a setting?
Code:
[defaults]

add_to_extra_valid_entries:customentry

include_in_customentry:someentry.NOREPL

custom_columns_settings: 
 customentry =>#column
This will make it not apply any replace_metadatas/includes/excludes.

Last edited by ownedbycats; 07-18-2023 at 08:24 PM.
ownedbycats is offline   Reply With Quote
Old 07-19-2023, 01:25 AM   #8668
chicleeblair
Connoisseur
chicleeblair began at the beginning.
 
Posts: 97
Karma: 10
Join Date: Sep 2018
Device: iPad mini
Oh! thank you!!!!

Two more things (that seems to be how it goes for me lately!)

Is there a way to add a prefix (fandom before categorys included in subject_tags? Depending on how it works out on Bookfusion, I may go in and do this for characters/ships, but for now, I’m just using it to keep Fandoms together in the tags (as I said, the only extra metadata that populates over there) It’d be nice if fanficfare could do it, even though there’d still be some standardizing to do.

I thought AO3 was so much more standardized before I started this.

Secondly, if I add,,a to included_in subject tags, that will just append new entries to the tags, correct? not overwrite them?

Oh, and finally, I have two columns for status, one that’s a yes/no boolean and one that’s text, but neither of them seem to be updating. On custom column, status is set to “competed” so it should check yes for a completed fic, right? but the AO3 fic I just checked with had 3/3 and it didn’t do anything. It’s marked as complete. Is there something I should have in personal.ini instead?

This was the fic: https://archiveofourown.org/works/15645684
chicleeblair is offline   Reply With Quote
Old 07-19-2023, 06:04 AM   #8669
ownedbycats
Custom User Title
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 10,996
Karma: 75337983
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
Take a look at this, though used for categories instead of ships:
Code:
[defaults]

# tagscategory is a copy category for Fanfiction.category in tags
include_in_tagscategory:category
include_subject_tags: tagscategory

## tagcategory standardization
 tagscategory=>(Portal|Half-Life)=>Half-Life &amp; Portal
 tagscategory=>(Mass Effect: Andromeda|Mass Effect Trilogy)=>Mass Effect
## Sorts anything other than a few selected categories into "Fanfiction.Other"
 tagscategory=>^(?!.*(Half-Life|Portal|Mass Effect|The Elder Scrolls)).*$=>Other
## Adds Fanfiction. to the beginning of tagcategory
 tagscategory=>^(.*)$=>Fanfiction.\1
I vaguely remember trying to do a Fandom.Character tag with the same method but having issues with crossovers.

Quote:
Originally Posted by chicleeblair View Post
I thought AO3 was so much more standardized before I started this.
lol

Last edited by ownedbycats; 07-19-2023 at 08:28 AM.
ownedbycats is offline   Reply With Quote
Old 07-19-2023, 11:17 AM   #8670
culytera
Zealot
culytera ought to be getting tired of karma fortunes by now.culytera ought to be getting tired of karma fortunes by now.culytera ought to be getting tired of karma fortunes by now.culytera ought to be getting tired of karma fortunes by now.culytera ought to be getting tired of karma fortunes by now.culytera ought to be getting tired of karma fortunes by now.culytera ought to be getting tired of karma fortunes by now.culytera ought to be getting tired of karma fortunes by now.culytera ought to be getting tired of karma fortunes by now.culytera ought to be getting tired of karma fortunes by now.culytera ought to be getting tired of karma fortunes by now.
 
Posts: 125
Karma: 295674
Join Date: Jul 2021
Device: iPhone
Quote:
Originally Posted by chicleeblair View Post

Two more things (that seems to be how it goes for me lately!)

Is there a way to add a prefix (fandom before categorys included in subject_tags? Depending on how it works out on Bookfusion, I may go in and do this for characters/ships, but for now, I’m just using it to keep Fandoms together in the tags (as I said, the only extra metadata that populates over there) It’d be nice if fanficfare could do it, even though there’d still be some standardizing to do.
This is how I organize tags on Calibre. MapleRead just puts Calibre's tags all onto one tag filtering browser so I decided to add prefixes to the tags to make navigating through them easier on the app.

Quote:
Originally Posted by chicleeblair View Post
Secondly, if I add,,a to included_in subject tags, that will just append new entries to the tags, correct? not overwrite them?
I believe it should be "add_to_include_subject_tags:,"
Quote:
Originally Posted by chicleeblair View Post
Oh, and finally, I have two columns for status, one that’s a yes/no boolean and one that’s text, but neither of them seem to be updating. On custom column, status is set to “competed” so it should check yes for a completed fic, right? but the AO3 fic I just checked with had 3/3 and it didn’t do anything. It’s marked as complete. Is there something I should have in personal.ini instead?
Maybe you need to set your custom column to the metadata value? Though for Completed/In-progress to be considered yes/no values you might need to do something else because for yes/no custom columns I could only select one status for the value. So you might have to make a custom yes/no column each for Completed and In-Progress? Not sure though


Thankfully the ones I read don't tend to have a lot of fandoms I have to manually cleanup lol

Speaking of, is there a way to keep only the first item in a list? Like if a fandom has Main Fandom, Fandom 2, Fandom 3, I just want to keep Main Fandom for the subject tags. Would it just be regex like ^(.+),$?
culytera is offline   Reply With Quote
Reply

Tags
fanfiction


Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] KindleUnpack - The Plugin DiapDealer Plugins 523 07-15-2025 06:45 PM
[GUI Plugin] Open With kiwidude Plugins 404 02-21-2025 05:42 AM
[GUI Plugin] Marvin XD Philantrop Plugins 126 01-29-2017 12:48 PM
[GUI Plugin] KiNotes -axel- Plugins 0 07-14-2013 06:39 PM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 12:27 PM


All times are GMT -4. The time now is 02:43 PM.


MobileRead.com is a privately owned, operated and funded community.