[GUI Plugin] FanFicFare - Page 634

JimmXinu · 04-24-2024, 01:03 PM

Quote:

Originally Posted by Clarkster

I picked a "Sci-Fi & Fantasy" story/example that I don't believe would be NSFW (it has a small amount of cursing, but no sex). I wanted to provide a legitimate example of the problem as it relates to the site -- I can edit or delete the post if is is breaking the MR rules.

While I appreciate the effort, it's a site called litErotica. Even the banner ads are explicit.

Moderator Notice
For everyone: Please don't post in NSFW links in this thread.

Use PM or github to transmit NSFW site URLs.

MrKonan · 04-24-2024, 01:35 PM

Thanks for the test version

Got most of what I needed added/updated done. But it's having issue with a story series. (see log file)

Status
Title
Author
Comment
URL
Error
Unknown
Unknown
'NoneType' object has no attribute 'get_text'
https://www.<lit-e>.com/s/lilacs-in-bloom-pt-01

JimmXinu · 04-24-2024, 02:11 PM

New Test Version Posted

2024-04-24
- adapter_literotica: Not all chapters have Rating
- adapter_literotica: Beta site changes #1058
- Ficbook.net More metadata collection #1064 Thanks, dbhmw

Quote:

Originally Posted by MrKonan

Thanks for the test version

Got most of what I needed added/updated done. But it's having issue with a story series. (see log file)

JimmXinu · 04-24-2024, 07:00 PM

New Test Version Posted

2024-04-24
- adapter_literotica: Not all chapters have Rating
- adapter_literotica: Beta site changes #1058
- Ficbook.net More metadata collection #1064 Thanks, dbhmw
- Ficbook.net Add chapter dates for TOC #1065 Thanks, dbhmw

w4tchdoge · 04-25-2024, 10:14 AM

Hi again. I'm sorry that I keep coming back with more cover related issues but I'm currently having some problems with preventing covers generated using the GC plugin from embedding into an EPUB file.

I'm mostly going to talk about SB and SV since I don't have any stories i follow on QQ that have a cover.

I am currently testing this with this SB thread and this SV thread. My settings in "Calibre Cover" section of the FFF GUI settings page are as follows. I've moved the GC settings for XenForo stories from the INI file to the GUI in case that was influencing something, and I've made sure that "Inject/update the generated cover inside EPUB" is unchecked and that "Generate Calibre Cover" is set to "Yes, Always". My INI settings for [base_xenforoforum], [forums.spacebattles.com], and [forums.sufficientvelocity.com] are below:

Spoiler:

Code:

[base_xenforoforum]
add_to_exclude_metadata_pre:
 prefix_tags=~Commission

legend_spoilers:true

user_agent:Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36

add_to_extratags:,From CrW Forums

add_to_custom_columns_settings:
 dateUpdated=>#fff_dateupdated
 numChapters=>#fff_chapter_count
 status=>#fff_status
 numWords=>#fff_words
 cover_image=>#cover_type

[base_xenforoforum:epub]
add_to_extra_valid_entries:,normalized_storyUrl
include_in_normalized_storyUrl:storyUrl

add_to_replace_metadata:
 normalized_storyUrl=>(https?:\/\/forums?\..*?\.com\/(threads|posts)\/)(.*\.)?(\d+\/)(\?post.\d+.*\D(\d+))?=>\1\4\5

titlepage_start:<?xml version="1.0" encoding="UTF-8"?>
 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd">
 <html xmlns="http://www.w3.org/1999/xhtml">
 <head>
 <title>${title} by ${author}</title>
 <link href="stylesheet.css" type="text/css" charset="UTF-8" rel="stylesheet"/>
 </head>
 <body class="fff_titlepage">
 <div class="title">
 <h2><a href="${normalized_storyUrl}">${title}</a> by ${authorHTML}</h2>
 </div>
 <hr id="underTitle-horRule">
 <div>

titlepage_entry:
 <b>${label}:</b> ${value}<br />

titlepage_end:
 </div>
 </body>
 </html>

## ------------------------------------------------

[forums.spacebattles.com]
username:XXXXXXXX
password:XXXXXXXX
#always_login:true

#use_browser_cache:true
#use_browser_cache_only:true
#open_pages_in_browser:true

use_threadmark_wordcounts:true
#use_flaresolverr_proxy:true

add_to_extratags:,From SB

add_to_extra_valid_entries:,prefix_tags
include_in_prefix_tags:forumtags,tagsfromtitle

#generate_cover_settings:
# ${publisher}=>spacebattles.com=>SpaceBattles
# ${cover_image} => ((specific)|(first)|(default)|(^$)) => SpaceBattles

add_to_replace_metadata:
 prefix_tags=>^(.*)=>[SB] [t] \1

include_subject_tags:prefix_tags,extratags

## ------------------------------------------------

[forums.sufficientvelocity.com]
username:XXXXXXXX
password:XXXXXXXX
always_login:true

add_to_extratags:,From SV

add_to_extra_valid_entries:,prefix_tags
include_in_prefix_tags:forumtags,tagsfromtitle

#generate_cover_settings:
# ${publisher}=>sufficientvelocity.com=>SufficientVelocity
# ${cover_image} => ((specific)|(first)|(default)|(^$)) => SufficientVelocity

add_to_replace_metadata:
 prefix_tags=>^(.*)=>[SV] [t] \1

include_subject_tags:prefix_tags,extratags

When I try to download the test threads I mentioned with these settings and check the internal files using Calibre's EPUB editor, I see the GC generated cover as the cover.jpg for both the SB story and the SV story.

If I then disable GC for SpaceBattles and SufficientVelocity through the GUI, the EPUB covers are now what is displayed on the story's SB / SV thread.

I've reviewed my INI & GUI settings a few times now and I haven't found anything egregiously wrong, but seeing as I've previously missed some pretty obvious things I'd like to ask if anyone knows what's going on here.

In case you need the info:

Calibre version: 7.8.0 (Was on 7.9.0 but I downgraded to see if the issue persisted)
FFF version: 4.33.0
Windows version: Windows-10-10.0.19045-SP0 64bit (taken from FFF job details)
Generate Cover version: 2.3.4

MrKonan · 04-25-2024, 11:00 AM

Quote:

Originally Posted by JimmXinu

New Test Version Posted

2024-04-24
- adapter_literotica: Not all chapters have Rating
- adapter_literotica: Beta site changes #1058
- Ficbook.net More metadata collection #1064 Thanks, dbhmw
- Ficbook.net Add chapter dates for TOC #1065 Thanks, dbhmw

Thanks for the test versions.. It's working great for the past couple of days.

JimmXinu · 04-25-2024, 11:36 AM

Quote:

Originally Posted by w4tchdoge

When I try to download the test threads I mentioned with these settings and check the internal files using Calibre's EPUB editor, I see the GC generated cover as the cover.jpg for both the SB story and the SV story.

If I then disable GC for SpaceBattles and SufficientVelocity through the GUI, the EPUB covers are now what is displayed on the story's SB / SV thread.

I've copied your settings to an otherwise empty library and I don't see this happening.

I see the thread cover inside the epub and the GC cover in Calibre. Even after deliberately using Polish book to inject the GC cover and then updating, the epub has the thread cover.

You already covered most of the failure cases I can think of, so I'm rather at a loss. Some ideas are:

If you are doing one of the 'Update Calibre Metadata' update options that will not change the cover inside epub.

Trying to keep the ebook cover and the Calibre cover different probably isn't going to be easy. Calibre's Convert book, Send to device, and Save to disk all automatically inject Calibre's metadata and cover into the ebook as it is converted/sent/saved. And probably a few other places I've forgotten.

Oh! That's a good possibility: Inside Edit book, open Preferences, look for 'Integration with Calibre' (bottom left), and in that, see if 'Update metadata embedded in the book when opening' is checked. Because that will also inject the cover whenever you edit a book.

Click image for larger version

Name: Capture.PNG
Views: 106
Size: 279.7 KB
ID: 207823

w4tchdoge · 04-25-2024, 01:36 PM

Quote:

Originally Posted by JimmXinu

Oh! That's a good possibility: Inside Edit book, open Preferences, look for 'Integration with Calibre' (bottom left), and in that, see if 'Update metadata embedded in the book when opening' is checked. Because that will also inject the cover whenever you edit a book.

This seems to be what was causing cover injection, I unchecked that tickbox and GC covers aren't injected anymore when I open the test stories with Calibre's e-book editor. I also opened the epub using Sigil before trying it with Calibre and it seems like that integration option was indeed the one causing injection. Thank you for the tip!

Quote:

Originally Posted by JimmXinu

Calibre's Convert book, Send to device, and Save to disk all automatically inject Calibre's metadata and cover into the ebook as it is converted/sent/saved. And probably a few other places I've forgotten.

Bit of a bummer that my mobile devices won't preserve the original cover but it makes sense why that would be the case, and at least it will be there in Calibre.

Thank you again for your help!

applegaa · 04-25-2024, 05:43 PM

Quote:

Originally Posted by JimmXinu

New Test Version Posted

2024-04-24
- adapter_literotica: Not all chapters have Rating
- adapter_literotica: Beta site changes #1058
- Ficbook.net More metadata collection #1064 Thanks, dbhmw
- Ficbook.net Add chapter dates for TOC #1065 Thanks, dbhmw

The changes for Literotica are working for individual stories, but I'm getting an error when attempting to update series.

'<' not supported between instances of 'str' and 'Tag'

If I try a series that doesn't have any new chapters, it correctly says that it already contains the correct number of chapters rather than generating an error.

JimmXinu · 04-25-2024, 06:52 PM

Quote:

Originally Posted by applegaa

The changes for Literotica are working for individual stories, but I'm getting an error when attempting to update series.

'<' not supported between instances of 'str' and 'Tag'

If I try a series that doesn't have any new chapters, it correctly says that it already contains the correct number of chapters rather than generating an error.

Please PM me a story link, or post it to the github issue.

applegaa · 04-25-2024, 07:29 PM

Quote:

Originally Posted by JimmXinu

Please PM me a story link, or post it to the github issue.

I sent you a PM, but thought I would mention here that I found another issue where Literotica now only lists the first 25 chapters of longer series unless you click on a link to display the full list.

JimmXinu · 04-25-2024, 10:13 PM

Quote:

Originally Posted by applegaa

I sent you a PM, but thought I would mention here that I found another issue where Literotica now only lists the first 25 chapters of longer series unless you click on a link to display the full list.

Yep, heard about that.

There's going to need to be some pretty fundamental changes to the adapter.

Nchalada · 04-26-2024, 02:14 AM

Dang sites changing the way they fundamentally work!

JimmXinu · 04-26-2024, 02:31 PM

New Test Version Posted

2024-04-26
- adapter_literotica: Rewrite(mostly) for site changes. #1058
- adapter_literotica: Remove use_meta_keywords option. #1058

This also removes literotica features:

averrating metadata entry - I haven't found a reasonably parsable version in the new pages.
order_chapters_by_date option - New story series page doesn't give chapter dates.
use_meta_keywords option - Unnecessary now, they're collected elsewhere

EDIT: Also adds cover image, but only for multi-chapter stories?

ChaoticAdventure · 04-26-2024, 02:43 PM

Hi! I searched the thread for this but didn't find anything, so I'm just wondering:
(for context all of this may only apply to ao3, it's the only site I use)
It seems that when I update anthologies, they don't call the custom columns in calibre the same way normal fics do. I use some tags that I add manually to manage cover settings, but with anthologies, those tags don't appear to do anything. I don't suppose there is a way to have that happen? I understand it may just not work because of how the anthology function works, or may be cumbersome to add, and I don't want to create tons of extra work for you.
As an example of what I mean: I would manually add the tag "BNHAMulti" to a fic after I upload it to calibre for the first time. That tags column does not update when the fic updates, so it won't get overwritten. Then, when I update the fic, calibre will automatically use the "BNHAMulti" cover thanks to my cover settings. With anthologies, that just doesn't happen, and I have to change the cover manually after updating.

I also have a second question. For anthologies, is there any way to call the "total word count" statistic? When I call the word count, it seems to call the individual word counts for each fic in the anthology, which is just not what I'm looking for. I'm happy to keep updating those manually, but if the function already exists and I just can't find it, I would love to know.
Thanks in advance.

04-26-2024, 02:31 PM	#9509
JimmXinu Plugin Developer Posts: 7,206 Karma: 5006097 Join Date: Dec 2011 Location: Midwest USA Device: Kobo Clara Colour running KOReader	New Test Version Posted 2024-04-26 - adapter_literotica: Rewrite(mostly) for site changes. #1058 - adapter_literotica: Remove use_meta_keywords option. #1058 This also removes literotica features: averrating metadata entry - I haven't found a reasonably parsable version in the new pages. order_chapters_by_date option - New story series page doesn't give chapter dates. use_meta_keywords option - Unnecessary now, they're collected elsewhere EDIT: Also adds cover image, but only for multi-chapter stories?

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
[GUI Plugin] KindleUnpack - The Plugin	DiapDealer	Plugins	527	08-15-2025 02:36 PM
[GUI Plugin] Open With	kiwidude	Plugins	404	02-21-2025 06:42 AM
[GUI Plugin] Marvin XD	Philantrop	Plugins	126	01-29-2017 01:48 PM
[GUI Plugin] KiNotes	-axel-	Plugins	0	07-14-2013 07:39 PM
[GUI Plugin] Plugin Updater Deprecated	kiwidude	Plugins	159	06-19-2011 01:27 PM

04-24-2024, 07:00 PM	#9499
JimmXinu Plugin Developer Posts: 7,206 Karma: 5006097 Join Date: Dec 2011 Location: Midwest USA Device: Kobo Clara Colour running KOReader	New Test Version Posted 2024-04-24 - adapter_literotica: Not all chapters have Rating - adapter_literotica: Beta site changes #1058 - Ficbook.net More metadata collection #1064 Thanks, dbhmw - Ficbook.net Add chapter dates for TOC #1065 Thanks, dbhmw

04-26-2024, 02:14 AM	#9508
Nchalada Junior Member Posts: 4 Karma: 10 Join Date: Aug 2020 Device: Cool Reader on Galaxy S20+	Dang sites changing the way they fundamentally work!

04-26-2024, 02:43 PM	#9510
ChaoticAdventure Member Posts: 16 Karma: 10 Join Date: Jan 2024 Device: Kindle Paperwhite, Calibre	Hi! I searched the thread for this but didn't find anything, so I'm just wondering: (for context all of this may only apply to ao3, it's the only site I use) It seems that when I update anthologies, they don't call the custom columns in calibre the same way normal fics do. I use some tags that I add manually to manage cover settings, but with anthologies, those tags don't appear to do anything. I don't suppose there is a way to have that happen? I understand it may just not work because of how the anthology function works, or may be cumbersome to add, and I don't want to create tons of extra work for you. As an example of what I mean: I would manually add the tag "BNHAMulti" to a fic after I upload it to calibre for the first time. That tags column does not update when the fic updates, so it won't get overwritten. Then, when I update the fic, calibre will automatically use the "BNHAMulti" cover thanks to my cover settings. With anthologies, that just doesn't happen, and I have to change the cover manually after updating. I also have a second question. For anthologies, is there any way to call the "total word count" statistic? When I call the word count, it seems to call the individual word counts for each fic in the anthology, which is just not what I'm looking for. I'm happy to keep updating those manually, but if the function already exists and I just can't find it, I would love to know. Thanks in advance.

Advert

Advert