[GUI Plugin] FanFicFare

[JimmXinu]

Originally Posted by culytera

Is it normal for the error log to show the URL for the tag instead of a specific work with that tag? It kind of looks like FFF was trying to download from the tag.

That was a call to 'Get Story URLs from Web Page' on a Search URL.

File "C:\Users\Robin.RICE-LAW\AppData\Roaming\calibre\plugins\FanFicFare.zip \fanficfare\geturls.py", line 44, in get_urls_from_page

[culytera]

Oh I see! Never thought to download from an entire tag before. I’ve redownloaded over 200 stories from my library several times now but surprisingly I haven’t gotten banned yet. It’s not something I do everyday though.

[Madisonian]

Originally Posted by JimmXinu

Without a story to look at, you'll have to explain what you mean by 'doesn't seem to be working'.

It isn't changing the HTML, or the appearance isn't what you expect afterwards? Because when I set it does what I explained above.

replace_tags_with_spans:pre

It does not change the HTML as confirmed by looking at it with Calibre's inspector feature. Does the setting go into the [defaults] section?

But if it should work like this I'll keep looking.

[JimmXinu]

Personally, I prefer using 'Edit book' to the viewer's inspector. Calibre can significantly rewrite the HTML as part of the pipe line that converts all the different formats before handing it to the viewer renderer.

Ideally, you'd only put replace_tags_with_spans in for the sites (or stories) you need it for. But in practice, <pre> tags aren't actually used much anymore.

I'd actually add <pre>, rather than replacing the existing settings, like so:

## the comma(,) is necessary
add_to_replace_tags_with_spans:,pre

I assume you know that you have to update the story (or download anew) before the replace_tags_with_spans change is applied?

Without knowing even the site you're trying to use, or seeing your personal.ini (there's a button to get a version with user/pass settings removed), I can't help any further. It's working as designed for me.

[jessbbaby34]

So I'm finding that one of the sites that used to work has suddenly stopped working, but still works with some. I've tried looking at the plugin and the site html to see if there's a difference between the stories that do work and those that don't, but with my limited skill I couldn't find anything.

The site is UtopiaStories . com

I saw once you said you didn't want public links to adult sites so I can DM specific examples if you want them. The pattern I've found is that if the story is linked on the homepage it works, but if it's found through search I get the "story does not exist" error, even for stories I have downloaded in the past with the exact same url.

So If you want DM examples I can but I didn't want to send them unless you need more info than that. The ~50 or so with links on the front page work and all others don't even though the urls and formatting seem not fundamentally different.

[applegaa]

Originally Posted by jessbbaby34

So I'm finding that one of the sites that used to work has suddenly stopped working, but still works with some. I've tried looking at the plugin and the site html to see if there's a difference between the stories that do work and those that don't, but with my limited skill I couldn't find anything.

The site is UtopiaStories . com

I saw once you said you didn't want public links to adult sites so I can DM specific examples if you want them. The pattern I've found is that if the story is linked on the homepage it works, but if it's found through search I get the "story does not exist" error, even for stories I have downloaded in the past with the exact same url.

So If you want DM examples I can but I didn't want to send them unless you need more info than that. The ~50 or so with links on the front page work and all others don't even though the urls and formatting seem not fundamentally different.

I took a look and it appears that the stories that fail are the ones where the author page is missing. The error is misleading in saying the story is not found when it's actually the author page that is not found. I didn't do exhaustive testing, but it seemed like authors with only older stories were more likely to be missing.

- Andrew

[jessbbaby34]

Huh, interesting idea about the author page. Is there a way to skip the checking for an author page?

followed from a working (front page) story to the author page and not everything from the author page is being picked up. Might still be a broken link, I don't know.

[culytera]

Under what circumstances does ${origchapter} actually retain the original value instead of having the same value as ${chapter} since the latter is affected by chapter_title_x_pattern?

[JimmXinu]

Originally Posted by jessbbaby34

...
I saw once you said you didn't want public links to adult sites so I can DM specific examples if you want them.
...

It's less me and more MobileRead wants to stay family friendly. DM'ing me NSFW links is fine.

Originally Posted by jessbbaby34

Huh, interesting idea about the author page. Is there a way to skip the checking for an author page?

I didn't write that adapter, but it looks like the only reason the author page is read is to get the story's category.

Most of the time, I don't like trying to code around site errors. In practice, I clicked to a dozen authors and didn't see a single story that wasn't category 'Bondage' on that site--the site's dedicated subject.

Plus the home page says it's a static copy of the site since Feb 22.

So I would not be hugely opposed to removing the author page fetch if you (meaning anyone who reads the site) will testify that they haven't seen other category values.

Originally Posted by culytera

Under what circumstances does ${origchapter} actually retain the original value instead of having the same value as ${chapter} since the latter is affected by chapter_title_x_pattern?

New chapter markings. Specifically, that's used to remove new chapter markings without needing to read the site again to get the chapter titles.

From defaults.ini:

Spoiler:

## If true, when updating an epub that already has old chapters, new
## chapters will be marked in the TOC and chapter header by using
## chapter_title_new_pattern and chapter_title_addnew_pattern to set
## the chapter title.
## If set to latestonly, only new chapters downloaded this time will
## be marked (new) and existing chapters will have any (new) marks
## removed.
##
## mark_new_chapters can be true, false or latestonly
mark_new_chapters:false

## chapter title patterns use python template substitution.  The
## ${number} is the 'chapter' number and ${title} is the chapter
## title, after applying chapter_title_strip_pattern.  ${index04} is
## chapter number padded with leading zeros (mostly for internal use)
## such as 0001.  ${index} == ${number} for backward compatibility.  A
## few site adapters add additional chapter metadata.

## The basic pattern used when not using add_chapter_numbers or
## mark_new_chapters
chapter_title_def_pattern:${title}

## Pattern used with add_chapter_numbers, but not mark_new_chapters
chapter_title_add_pattern:${number}. ${title}

## Pattern used with mark_new_chapters, but not add_chapter_numbers
## (new) is just text and can be changed.
chapter_title_new_pattern:(new) ${title}

## Pattern used with add_chapter_numbers and mark_new_chapters
## (new) is just text and can be changed.
chapter_title_addnew_pattern:${number}. (new) ${title}

[jessbbaby34]

"So I would not be hugely opposed to removing the author page fetch if you (meaning anyone who reads the site) will testify that they haven't seen other category values."


Yes that would be fine. I didn't realize it was trying to fetch categories since I don't think the site has those well defined.

Does it being a static copy mean other information might be unreachable?

[JimmXinu]

New Test Version Posted

2024-02-04
- adapter_wwwutopiastoriescom: Updates for site changes.

[jessbbaby34]

Originally Posted by JimmXinu

New Test Version Posted

2024-02-04
- adapter_wwwutopiastoriescom: Updates for site changes.

Thanks, works great.

[applegaa]

Originally Posted by JimmXinu

New Test Version Posted

2024-01-15
- Allow image/comic (/i/) and poems (/p/) on literotica


It's not quite that simple, but it also doesn't seem to be much more complex.

Literotica site is kind of a pain to support and I don't read it, so I don't have many examples to test with. No promises this change will stay if it breaks normal stories.

Unfortunately, it looks like this did add a bug to regular stories. I can't say for sure from my limited data, but the problem seems to have started after I installed this test version.

The problem is that it adds the word "None" at the end of each page. Here's an example:

Spoiler:

<p>With his head stuck in his scope and headphones attuned to listening for ambient but important signals, Michaels was too occupied to be watching the visual feeds. The sudden gasps and cries on the bridge was the only warning he had before a feedback loop the likes he had never experienced or could have imagined hit his instruments and he felt consciousness slip away as the hum of the ship beneath also slipped into silence.<br/>
</p>
None<p>Captain du Pont called for Michaels’ replacement to try and hail the Panzer.</p>

It also inserts one at the end of the story, as that is also the end of a page.

Spoiler:

I never bought into that mindset; somewhere deep down I have too much faith in humanity.</i></p>
None
</body>
</html>

I pulled up the page source for several stories and none of them have the word "None" where it could be grabbed. Also, there is no HTML formatting like it does for actual story text, so it seems to be some sort of programming check getting written to the output by mistake.

I took a look at the adapter code and debug log, but I'm just learning Python and wasn't able to figure anything out.

- Andrew

[JimmXinu]

Please post some SFW story URLs that exhibit the problem or PM NSFW ones.

[culytera]

Originally Posted by JimmXinu

New chapter markings. Specifically, that's used to remove new chapter markings without needing to read the site again to get the chapter titles.

Ah, I didn't have any stories that just updated so I couldn't test my chapter title patterns for that.

I assume there's no way to only affect chapters in an epub's TOC metadata using chapter_title_x_patterns while having a different pattern for the chapter pages (via chapter_start) and/or the TOC page (if you have include_tocpage set to true).