[GUI Plugin] FanFictionDownLoader

[JimmXinu]

Fix for literotica stories without b-s-story-tag-list.

This one is a temporary fix and will need to be addressed better. davidfor mentioned possibly providing an outright replacement for the literotica adapter.

[davidfor]

Originally Posted by JimmXinu

Fix for literotica stories without b-s-story-tag-list.

This one is a temporary fix and will need to be addressed better. davidfor mentioned possibly providing an outright replacement for the literotica adapter.

Yes, but I was hoping to get a comment from someone else who does use literotica about the way the stories were produced. My version does it the way I like it. If people disagreed, I wouldn't force it on them. Nobody has commented yet.

[kneon]

I've tried to download from Fictionpad since last update last week & even did the download you recommended above, but I'm still getting this error:


Status Title Author Comment
Bad Caught in the Flames tufano79 sequence item 0: expected string or Unicode, int found

URL
https://fictionpad.com/author/tufano79/stories/15571

Thanks for any help

[JimmXinu]

Originally Posted by kneon

I've tried to download from Fictionpad since last update last week & even did the download you recommended above, but I'm still getting this error:


Status Title Author Comment
Bad Caught in the Flames tufano79 sequence item 0: expected string or Unicode, int found

URL
https://fictionpad.com/author/tufano79/stories/15571

Thanks for any help

Are you sure you're using the latest one from https://www.mobileread.com/forums/sho...ostcount=3031? Because it worked for me.

If it doesn't, please switch calibre into debug mode (under Preferences menu) and try it again and post the debug output.

[JimmXinu]

Originally Posted by davidfor

Yes, but I was hoping to get a comment from someone else who does use literotica about the way the stories were produced. My version does it the way I like it. If people disagreed, I wouldn't force it on them. Nobody has commented yet.

In practice, I think most users are only here long enough to get their own problems fixed. I don't think many hang around.

What's different about the output from your adapter vs the current one? I didn't write either and I don't read the site.

[JimmXinu]

Version 1.8.26 - 25 Jun 2014

• Fixes for some metadata problems on various sites.
• Known problem: specific metadata 'eroticatags' for literotica.com doesn't work on all stories.

[kneon]

Originally Posted by JimmXinu

Are you sure you're using the latest one from https://www.mobileread.com/forums/sho...ostcount=3031? Because it worked for me.

If it doesn't, please switch calibre into debug mode (under Preferences menu) and try it again and post the debug output.

Fixed with the new updated thank you.

[davidfor]

Originally Posted by JimmXinu

In practice, I think most users are only here long enough to get their own problems fixed. I don't think many hang around.

Yes, that is a problem in most support forums.

What's different about the output from your adapter vs the current one? I didn't write either and I don't read the site.

The main difference is for multi-chapter stories and how the chapter titles are handled. At the moment, what is at the top of the page is shown as the chapter title. That means it will have something like "This it the story title Ch. 02" at the start of the chapter and in the ToC. My version attempts to parse that so that it uses "Chapter 2". I also put the one-line description for the chapter the start of the chapter separated from the text by a line. The description for the first chapter is used on the summary page/metadata, but there wasn't anywhere obvious for the other chapter descriptions.

[JimmXinu]

Originally Posted by davidfor

The main difference is for multi-chapter stories and how the chapter titles are handled. At the moment, what is at the top of the page is shown as the chapter title. That means it will have something like "This it the story title Ch. 02" at the start of the chapter and in the ToC. My version attempts to parse that so that it uses "Chapter 2". I also put the one-line description for the chapter the start of the chapter separated from the text by a line. The description for the first chapter is used on the summary page/metadata, but there wasn't anywhere obvious for the other chapter descriptions.

That sounds reasonable to me. I'd accept that.

Also, have you looked at how the ao3 adapter handles the various chapter head notes and foot notes? I remember that one makes some of it optional. Might give you ideas for the chapter descs.

[Amalthia]

Hi,

I've been using the replace_metadata: setting with good results. However, lately I've run across a slight problem.

When I downloaded this story: http://archiveofourown.org/works/1124782

The metadata it generated gave me this: a03 downloader, Avengers, Marvel, The Marvel (Marvel Movies), Thor

I bolded the part that should not be there.

These are my current settings: [behind the spoiler cut]

Spoiler:

# only put fandoms in tags
include_subject_tags: fandoms
# Remove the FanFiction tag that FFDL includes for most sites.
anthology_tags:
extratags: a03 downloader
replace_metadata:
 fandoms=>Agents of S.H.I.E.L.D. \(TV\)=>Agents of S.H.I.E.L.D.
 fandoms=>Arrow \(TV 2012\)=>Arrow
 fandoms=>The Amazing Spider\-\Man \(Movies \-\ Webb\)=>Spider-Man
 fandoms=>Spider\-\Man \(Comicverse\)=>Spider-Man
 fandoms=>Spider\-\Man \(Movies \-\ Raimi\)=>Spider-Man
 fandoms=>Captain America \(Movies\)=>Captain America
 fandoms=>Captain America \(2011\)=>Captain America
 fandoms=>Iron Man \(Comic\)=>Avengers
 fandoms=>Iron Man \(Movies\)=>Avengers
 fandoms=>Batman \(Comic\)=>DCU
 fandoms=>Red Robin \(Comic\)=>DCU
 fandoms=>Harry Potter \-\ J. K. Rowling=>Harry Potter
 fandoms=>Hawaii Five\-\0 \(2010\)=>Hawaii Five-0
 fandoms=>Marvel Cinematic Universe=>Marvel
 fandoms=>Marvel 616=>Marvel
 fandoms=>Marvel \(Comics\)=>Marvel
 fandoms=>Marvel \(Comicverse\)=>Marvel
 fandoms=>Marvel \(Movies\)=>Marvel
 fandoms=>Marvel \(2011\)=>Marvel
 fandoms=>Marvel \(2012\)=>Marvel
 fandoms=>Marvel Marvel Movies Universe=>Marvel
 fandoms=>Marvel \-\ All Media Type=>Marvel
 fandoms=>Marvel Avengers Movies Universe=>Marvel
 fandoms=>Marvel\:\ First Class \(2011\)=>X-Men
 fandoms=>Marvel Agents of S.H.I.E.L.D=>Agents of S.H.I.E.L.D.
 fandoms=>The Avengers \(Marvel Movies\)=>Avengers
 fandoms=>The Avengers \(2012\)=>Avengers
 fandoms=>The Avengers \(Marvel\) \-\ All Media Types=>Avengers
 fandoms=>Teen Wolf \(TV\)=>Teen Wolf
 fandoms=>Thor \(2011\)=>Thor
 fandoms=>Thor \(Movies\)=>Thor
 fandoms=>Rise of the Guardians \(2012\)=>Rise of the Guardians
 fandoms=>Star Trek \(2009\)=>Star Trek
 fandoms=>Star Trek\:\ Alternate Original Series \(Movies\)=>Star Trek
 fandoms=>Star Trek\:\ The Original Series \(Movies\)=>Star Trek
 fandoms=>Star Trek\:\ The Original Series=>Star Trek
 fandoms=>Star Trek\:\ Deep Space Nine=>Star Trek
 fandoms=>Star Trek\:\ Voyager=>Star Trek
 fandoms=>Star Trek\:\ Mirror Universe=>Star Trek
 fandoms=>Star Trek\:\ The Original Series=>Star Trek
 fandoms=>Supernatural RPF=>Supernatural
 fandoms=>X-Men \(Movies\)=>X-Men
 fandoms=>X-Men \-\ All Media Types=>X-Men
 fandoms=>X-Men\:\ First Class \(2011\)=>X-Men
 fandoms=>X-Men\:\ Days of Future Past \(2014\)=>X-Men
 fandoms=>X-Men \(Comicverse\)=>X-Men
 fandoms=>(Captain America|Thor|Avengers|Agents of S.H.I.E.L.D.|X-Men|Spider-Man)=>\1\,Marvel

I do not know where "The Marvel (Marvel Movies)" is coming from.

I'd appreciate any and all help in figuring this out.

Thanks,
Amalthia

[davidfor]

Originally Posted by JimmXinu

That sounds reasonable to me. I'd accept that.

That's what I think, but others...

Also, have you looked at how the ao3 adapter handles the various chapter head notes and foot notes? I remember that one makes some of it optional. Might give you ideas for the chapter descs.

I'll have a look over the weekend.

[JimmXinu]

Originally Posted by Amalthia

When I downloaded this story: http://archiveofourown.org/works/1124782

The metadata it generated gave me this: a03 downloader, Avengers, Marvel, The Marvel (Marvel Movies), Thor

I bolded the part that should not be there.

These are my current settings:

First, when posting personal.ini settings, please use 'code', not 'quote' tags (it's the hash sign button). That way it preserves the spacing and we can copy & paste from each other without having to put all the spaces in at the beginning of lines.

Second, I'm not sure what's causing your problem precisely, but I can tell you how to significantly reduce your replacement list and fix the problem.

The key is that you're not using the power of the regular expressions to work for you. The character '.' in regexp means "any character". '*' means "zero or more of the previous character".

So you can put '.*' in your expressions and match anything instead of having a line for each possible version used.

You'll need to double check and test it, but I think this will work for all the cases you had before.

replace_metadata:
 fandoms=>Arrow \(TV 2012\)=>Arrow
 fandoms=>Batman \(Comic\)=>DCU
 fandoms=>Red Robin \(Comic\)=>DCU
 fandoms=>Harry Potter.*=>Harry Potter
 fandoms=>Hawaii Five-0 \(2010\)=>Hawaii Five-0
 fandoms=>Marvel.*=>Marvel
 fandoms=>Teen Wolf.*=>Teen Wolf
 fandoms=>Rise of the Guardians.*=>Rise of the Guardians
 fandoms=>Star Trek.*=>Star Trek
 fandoms=>Supernatural RPF=>Supernatural
 fandoms=>Iron Man=>Avengers
 fandoms=>.*(Captain America|Thor|Avengers|Agents of S.H.I.E.L.D.|X-Men|Spider-Man).*=>\1\,Marvel

(You may have realized that that means 'Agents of S.H.I.E.L.D.' will also match "Agents of SzHzIzEzLzDz". In general, you can escape '.' with '\.' like '(' and ')'. In that particular case, the odds hitting something else that also matches are so small as to be negligible.)

[Amalthia]

Originally Posted by JimmXinu

First, when posting personal.ini settings, please use 'code', not 'quote' tags (it's the hash sign button). That way it preserves the spacing and we can copy & paste from each other without having to put all the spaces in at the beginning of lines.

Second, I'm not sure what's causing your problem precisely, but I can tell you how to significantly reduce your replacement list and fix the problem.

The key is that you're not using the power of the regular expressions to work for you. The character '.' in regexp means "any character". '*' means "zero or more of the previous character".

So you can put '.*' in your expressions and match anything instead of having a line for each possible version used.

You'll need to double check and test it, but I think this will work for all the cases you had before.

replace_metadata:
 fandoms=>Arrow \(TV 2012\)=>Arrow
 fandoms=>Batman \(Comic\)=>DCU
 fandoms=>Red Robin \(Comic\)=>DCU
 fandoms=>Harry Potter.*=>Harry Potter
 fandoms=>Hawaii Five-0 \(2010\)=>Hawaii Five-0
 fandoms=>Marvel.*=>Marvel
 fandoms=>Teen Wolf.*=>Teen Wolf
 fandoms=>Rise of the Guardians.*=>Rise of the Guardians
 fandoms=>Star Trek.*=>Star Trek
 fandoms=>Supernatural RPF=>Supernatural
 fandoms=>Iron Man=>Avengers
 fandoms=>.*(Captain America|Thor|Avengers|Agents of S.H.I.E.L.D.|X-Men|Spider-Man).*=>\1\,Marvel

(You may have realized that that means 'Agents of S.H.I.E.L.D.' will also match "Agents of SzHzIzEzLzDz". In general, you can escape '.' with '\.' like '(' and ')'. In that particular case, the odds hitting something else that also matches are so small as to be negligible.)

Hi, I will give this a try and yes it would be nice to cut down the amount of lines I'm using. Sorry about using quotes instead of code, I'll use code next time.

Thanks for helping!
Amalthia

[PeterT]

As an FYI, even if the message was posted with QUOTE rather than CODE as long as you do a QUOTE yourself of the original message, you WILL see the indentation as the user had entered it.

Another handy trick is to wrap the [code] xxxx [/code] tags within a [spoiler] ... [/spoiler] pair; this way one does not have to scroll through a long message, just a shortened version.

Lorem ipsum dolor sit amet, consectetur adipiscing elit. 
Nam iaculis enim at libero congue, nec rutrum dui cursus. 
In consequat, dui eget hendrerit varius, odio magna luctus lacus, a lacinia metus nisl id quam. 
Sed quis sollicitudin mi. 
Pellentesque tincidunt lobortis mi, a vestibulum metus faucibus ut. 
Sed quis felis in quam iaculis tempus. Duis justo erat, sagittis at bibendum sit amet, malesuada id lectus. 
Nullam adipiscing, erat at varius tempus, urna erat malesuada sem, interdum condimentum ante felis cursus odio. Integer malesuada eros dui, quis congue elit tristique ut. Pellentesque laoreet in elit eget tristique. In a nunc felis. Nullam sodales mi non nibh congue, eget pulvinar dolor lobortis. Praesent est elit, blandit in porttitor ut, eleifend vel velit. Pellentesque eu nulla non nibh sodales vestibulum. In hac habitasse platea dictumst.

vs

Spoiler:

Lorem ipsum dolor sit amet, consectetur adipiscing elit. 
Nam iaculis enim at libero congue, nec rutrum dui cursus. 
In consequat, dui eget hendrerit varius, odio magna luctus lacus, a lacinia metus nisl id quam. 
Sed quis sollicitudin mi. 
Pellentesque tincidunt lobortis mi, a vestibulum metus faucibus ut. 
Sed quis felis in quam iaculis tempus. Duis justo erat, sagittis at bibendum sit amet, malesuada id lectus. 
Nullam adipiscing, erat at varius tempus, urna erat malesuada sem, interdum condimentum ante felis cursus odio. Integer malesuada eros dui, quis congue elit tristique ut. Pellentesque laoreet in elit eget tristique. In a nunc felis. Nullam sodales mi non nibh congue, eget pulvinar dolor lobortis. Praesent est elit, blandit in porttitor ut, eleifend vel velit. Pellentesque eu nulla non nibh sodales vestibulum. In hac habitasse platea dictumst.

[Amalthia]

Originally Posted by PeterT

As an FYI, even if the message was posted with QUOTE rather than CODE as long as you do a QUOTE yourself of the original message, you WILL see the indentation as the user had entered it.

Another handy trick is to wrap the [code] xxxx [/code] tags within a [spoiler] ... [/spoiler] pair; this way one does not have to scroll through a long message, just a shortened version.

Thanks for the tip! I'll go back and edit my post to add the spoiler tag to it.