[GUI Plugin] FanFicFare

[JimmXinu]

Originally Posted by xvector

I'm looking to integrate FanFicFare with a Reddit bot I have to grab story metadata and download URLs when people are recommending fics to each other.

Unfortunately, grabbing the story metadata takes forever. Is there some sort of hard-coded delay to avoid hitting the site too many times? (I am supplying the -m flag.)

Depends on the site. Several sites have default slow_down_sleep_time settings, but a few do have hard coded sleeps as well. None of them are long enough for metadata that I would class them as 'forever'.

[dwraith0877]

I am having trouble downloading/updating some stories from SOL...

The URL's for the specific two are as follows:
http://storiesonline.net/s/73213
http://storiesonline.net/s/16063

This is the error report I get from FFF:
Status [...] Title [..........] Author [......] Comment [.................................................. .] URL
Bad [.......] Unknown [...] Unknown [...] 'NoneType' object has no attribute 'get_text' [...] http://storiesonline.net/s/73213
Bad [.......] Unknown [...] Unknown [...] 'NoneType' object has no attribute 'get_text' [...] http://storiesonline.net/s/16063

So far, only those two stories that I am aware of... is something going on?

Edit: And also, is there a way to have FFF get the tags from Literotica, as well?
thanks

[davidfor]

@dwraith0877: There is a small change on the site to the series page. I have fixed it and created a pull request in the repository

[dwraith0877]

Originally Posted by davidfor

@dwraith0877: There is a small change on the site to the series page. I have fixed it and created a pull request in the repository

thanks... saw what you changed, d/l'd the zip from the top of this thread, made the change myself, and it worked... cool

[botmtl]

Any chance of adding The Wayback Machine (Archive.org)?

i think your best bet for this would be a proxy with basic url rewriting capability. its fairly technical stuff for the unitiated, and the result is in no way certain, but if you have the technical knowhow, it could save you a lot of time.

[Tharos]

I'm not sure if i'm doing it wrong, or if FFF has a bug. (Probably the first)

I would like to add the following links/chapters as separate books.

http://gravitytales.com/novel/the-kings-avatar[343-419]
http://gravitytales.com/novel/the-kings-avatar[420-489]
http://gravitytales.com/novel/the-kings-avatar[490-564]
http://gravitytales.com/novel/the-kings-avatar[565-638]
http://gravitytales.com/novel/the-kings-avatar[639-662]

In the following I choose "Add New Book", and assume that FFF creates a new book for each line.

But FFF creates a new book for the first Line only, and for the following lines it outputs the error message "The same Story is already present".

Sorry for den bad Grammar. Writing Englich isn't my best work.

[botmtl]

Originally Posted by Tharos

I would like to add the following links/chapters as separate books.

Outputting only one book per story (even it has multiple chapter urls) is a feature, not a bug. (i.e. it's like this by design).

I would suggest letting it do it's thing, then either:
- using the epubsplitter plugin (*forgot it exact name, but it's in the list). This will keep cover/metadata/css that is associated with the book.
- even faster would be to set up an "automatic adding" folder (preferences -> adding books -> automatic adding) and unzip the html files from the epub in there. The automatic adding system will create one book per html file it finds. It will also pick up the css files. The metadata, however, will likely be gone.

good luck!

[JimmXinu]

New test version posted

2017-06-18
- Fix for storiesonline.net site change, thanks davidfor!
- Allow multiple range URLs (url[1-5]) for same story in one download.

As for "tags from Literotica", eroticatags are already collected. Not sure what else you'd mean. You may need to add some personal.ini settings to get them where you want them, though.

And FYI, the mobileread.com forum doesn't like links to NSFW material.

[JimmXinu]

Originally Posted by Tharos

...
But FFF creates a new book for the first Line only, and for the following lines it outputs the error message "The same Story is already present".

That's not an unreasonable thing to expect to work. I've updated the test version to allow it. The code that checks for duplicate story URLs entered in the text box will now also pay attention to the chapter range.

However, be aware that I'm not planning on anything like that for the code that looks for existing books in the library. If you've already downloaded chapters 1-5, if you want to download 6-10 separately, you'll need to change the "If story already exists" setting to 'Add New Book'.

[Tharos]

Originally Posted by JimmXinu

- Allow multiple range URLs (url[1-5]) for same story in one download.

Great, Thanks

[theit8514]

I am trying to write a batch script for post_process_cmd and I'm running into issues trying to get at the tags field. When I add a book using the Calibre plugin, there are values in the Tags field. However, trying to use '${tags}' gives me a hash error. I looked around the code and found 'extratags' as well, but that gives me an empty string. Is there a way to get the list of all tags the same way the Calibre plugin writes to the Tags field?

Example URL: https://www.fanfiction.net/s/4378675/1/

Ini:
[defaults]
post_process_cmd: addbook.bat "${title}" "${author}" "${series}" "${tags}" "${output_filename}"

Error:
Python function terminated unexpectedly
u'tags' (Error Code: 1)
Traceback (most recent call last):
File "site.py", line 132, in main
File "site.py", line 109, in run_entry_point
File "site-packages\calibre\debug.py", line 278, in main
File "calibre_plugins.fanficfare_plugin.__init__", line 140, in cli_main
File "calibre_plugins.fanficfare_plugin.fanficfare.cli" , line 246, in main
File "calibre_plugins.fanficfare_plugin.fanficfare.cli" , line 407, in do_download
File "string.py", line 172, in substitute
File "string.py", line 162, in convert
KeyError: u'tags'

[JimmXinu]

"Tags" is actually a Calibre thing. FFF sets epub subject tags which were later put into the calibre tags column. There isn't actually a 'tags' metadata item in FFF.

But there can be. I believe this would work:

[defaults]
# adds the entry 'tags'
add_to_extra_valid_entries:,tags
# Or whatever you normally have in include_subject_tags
include_in_tags: extratags, genre, category, characters, ships, lastupdate, status

I'll think about adding something like that to the defaults.ini.

Originally Posted by theit8514

Is there a way to get the list of all tags the same way the Calibre plugin writes to the Tags field?
KeyError: u'tags'

[botmtl]

arg - can't read!

[JimmXinu]

Originally Posted by botmtl

...

What?

Nothing should change when you aren't putting chapter ranges on the URLs.
Unless the page you're grabbing from puts [1-5] or [15-] etc at the end of the URLs (or you do), nothing should have changed for your use case.

I said:

That's not an unreasonable thing to expect to work. I've updated the test version to allow it. The code that checks for duplicate story URLs entered in the text box will now also pay attention to the chapter range.

Are you speculating, or is there an unexpected behavior you're seeing?

[botmtl]

Originally Posted by JimmXinu

What?

Nothing should change when you aren't putting chapter ranges on the URLs.
Unless the page you're grabbing from puts [1-5] or [15-] etc at the end of the URLs (or you do), nothing should have changed for your use case.

I said:


Are you speculating, or is there an unexpected behavior you're seeing?

I redacted my post. Somehow I thought the person was asking to get seperate books for every url he typed in and my reading comprehension just got worse from there.