Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 06-17-2017, 08:33 PM   #2236
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,973
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by xvector View Post
I'm looking to integrate FanFicFare with a Reddit bot I have to grab story metadata and download URLs when people are recommending fics to each other.

Unfortunately, grabbing the story metadata takes forever. Is there some sort of hard-coded delay to avoid hitting the site too many times? (I am supplying the -m flag.)
Depends on the site. Several sites have default slow_down_sleep_time settings, but a few do have hard coded sleeps as well. None of them are long enough for metadata that I would class them as 'forever'.
JimmXinu is offline   Reply With Quote
Old 06-17-2017, 10:27 PM   #2237
dwraith0877
Member
dwraith0877 is on a distinguished road
 
Posts: 16
Karma: 66
Join Date: Dec 2015
Device: Kobo Glo HD
I am having trouble downloading/updating some stories from SOL...

The URL's for the specific two are as follows:
http://storiesonline.net/s/73213
http://storiesonline.net/s/16063

This is the error report I get from FFF:
Status [...] Title [..........] Author [......] Comment [.................................................. .] URL
Bad [.......] Unknown [...] Unknown [...] 'NoneType' object has no attribute 'get_text' [...] http://storiesonline.net/s/73213
Bad [.......] Unknown [...] Unknown [...] 'NoneType' object has no attribute 'get_text' [...] http://storiesonline.net/s/16063

So far, only those two stories that I am aware of... is something going on?

Edit: And also, is there a way to have FFF get the tags from Literotica, as well?
thanks

Last edited by dwraith0877; 06-17-2017 at 10:52 PM.
dwraith0877 is offline   Reply With Quote
Advert
Old 06-18-2017, 12:09 AM   #2238
davidfor
Grand Sorcerer
davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.
 
Posts: 24,905
Karma: 47303824
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
@dwraith0877: There is a small change on the site to the series page. I have fixed it and created a pull request in the repository
davidfor is offline   Reply With Quote
Old 06-18-2017, 01:07 AM   #2239
dwraith0877
Member
dwraith0877 is on a distinguished road
 
Posts: 16
Karma: 66
Join Date: Dec 2015
Device: Kobo Glo HD
Smile

Quote:
Originally Posted by davidfor View Post
@dwraith0877: There is a small change on the site to the series page. I have fixed it and created a pull request in the repository
thanks... saw what you changed, d/l'd the zip from the top of this thread, made the change myself, and it worked... cool
dwraith0877 is offline   Reply With Quote
Old 06-18-2017, 01:24 AM   #2240
botmtl
Enthusiast
botmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel is
 
botmtl's Avatar
 
Posts: 43
Karma: 70238
Join Date: Jun 2014
Device: none
Quote:
Any chance of adding The Wayback Machine (Archive.org)?
i think your best bet for this would be a proxy with basic url rewriting capability. its fairly technical stuff for the unitiated, and the result is in no way certain, but if you have the technical knowhow, it could save you a lot of time.
botmtl is offline   Reply With Quote
Advert
Old 06-18-2017, 05:29 AM   #2241
Tharos
Connoisseur
Tharos began at the beginning.
 
Posts: 66
Karma: 10
Join Date: Jul 2010
Device: Pocketbook InkPad Color 3, Kindle Oasis 2, Moon+ Reader pro
I'm not sure if i'm doing it wrong, or if FFF has a bug. (Probably the first)

I would like to add the following links/chapters as separate books.
In the following I choose "Add New Book", and assume that FFF creates a new book for each line.

But FFF creates a new book for the first Line only, and for the following lines it outputs the error message "The same Story is already present".

Sorry for den bad Grammar. Writing Englich isn't my best work.
Tharos is offline   Reply With Quote
Old 06-18-2017, 09:49 AM   #2242
botmtl
Enthusiast
botmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel is
 
botmtl's Avatar
 
Posts: 43
Karma: 70238
Join Date: Jun 2014
Device: none
Quote:
Originally Posted by Tharos View Post
I would like to add the following links/chapters as separate books.
Outputting only one book per story (even it has multiple chapter urls) is a feature, not a bug. (i.e. it's like this by design).

I would suggest letting it do it's thing, then either:
- using the epubsplitter plugin (*forgot it exact name, but it's in the list). This will keep cover/metadata/css that is associated with the book.
- even faster would be to set up an "automatic adding" folder (preferences -> adding books -> automatic adding) and unzip the html files from the epub in there. The automatic adding system will create one book per html file it finds. It will also pick up the css files. The metadata, however, will likely be gone.

good luck!
botmtl is offline   Reply With Quote
Old 06-18-2017, 10:29 AM   #2243
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,973
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
New test version posted

2017-06-18
- Fix for storiesonline.net site change, thanks davidfor!
- Allow multiple range URLs (url[1-5]) for same story in one download.

As for "tags from Literotica", eroticatags are already collected. Not sure what else you'd mean. You may need to add some personal.ini settings to get them where you want them, though.

And FYI, the mobileread.com forum doesn't like links to NSFW material.

Last edited by JimmXinu; 06-18-2017 at 11:10 AM.
JimmXinu is offline   Reply With Quote
Old 06-18-2017, 11:14 AM   #2244
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,973
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by Tharos View Post
...
But FFF creates a new book for the first Line only, and for the following lines it outputs the error message "The same Story is already present".
That's not an unreasonable thing to expect to work. I've updated the test version to allow it. The code that checks for duplicate story URLs entered in the text box will now also pay attention to the chapter range.

However, be aware that I'm not planning on anything like that for the code that looks for existing books in the library. If you've already downloaded chapters 1-5, if you want to download 6-10 separately, you'll need to change the "If story already exists" setting to 'Add New Book'.
JimmXinu is offline   Reply With Quote
Old 06-18-2017, 11:18 AM   #2245
Tharos
Connoisseur
Tharos began at the beginning.
 
Posts: 66
Karma: 10
Join Date: Jul 2010
Device: Pocketbook InkPad Color 3, Kindle Oasis 2, Moon+ Reader pro
Quote:
Originally Posted by JimmXinu View Post
- Allow multiple range URLs (url[1-5]) for same story in one download.
Great, Thanks
Tharos is offline   Reply With Quote
Old 06-18-2017, 07:20 PM   #2246
theit8514
Junior Member
theit8514 began at the beginning.
 
Posts: 2
Karma: 10
Join Date: Jun 2017
Device: none
I am trying to write a batch script for post_process_cmd and I'm running into issues trying to get at the tags field. When I add a book using the Calibre plugin, there are values in the Tags field. However, trying to use '${tags}' gives me a hash error. I looked around the code and found 'extratags' as well, but that gives me an empty string. Is there a way to get the list of all tags the same way the Calibre plugin writes to the Tags field?

Example URL: https://www.fanfiction.net/s/4378675/1/

Ini:
[defaults]
post_process_cmd: addbook.bat "${title}" "${author}" "${series}" "${tags}" "${output_filename}"

Error:
Python function terminated unexpectedly
u'tags' (Error Code: 1)
Traceback (most recent call last):
File "site.py", line 132, in main
File "site.py", line 109, in run_entry_point
File "site-packages\calibre\debug.py", line 278, in main
File "calibre_plugins.fanficfare_plugin.__init__", line 140, in cli_main
File "calibre_plugins.fanficfare_plugin.fanficfare.cli" , line 246, in main
File "calibre_plugins.fanficfare_plugin.fanficfare.cli" , line 407, in do_download
File "string.py", line 172, in substitute
File "string.py", line 162, in convert
KeyError: u'tags'
theit8514 is offline   Reply With Quote
Old 06-18-2017, 08:19 PM   #2247
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,973
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
"Tags" is actually a Calibre thing. FFF sets epub subject tags which were later put into the calibre tags column. There isn't actually a 'tags' metadata item in FFF.

But there can be. I believe this would work:

Code:
[defaults]
# adds the entry 'tags'
add_to_extra_valid_entries:,tags
# Or whatever you normally have in include_subject_tags
include_in_tags: extratags, genre, category, characters, ships, lastupdate, status
I'll think about adding something like that to the defaults.ini.

Quote:
Originally Posted by theit8514 View Post
Is there a way to get the list of all tags the same way the Calibre plugin writes to the Tags field?
KeyError: u'tags'

Last edited by JimmXinu; 06-18-2017 at 08:20 PM. Reason: trim quote
JimmXinu is offline   Reply With Quote
Old 06-18-2017, 09:37 PM   #2248
botmtl
Enthusiast
botmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel is
 
botmtl's Avatar
 
Posts: 43
Karma: 70238
Join Date: Jun 2014
Device: none
arg - can't read!

Last edited by botmtl; 06-19-2017 at 01:27 AM. Reason: use cases examples
botmtl is offline   Reply With Quote
Old 06-18-2017, 11:07 PM   #2249
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,973
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by botmtl View Post
...
What?

Nothing should change when you aren't putting chapter ranges on the URLs.
Unless the page you're grabbing from puts [1-5] or [15-] etc at the end of the URLs (or you do), nothing should have changed for your use case.

I said:
Quote:
That's not an unreasonable thing to expect to work. I've updated the test version to allow it. The code that checks for duplicate story URLs entered in the text box will now also pay attention to the chapter range.
Are you speculating, or is there an unexpected behavior you're seeing?
JimmXinu is offline   Reply With Quote
Old 06-19-2017, 01:28 AM   #2250
botmtl
Enthusiast
botmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel isbotmtl really knows where his or her towel is
 
botmtl's Avatar
 
Posts: 43
Karma: 70238
Join Date: Jun 2014
Device: none
Quote:
Originally Posted by JimmXinu View Post
What?

Nothing should change when you aren't putting chapter ranges on the URLs.
Unless the page you're grabbing from puts [1-5] or [15-] etc at the end of the URLs (or you do), nothing should have changed for your use case.

I said:


Are you speculating, or is there an unexpected behavior you're seeing?

I redacted my post. Somehow I thought the person was asking to get seperate books for every url he typed in and my reading comprehension just got worse from there.
botmtl is offline   Reply With Quote
Reply

Tags
fanfiction


Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] KindleUnpack - The Plugin DiapDealer Plugins 523 07-15-2025 06:45 PM
[GUI Plugin] Open With kiwidude Plugins 404 02-21-2025 05:42 AM
[GUI Plugin] Marvin XD Philantrop Plugins 126 01-29-2017 12:48 PM
[GUI Plugin] KiNotes -axel- Plugins 0 07-14-2013 06:39 PM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 12:27 PM


All times are GMT -4. The time now is 04:12 PM.


MobileRead.com is a privately owned, operated and funded community.