Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 05-25-2020, 01:05 PM   #4126
-BLLB-
Junior Member
-BLLB- began at the beginning.
 
Posts: 5
Karma: 10
Join Date: May 2020
Device: None
Quote:
Originally Posted by JimmXinu View Post
FYI, I would recommend against putting those in Long Text fields in favor of Tag-like text as a general rule. They aren't long texts and Calibre makes it easier to edit tag-like text columns. YMMV.

Just configuring the columns in FFF doesn't fill columns. Remember I said:

"Note that FFF only populates Calibre columns on story download or update. "
Ahhhh... please ignore my previous post. I think I have sorted it now.

My brain is just scrambled today.

Thanks again!
-BLLB- is offline   Reply With Quote
Old 05-27-2020, 12:00 PM   #4127
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,988
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
New Test Version Posted

2020-05-27
- Fix numWords parsing in adapter_fanficsme.
- Update translations, add Russian.
- Fix broken series parsing in adapter_adastrafanficcom & adapter_lotrgficcom.
- New Site: www.silmarillionwritersguild.org, thanks Alistair!
JimmXinu is offline   Reply With Quote
Old 05-28-2020, 04:16 PM   #4128
ILB
Groupie
ILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipse
 
ILB's Avatar
 
Posts: 173
Karma: 8098
Join Date: Jun 2012
Location: Germany
Device: Kindle Voyage, Kindle Oasis
fanfiktion.de - category and characters

On Fanfiktion.de I´m missing a few metadata. (in "category" and "characters")

example:
https://www.fanfiktion.de/s/50c881e6...nd-ihre-Folgen

With this story I only get "Sport" in category.
I´m missing "Fußball" and "Männerfußball" in category.
Is there maybe a new classification with subcategories?
If possible - how do I get these into category?

Besides there are "Borussia Dortmund", "Die deutsche Nationalmannschaft", "FC Bayern München" and "FC Schalke 04" - that should be in characters.

Was there a change in the naming of the metadata? Or is this new on ff.de?

A second example for characters: https://www.fanfiktion.de/s/4bc61a91...and-Besonderes
Characters would be "Kyoko Mogami" and "Ren Tsuruga"

ILB is offline   Reply With Quote
Old 05-28-2020, 07:03 PM   #4129
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,988
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
New Test Version Posted

2020-05-28
- Add characters and increased category collection for adapter_fanfiktionde.
- Suppress output_css on CLI -z

category was previously being collected by text manipulation and choosing whatever was third in the breadcrumb trail. I've changed it to use every 'category' (identified by /c/ in the URL) except 'Fanfiction'.

characters wasn't previously collected at all. I suspect it wasn't there before on the site.
JimmXinu is offline   Reply With Quote
Old 05-29-2020, 12:50 AM   #4130
ILB
Groupie
ILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipse
 
ILB's Avatar
 
Posts: 173
Karma: 8098
Join Date: Jun 2012
Location: Germany
Device: Kindle Voyage, Kindle Oasis
Quote:
Originally Posted by JimmXinu View Post
New Test Version Posted

2020-05-28
- Add characters and increased category collection for adapter_fanfiktionde.

category was previously being collected by text manipulation and choosing whatever was third in the breadcrumb trail. I've changed it to use every 'category' (identified by /c/ in the URL) except 'Fanfiction'.

characters wasn't previously collected at all. I suspect it wasn't there before on the site.
ILB is offline   Reply With Quote
Old 05-29-2020, 06:56 AM   #4131
ILB
Groupie
ILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipse
 
ILB's Avatar
 
Posts: 173
Karma: 8098
Join Date: Jun 2012
Location: Germany
Device: Kindle Voyage, Kindle Oasis
error: bogus escape (end of line)

What does the error message "bogus escape (end of line)" mean?
ILB is offline   Reply With Quote
Old 05-29-2020, 10:20 AM   #4132
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,988
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by ILB View Post
What does the error message "bogus escape (end of line)" mean?
I don't know--it isn't from my code.

When reporting any problem, please provide a story URL that exhibits it and, ideally, a Calibre debug log of the problem happening.
JimmXinu is offline   Reply With Quote
Old 05-29-2020, 11:56 AM   #4133
ILB
Groupie
ILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipse
 
ILB's Avatar
 
Posts: 173
Karma: 8098
Join Date: Jun 2012
Location: Germany
Device: Kindle Voyage, Kindle Oasis
error: bogus escape (end of line)

Quote:
Originally Posted by JimmXinu View Post
When reporting any problem, please provide a story URL that exhibits it and, ideally, a Calibre debug log of the problem happening.
Sorry.
Following two story URLs (I´ve got this error on AO3 and FF.de):
https://www.fanfiktion.de/s/50c881e6000040db06d00fa2/1
http://archiveofourown.org/works/2710154

The error appears with “update Story”, “update metadata from web” and also with “update from saved metadata”.
The story URL is ok if I open it in my browser.

Enclosed the debug log.
Attached Files
File Type: txt tmpgciflg.txt (22.7 KB, 225 views)
ILB is offline   Reply With Quote
Old 05-29-2020, 02:50 PM   #4134
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,988
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by ILB View Post
Enclosed the debug log.
Relevant parts:
Code:
FFF: ERROR: 2020-05-29 17:50:14,265: calibre_plugins.fanficfare_plugin.fanficfare.story(633): Exception with replacement line,value:(category=>^(.*Football RPF.*)$=>Fußball RPF | Football RPF\),(Fußball RPF | Football RPF)
...
  File "calibre_plugins.fanficfare_plugin.fanficfare.story", line 630, in doReplacements
  File "re.py", line 286, in _subx
  File "re.py", line 273, in _compile_repl
error: bogus escape (end of line)
Searching for that error yields this: "bogus escape (end of line)" means that your pattern ends with a backslash.

And apparently it also applies to the replacement pattern, since this is the line causing it:
category=>^(.*Football RPF.*)$=>Fußball RPF | Football RPF\

So take off that trailing \ and it should be fine.

FYI, FFF checks the regexp part when you saving personal.ini, so it alerts you to that problem in the regexp, but not the replacement pattern.
JimmXinu is offline   Reply With Quote
Old 05-29-2020, 04:33 PM   #4135
ILB
Groupie
ILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipseILB can illuminate an eclipse
 
ILB's Avatar
 
Posts: 173
Karma: 8098
Join Date: Jun 2012
Location: Germany
Device: Kindle Voyage, Kindle Oasis
Quote:
Originally Posted by JimmXinu View Post

So take off that trailing \ and it should be fine.

FYI, FFF checks the regexp part when you saving personal.ini, so it alerts you to that problem in the regexp, but not the replacement pattern.
Thanks!

Does that mean I should have gotten an error message if I try to save personal.ini with that backslash ?
Because there was none.
ILB is offline   Reply With Quote
Old 05-29-2020, 07:59 PM   #4136
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,988
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by ILB View Post
Does that mean I should have gotten an error message if I try to save personal.ini with that backslash ?
Because there was none.
No. The form is:
Code:
replace_metadata:
 metdata keyword(s)=>regexp=>replacement pattern
FFF checks the regexp part (you'll get that error as a warning if you put a trailing / in the regexp), but doesn't check anything with the replacement pattern.

I was surprised Python's regexp engine made that complaint about the replacement pattern.
JimmXinu is offline   Reply With Quote
Old 05-30-2020, 04:06 PM   #4137
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,988
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
New Test Version Posted

2020-05-30
- Fix for is_adult needing &showRestricted URL in adapter_harrypotterfanfictioncom.
- Better auth page parsing due to own-favorite story in adapter_harrypotterfanfictioncom.
JimmXinu is offline   Reply With Quote
Old 05-31-2020, 10:58 AM   #4138
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,988
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
New Test Version Posted

2020-05-31
- Add more URLs to cover_exclusion_regexp for base_xenforoforum.

I expect this will be the last test version before next release.
JimmXinu is offline   Reply With Quote
Old 06-01-2020, 12:57 AM   #4139
vikarti
Groupie
vikarti ought to be getting tired of karma fortunes by now.vikarti ought to be getting tired of karma fortunes by now.vikarti ought to be getting tired of karma fortunes by now.vikarti ought to be getting tired of karma fortunes by now.vikarti ought to be getting tired of karma fortunes by now.vikarti ought to be getting tired of karma fortunes by now.vikarti ought to be getting tired of karma fortunes by now.vikarti ought to be getting tired of karma fortunes by now.vikarti ought to be getting tired of karma fortunes by now.vikarti ought to be getting tired of karma fortunes by now.vikarti ought to be getting tired of karma fortunes by now.
 
Posts: 185
Karma: 1004974
Join Date: May 2013
Location: Solar system, Earth
Device: none
ficbook.net's urls (I first noticed this on https://ficbook.net/readfic/6689669 but it looks like it appears to ANY ficbook url) now result in 503 error in FanFicFare. Opening them in browser shows Cloudlfare's page with 'checking...' for several seconds and page opens after that. How to make FanFicFare work again for it?
vikarti is offline   Reply With Quote
Old 06-01-2020, 11:53 AM   #4140
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,988
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by vikarti View Post
ficbook.net's urls (I first noticed this on https://ficbook.net/readfic/6689669 but it looks like it appears to ANY ficbook url) now result in 503 error in FanFicFare. Opening them in browser shows Cloudlfare's page with 'checking...' for several seconds and page opens after that. How to make FanFicFare work again for it?
This is the third report in the last few weeks about Cloudflare getting in the way. (#488, #493) At least one of the reporters only saw the problem while using a VPN.

This is the first time that I've seen it happen myself, however, so I can find out a bit more.

What appears to be happening is that there's some moderately obfuscated javascript on the "Checking your browser before accessing" page that needs to run and decode some numbers to call a different URL with a POST req and get some cookies set.

I call it 'moderately' obfuscated because I can still get some sense of what it's doing--which I suspect is primarily making your client computer spin a lot of cycles to slow it down and prove it isn't a DDoS script.

Unfortunately, FFF doesn't have any current ability to run javascript and I'm really hesitant to try and add one. And from a site's point of view, the difference between FFF and a hostile script can be pretty hard to tell.

I will continue to think about this, but so far I have no good ideas.
JimmXinu is offline   Reply With Quote
Reply

Tags
fanfiction


Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] KindleUnpack - The Plugin DiapDealer Plugins 523 07-15-2025 06:45 PM
[GUI Plugin] Open With kiwidude Plugins 404 02-21-2025 05:42 AM
[GUI Plugin] Marvin XD Philantrop Plugins 126 01-29-2017 12:48 PM
[GUI Plugin] KiNotes -axel- Plugins 0 07-14-2013 06:39 PM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 12:27 PM


All times are GMT -4. The time now is 11:56 AM.


MobileRead.com is a privately owned, operated and funded community.