Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 11-20-2021, 05:57 PM   #6721
junni
Member
junni began at the beginning.
 
Posts: 12
Karma: 10
Join Date: Oct 2021
Device: kobo libra 2
Quote:
Originally Posted by JimmXinu View Post
New Test Version Posted

2021-11-20
- Add averrating metadata to adapter_novelfull.
- Disable patreon downloads, decided I didn't want to add new site behind pay wall *and* only works with browser cache. Developer discussion here.



Added as averrating (rating already used for G/PG/etc). Use custom_columns_settings in personal.ini to assign to a column
Worked like a charm! Thanks!
I actually tested on some novels with low number of votes, and it actually updates the rating.

Last edited by junni; 11-20-2021 at 06:01 PM.
junni is offline   Reply With Quote
Old 11-27-2021, 09:15 PM   #6722
crich70
Grand Sorcerer
crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.
 
crich70's Avatar
 
Posts: 11,280
Karma: 43990980
Join Date: Feb 2010
Location: Monroe Wisconsin
Device: K3, Kindle Paperwhite, Calibre, and Mobipocket for Pc (netbook)
Not sure what I'm doing wrong. As far as I know I have the most up to date copy of Calibre and the plug in but when I try to use it I get this:
Quote:
calibre, version 5.32.0
ERROR: Unhandled exception: <b>FailedToDownload</b>:cloudscraper reports: (Detected a Cloudflare version 2 Captcha challenge, This feature is not available....)
See https://github.com/JimmXinu/FanFicFa...erCacheFeature for a possible workaround.

calibre 5.32 [64bit] embedded-python: True is64bit: True
Windows-10-10.0.19041 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.19041')
Python 3.8.5
Windows: ('10', '10.0.19041', '', 'Multiprocessor Free')
Interface language: None
Successfully initialized third party plugins: EpubMerge (2, 11, 0) && FanFicFare (4, 7, 0) && Find Duplicates (1, 8, 10) && Generate Cover (2, 0, 2) && Kindle hi-res covers (0, 5, 0) && Prettify Cover (1, 5, 0) && Resize Cover (1, 1, 0)
Traceback (most recent call last):
cloudscraper.exceptions.CloudflareChallengeError: Detected a Cloudflare version 2 Captcha challenge, This feature is not available in the opensource (free) version.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
fanficfare.exceptions.FailedToDownload: cloudscraper reports: (Detected a Cloudflare version 2 Captcha challenge, This feature is not available....)
See https://github.com/JimmXinu/FanFicFa...erCacheFeature for a possible workaround.
I have Windows 10.
crich70 is offline   Reply With Quote
Old 11-27-2021, 10:00 PM   #6723
ownedbycats
Wizard
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 3,384
Karma: 14100982
Join Date: Oct 2018
Device: Kobo Aura HD (retired), Kobo Libra H2O
Did you read the error message?
ownedbycats is offline   Reply With Quote
Old 11-27-2021, 10:24 PM   #6724
crich70
Grand Sorcerer
crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.crich70 ought to be getting tired of karma fortunes by now.
 
crich70's Avatar
 
Posts: 11,280
Karma: 43990980
Join Date: Feb 2010
Location: Monroe Wisconsin
Device: K3, Kindle Paperwhite, Calibre, and Mobipocket for Pc (netbook)
Quote:
Originally Posted by ownedbycats View Post
Did you read the error message?
I had actually missed noticing the link. Of course I've also never had a problem with the plugin before either.
crich70 is offline   Reply With Quote
Old 11-28-2021, 06:06 AM   #6725
MonicaOP
Enthusiast
MonicaOP ought to be getting tired of karma fortunes by now.MonicaOP ought to be getting tired of karma fortunes by now.MonicaOP ought to be getting tired of karma fortunes by now.MonicaOP ought to be getting tired of karma fortunes by now.MonicaOP ought to be getting tired of karma fortunes by now.MonicaOP ought to be getting tired of karma fortunes by now.MonicaOP ought to be getting tired of karma fortunes by now.MonicaOP ought to be getting tired of karma fortunes by now.MonicaOP ought to be getting tired of karma fortunes by now.MonicaOP ought to be getting tired of karma fortunes by now.MonicaOP ought to be getting tired of karma fortunes by now.
 
MonicaOP's Avatar
 
Posts: 46
Karma: 2136220
Join Date: Apr 2017
Location: Mexico
Device: Kindle Keyboard Oasis
Hi, well, Wuxiaworld is not working again, I tried updating the new trial version of the plugin but nothing changed, this is what it says.

Error
Unknown
Unknown
'NoneType' object has no attribute 'get_text'
https://wuxiaworld.site/novel/my-mom...seven-brothers
Error
Unknown
Unknown
'NoneType' object has no attribute 'i'
https://wuxiaworld.site/novel/rebirt...press-freeread

What can I do? Thank you for everything, be well, Monica
MonicaOP is offline   Reply With Quote
Old 11-28-2021, 02:11 PM   #6726
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 5,137
Karma: 955296
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Quote:
Originally Posted by crich70 View Post
I had actually missed noticing the link. Of course I've also never had a problem with the plugin before either.
From the errors, I assume you were trying fanfiction.net. Most of us have had these problems for most of the last year now.

If it wasn't ffnet, you need to report the story URL before I'll look at it anymore. Use PM if it's NSFW.

Quote:
Originally Posted by MonicaOP View Post
Hi, well, Wuxiaworld is not working again, I tried updating the new trial version of the plugin but nothing changed, this is what it says.
They've changed the site again, now chapters are back to being a separate POST, but the old code doesn't work.

I reported here and here:

Quote:
Originally Posted by JimmXinu View Post
Back in Sept, wuxiaworld.site changed from having the chapter list in a separate POST req to putting in the story page directly. Now, they appear to have changed back, but with a different POST url without any request parameters.

However, it's not working when I try from FFF. Not sure if that's because of something subtle I'm missing or because flaresolverr won't accept a POST with no parameters.

If somebody else wants to look at it, great; but I don't have the energy or interest for this right now.
JimmXinu is offline   Reply With Quote
Old 11-28-2021, 02:41 PM   #6727
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 5,137
Karma: 955296
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
New Test Version Posted

2021-11-28
- Add fix_relative_text_links feature, defaults to true.
- Make Scribble Hub spoilers & footnotes look nicer PR#733, thanks Epicpkmn11!
JimmXinu is offline   Reply With Quote
Old 12-02-2021, 11:41 AM   #6728
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 5,137
Karma: 955296
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
New Version Released

Version 4.8.0 - 2021-12-02
- Add fix_relative_text_links feature, defaults to true.
- Make Scribble Hub spoilers & footnotes look nicer PR#733, thanks Epicpkmn11!
- Add averrating metadata to adapter_novelfull.
- Fix for cover_min_size causing failures with SVG images when no_image_processing:true.
- Set default slow_down_sleep_time:2 for [www.asianfanfics.com]
- Deviantart date fix (closes #768), also storyId and extratags changes, thanks jcotton42
- New Site: www.deviantart.com, thanks jcotton42 (see #765 and #374)
- New Site: psychfic.com (re-added), thanks HappyFaceSpider Closes #764
- adapter_storiesonlinenet: Take rating from 'Age' field on scifistories/finestories - Thanks bpothier
- adapter_ficbooknet: Fix for site change.
JimmXinu is offline   Reply With Quote
Old 12-02-2021, 08:34 PM   #6729
junni
Member
junni began at the beginning.
 
Posts: 12
Karma: 10
Join Date: Oct 2021
Device: kobo libra 2
Hi!

I'm trying to update metadata from this link: https://www.novelall.com/novel/Game-...e-Thrones.html and it gives me an error: list index out of range.

I've tried looking into the adapter, but without more information on the error, it's difficult to pinpoint what is the problem.
Can you help JimmXinu?
junni is offline   Reply With Quote
Old 12-03-2021, 11:28 AM   #6730
Kite013
Junior Member
Kite013 began at the beginning.
 
Posts: 2
Karma: 10
Join Date: Dec 2021
Device: Nook
Problems with FF.net

Recently I have had trouble downloading fanfictions from fanfiction.net. I have made it so the plugin uses cookies in order to do so as it was suggested and for long while it worked. However, I still get the same old cloudserver error now. Please advise.

Edit: Never mind it seems to be working now, unsure what I was doing wrong before.

Last edited by Kite013; 12-03-2021 at 11:31 AM. Reason: Problem has been fixed
Kite013 is offline   Reply With Quote
Old 12-03-2021, 01:01 PM   #6731
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 5,137
Karma: 955296
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
New Test Version Posted

2021-12-03
- adapter_wwwnovelallcom: fixes for story w/o chapters & html desc.

Quote:
Originally Posted by junni View Post
I'm trying to update metadata from this link: https://www.novelall.com/novel/Game-...e-Thrones.html and it gives me an error: list index out of range.
I've added code for this, but it still won't work because that story has no chapters. Adapter now raises an exception that says that.

You can run Calibre in debug mode to see more debugging output.

Quote:
Originally Posted by Kite013 View Post
Recently I have had trouble downloading fanfictions from fanfiction.net. ...
Everybody is having cloudflare problems with ffnet and have been for about a year now. It's been discussed many times.
JimmXinu is offline   Reply With Quote
Old 12-04-2021, 12:21 PM   #6732
junni
Member
junni began at the beginning.
 
Posts: 12
Karma: 10
Join Date: Oct 2021
Device: kobo libra 2
Quote:
Originally Posted by JimmXinu View Post
New Test Version Posted

2021-12-03
- adapter_wwwnovelallcom: fixes for story w/o chapters & html desc.



I've added code for this, but it still won't work because that story has no chapters. Adapter now raises an exception that says that.

You can run Calibre in debug mode to see more debugging output.
The thing is, that website has most novels with just a handfull of chapters or none at all, but on the other hand it has a LOT of novels metadata. So basically i use it to update the metadata on the novels i download from elsewhere.

So is there a way to make it update the metadata, even if the story doesn't have any chapters?

EDIT:

Nevermind, i changed it myself:
Code:
cdata = soup.select('.detail-chlist li')
        cdata.reverse()
        if not cdata: # user found a story with no chapters.
            pass
        else:
            cdates = []

            for li in cdata:
                # <span class="time">31 minutes ago</span>s
                # <span class="time">Jul 15, 2017</span>
                dt = li.select_one('.time').string
                if "ago" in dt:
                    cdates.append(parse_relative_date_string(dt))
                else:
                    cdates.append(makeDate(dt, '%b %d, %Y'))
                # <a href="https://www.novelall.com/chapter/Stellar-Transformation-Volume-18-Chapter-45-part2/616971/" title="Stellar Transformation Volume 18 Chapter 45 part2">
                a = li.find('a')
                ctitle = re.sub(r"^%s(.+)$" % re.escape(title), r"\1", a['title'], 0, re.UNICODE | re.IGNORECASE).strip()
                self.add_chapter(ctitle, a['href'])

            cdates.sort()
            self.story.setMetadata('datePublished', cdates[0])
            self.story.setMetadata('dateUpdated', cdates[-1])

Last edited by junni; 12-04-2021 at 12:45 PM.
junni is offline   Reply With Quote
Old 12-05-2021, 08:08 PM   #6733
ownedbycats
Wizard
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 3,384
Karma: 14100982
Join Date: Oct 2018
Device: Kobo Aura HD (retired), Kobo Libra H2O
Anyone else having spordaic Flaresolverr failures? Tried updating a fic a few hours ago and it timed out, but I just tried again (before falling back to FFDL cache) and it's working now.
ownedbycats is offline   Reply With Quote
Old 12-05-2021, 08:21 PM   #6734
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 5,137
Karma: 955296
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
I have found it helps with FlareSolverr for fanfiction.net if you first visit a story URL in browser and wait for the CloudFlare verification to finish before trying to use FFF and FlareSolverr.

I suspect they are remembering IPs that have been verified recently.
JimmXinu is offline   Reply With Quote
Old 12-05-2021, 08:23 PM   #6735
ownedbycats
Wizard
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 3,384
Karma: 14100982
Join Date: Oct 2018
Device: Kobo Aura HD (retired), Kobo Libra H2O
I'll try that then.
ownedbycats is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] Open With kiwidude Plugins 387 01-17-2022 10:37 AM
[GUI Plugin] KindleUnpack - The Plugin DiapDealer Plugins 484 01-14-2022 01:49 PM
[GUI Plugin] Marvin XD Philantrop Plugins 126 01-29-2017 01:48 PM
[GUI Plugin] KiNotes -axel- Plugins 0 07-14-2013 07:39 PM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 01:27 PM


All times are GMT -4. The time now is 09:48 AM.


MobileRead.com is a privately owned, operated and funded community.