Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 07-13-2017, 01:49 AM   #2341
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,060
Karma: 587516
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Quote:
Originally Posted by bugstomper View Post
Although, what about a general purpose adaptor for situations like this...
There are already other tools out there for creating ebooks from web pages as a general thing.

I'm not interested in supporting more general solutions in FFF because I rather doubt that it's going to be as close as you think, honestly.
JimmXinu is offline   Reply With Quote
Advert
Old 07-15-2017, 01:27 AM   #2342
bugstomper
Junior Member
bugstomper began at the beginning.
 
Posts: 8
Karma: 10
Join Date: Jun 2017
Device: kindle
Quote:
Originally Posted by JimmXinu View Post
'm not interested in supporting more general solutions in FFF because I rather doubt that it's going to be as close as you think, honestly.
It looks like you are right about that. I now have two serial books I'm reading that are on wordpress.com. They are both just a tiny bit of extending basic_adaptor and even easier to do the second one after I did the first. But I don't see how I would generalise anything else to make anything easier for a non-programmer.

However, is there any way to make it so I don't have to manually unzip the plugin, add in my adaptors and modified __init__.py, and zip it up again every time Calibre updates the plugin? Perhaps something that could go in personal.ini to specify paths of custom adaptors or specify a directory containing them?
bugstomper is offline   Reply With Quote
Old 07-15-2017, 09:03 AM   #2343
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,060
Karma: 587516
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Quote:
Originally Posted by bugstomper View Post
However, is there any way to make it so I don't have to manually unzip the plugin, add in my adaptors and modified __init__.py, and zip it up again every time Calibre updates the plugin? Perhaps something that could go in personal.ini to specify paths of custom adaptors or specify a directory containing them?
When I re-designed the internal structure several years ago, I tried really hard to set it up so all that was required was having adapter source files in a certain directory (inside the zip, for plugin) with a common name pattern.

I was never able to come up with a way that worked across all three FanFicFare platforms (Calibre plugin, web service and python CLI). Admittedly, I was new with Python then and I'm still no classloader expert now.

Plus, even if I could I'm not sure it would be a good idea to allow loading of arbitrary code for security reasons.

Your best bet right now is to keep your code in your own github fork, merge my upstream changes into that periodically and install that version in your calibre. This does require git and learning a least a bit about how to use it.

Roughly:
  1. Make a github account
  2. Create a fork of the FanFicFare project on github (there's a 'fork' button)
  3. Clone your fork to a working directory on your Calibre machine (follow github instructions)
  4. Set an upstream remote to the project (git remote add upstream https://github.com/JimmXinu/FanFicFare.git)
  5. Create (and checkout) a branch in your working directory (somewhat optional)
  6. Make your changes in your working directory and commit them
  7. From your working directory, run FFF's makeplugin.py
  8. Install the plugin zip in Calibre with calibre-customize -a FanFicFare.zip
  9. Then, when FanFicFare updates, instead of installing normally, go to your working directory, merge upstream changes with git fetch upstream; git merge upstream/master then repeat steps 7 & 8.
JimmXinu is offline   Reply With Quote
Old 07-15-2017, 02:48 PM   #2344
sonofden
Junior Member
sonofden began at the beginning.
 
Posts: 1
Karma: 10
Join Date: Jul 2017
Device: Sony PRS 600
Having some problems with xen forums (spacebattles and sufficient velocity).


It downloads the book but only the first post, despite the fact there are several threadmarked chapters. Here are examples of problem stories:

https://forums.spacebattles.com/thre...ssover.544303/

https://forums.sufficientvelocity.co...aracter.39758/


It is not all stories on these websites, just some. Any help or guidance would be appreciated.


Edit: Nevermind. For some reason some times the plugin picks up the wrong address. When I manually correct the url and re-download it works.

Last edited by sonofden; 07-15-2017 at 03:10 PM.
sonofden is offline   Reply With Quote
Old 07-17-2017, 07:17 AM   #2345
cklls
Zealot
cklls ought to be getting tired of karma fortunes by now.cklls ought to be getting tired of karma fortunes by now.cklls ought to be getting tired of karma fortunes by now.cklls ought to be getting tired of karma fortunes by now.cklls ought to be getting tired of karma fortunes by now.cklls ought to be getting tired of karma fortunes by now.cklls ought to be getting tired of karma fortunes by now.cklls ought to be getting tired of karma fortunes by now.cklls ought to be getting tired of karma fortunes by now.cklls ought to be getting tired of karma fortunes by now.cklls ought to be getting tired of karma fortunes by now.
 
Posts: 144
Karma: 1030058
Join Date: Jul 2010
Location: New England
Device: Nook, EB1150, Samsung Galaxy Tab 2 10.1, Surface Pro 3
Hi Jimm - dramione.org is up and operating again. Would very much appreciate having it added back in! Thanks!
cklls is offline   Reply With Quote
Old 07-17-2017, 11:35 AM   #2346
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,060
Karma: 587516
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
New test version posted

2017-07-17
- Restore adapter_dramioneorg after site came back.
JimmXinu is offline   Reply With Quote
Old 07-17-2017, 04:03 PM   #2347
ILB
Connoisseur
ILB began at the beginning.
 
Posts: 80
Karma: 10
Join Date: Jun 2012
Location: Germany
Device: Kindle Voyage
I get an error message (IndexError:list index out of range) if I want to use "Get Story URLs from Web Page"
example http://archiveofourown.org/series/558469


Spoiler:

calibre, version 3.4.0
ERROR: Unhandled exception: <b>IndexError</b>:list index out of range

calibre 3.4 [64bit] embedded-python: True is64bit: True
Windows-10-10.0.15063-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.15063')
Python 2.7.12+
Windows: ('10', '10.0.15063', 'SP0', u'Multiprocessor Free')
Interface language: None
Successfully initialized third party plugins: Generate Cover (1, 5, 21) && Count Pages (1, 8, 0) && Copy Cover To Device (2, 0, 0) && EpubMerge (2, 1, 1) && Quick Preferences (1, 4, 1) && FanFicFare (2, 14, 1) && Similar Stories (1, 0, 58) && Find Duplicates (1, 6, 3) && Reading List (1, 6, 6) && SmartEject (2, 0, 7) && Manage Series (1, 2, 8) && Kindle Collections (1, 7, 17)
Traceback (most recent call last):
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 548, in get_urls_from_page_menu
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 568, in get_urls_from_page
File "calibre_plugins.fanficfare_plugin.fanficfare.getu rls", line 61, in get_urls_from_page
File "calibre_plugins.fanficfare_plugin.fanficfare.adap ters.adapter_archiveofourownorg", line 106, in performLogin
IndexError: list index out of range
ILB is offline   Reply With Quote
Old 07-17-2017, 07:29 PM   #2348
Loba
Member
Loba began at the beginning.
 
Loba's Avatar
 
Posts: 18
Karma: 10
Join Date: Sep 2016
Device: PW2 Wifi-4GB
Quote:
Originally Posted by ILB View Post
I get an error message (IndexError:list index out of range) if I want to use "Get Story URLs from Web Page"
example http://archiveofourown.org/series/558469
Getting the same when trying create anthologies and also when updating existing ones. Error below.
Spoiler:

calibre, version 3.3.0
ERROR: Unhandled exception: <b>IndexError</b>:list index out of range

calibre 3.3 Portable embedded-python: True is64bit: False
Windows-10-10.0.15063-SP0 Windows ('32bit', 'WindowsPE')
32bit process running on 64bit windows
('Windows', '10', '10.0.15063')
Python 2.7.12+
Windows: ('10', '10.0.15063', 'SP0', u'Multiprocessor Free')
Interface language: None
Successfully initialized third party plugins: EpubMerge (2, 1, 1) && SmartEject (2, 0, 7) && View Manager (1, 4, 3) && Reading List (1, 6, 6) && EpubSplit (2, 2, 1) && Favourites Menu (1, 0, 4) && Generate Cover (1, 5, 21) && FanFicFare (2, 14, 0) && Quick Preferences (1, 4, 1) && Kindle Collections (1, 7, 17) && Prettify Cover (0, 9, 9) && Find Duplicates (1, 6, 3) && Count Pages (1, 8, 0) && Consolidate All Library Metadata (2, 0, 32)
Traceback (most recent call last):
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 810, in update_anthology
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 568, in get_urls_from_page
File "calibre_plugins.fanficfare_plugin.fanficfare.getu rls", line 61, in get_urls_from_page
File "calibre_plugins.fanficfare_plugin.fanficfare.adap ters.adapter_archiveofourownorg", line 106, in performLogin
IndexError: list index out of range


Ao3 did a deploy last night.
Quote:
Originally Posted by Ao3_Status Twitter
The Archive is now running on Rails 4.2, with further upgrades in the works. Issues in the previous deploy have been resolved as well.

Last edited by Loba; 07-17-2017 at 07:37 PM.
Loba is offline   Reply With Quote
Old 07-17-2017, 07:42 PM   #2349
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,060
Karma: 587516
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
AO3 has changed their login mechanism a bit, breaking FFF in the process. I'm looking into it.

If you comment out / set fale always_login under [archiveofourown.org], you should at least be able to download stories that don't require login.
JimmXinu is offline   Reply With Quote
Old 07-17-2017, 09:50 PM   #2350
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,060
Karma: 587516
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
New test version posted

2017-07-17 again
- Fix for AO3 login change.

2017-07-17
- Restore adapter_dramioneorg after site came back.
JimmXinu is offline   Reply With Quote
Old 07-20-2017, 11:14 AM   #2351
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,060
Karma: 587516
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
New Test version posted

2017-07-20
- Fix for images from some sources ending up with // accidentally in longdesc.
- Fixes for replace_br_with_p causing extra tags when run more than once on the same text. Now adds <!-- FFF_replace_br_with_p_has_been_run --> markers to prevent it.
- Add replace_failed_smilies_with_alt_text option for base_xenforo.
- Add some debug perf prof output.
- Fix published and update date for gravitytales.com adapter - import feedparser (#204) from cryzed

replace_failed_smilies_with_alt_text details:
Spoiler:
Code:
## SV & SB (and possibly QQ and AH) like to use sprite smilies --
## smiley images that are all in one image file for performance and
## are shown by CSS background with offsets.  Epub viewers don't like
## that.
##
## The sprite smiley img tags generally do have alt attributes that get
## the point across: ":)" ":D" ":(" ":lol" etc.  And not all smilies
## on these sites use sprite images, so some can be used as is.
##
## When replace_failed_smilies_with_alt_text:true, any images that
## failed to download or are src=clear.png *and* have a class containing
## mceSmilie and an alt attribute will be replaced with:
## <span class="(classes)">(alt text)</span>
##
## The smiley classes are preserved in case the user wants to do
## something special with them.
#replace_failed_smilies_with_alt_text:false
JimmXinu is offline   Reply With Quote
Old 07-20-2017, 01:01 PM   #2352
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,060
Karma: 587516
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Something I learned today: FanFicFare already has code in it for a user custom icon.

See the end of the discussion on this issue.
JimmXinu is offline   Reply With Quote
Old 07-20-2017, 03:15 PM   #2353
Loba
Member
Loba began at the beginning.
 
Loba's Avatar
 
Posts: 18
Karma: 10
Join Date: Sep 2016
Device: PW2 Wifi-4GB
Re:AO3 login changes

I'm getting the following error when always_login is set to true on the latest test version. Different error than before, but always login still has to be commented out.
Code:
'NoneType' object has no attribute '__getitem__'

Last edited by Loba; 07-20-2017 at 03:17 PM. Reason: typo
Loba is offline   Reply With Quote
Old 07-20-2017, 08:44 PM   #2354
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,060
Karma: 587516
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
I'm not seeing it--I can download with user/pass fine on AO3.

I suggest you install the test version again and make sure you restart calibre afterwards.

Quote:
Originally Posted by Loba View Post
Re:AO3 login changes

I'm getting the following error when always_login is set to true on the latest test version. Different error than before, but always login still has to be commented out.
Code:
'NoneType' object has no attribute '__getitem__'
JimmXinu is offline   Reply With Quote
Old 07-20-2017, 08:51 PM   #2355
Loba
Member
Loba began at the beginning.
 
Loba's Avatar
 
Posts: 18
Karma: 10
Join Date: Sep 2016
Device: PW2 Wifi-4GB
Quote:
Originally Posted by JimmXinu View Post
I'm not seeing it--I can download with user/pass fine on AO3.

I suggest you install the test version again and make sure you restart calibre afterwards.
Hmmm I must have fudged up the install somehow. I restarted a few times after installing it. Idek. Working fine now. Thanks.

Edit:
Nevermind. It's still happening.
Quote:
Status
Title
Author
Comment
URL
Error
With A Little Christmas Magic
AceLotti
'NoneType' object has no attribute '__getitem__'
https://archiveofourown.org/works/590407
That's the full copypasta. I've tried updating both fics that require login and ones that don't. I must have clicked a non-ao3 fic after reinstalling. Works just fine when I comment out always_login:true for fics that don't require login. I'll try reinstalling again, full restart pc and all that and report back if I get it to work. *confused*

Last edited by Loba; 07-20-2017 at 09:14 PM.
Loba is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] Open With kiwidude Plugins 316 06-12-2017 06:30 PM
[GUI Plugin] KindleUnpack - The Plugin DiapDealer Plugins 402 03-05-2017 10:31 AM
[GUI Plugin] Marvin XD Philantrop Plugins 126 01-29-2017 12:48 PM
[GUI Plugin] KiNotes -axel- Plugins 0 07-14-2013 06:39 PM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 12:27 PM


All times are GMT -4. The time now is 07:25 PM.


MobileRead.com is a privately owned, operated and funded community.