Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 04-21-2017, 08:32 AM   #2011
Tanjamuse
Guru
Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!
 
Posts: 823
Karma: 5258
Join Date: Jan 2014
Device: Samsung Galaxy Tab 3
Can I convert this to epub and get FFF to collect the metadata?
Attached Files
File Type: txt Joey - Flopsy - A Child Looked Back.txt (4.7 KB, 22 views)
Tanjamuse is offline   Reply With Quote
Old 04-21-2017, 10:08 AM   #2012
taratears
Connoisseur
taratears began at the beginning.
 
Posts: 50
Karma: 10
Join Date: Aug 2013
Device: Kindle Fire HD
Did you still want those Examples?

Quote:
Originally Posted by JimmXinu View Post
I had a minute, so I just checked--a downloaded EPUB from AO3 for a recently updated story contained a normal story URL that existing FFF could find just fine.

So if you have example(s) of epubs or pages where this download.archiveofourown.org domain is used, I'd like to see them.
I lost access to a computer for awhile, so I'm just getting back to you on this.
taratears is offline   Reply With Quote
Old 04-21-2017, 11:21 AM   #2013
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,022
Karma: 587496
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Quote:
Originally Posted by gcomyn View Post
I haven't been able to figure out how to do a partial download with Calibre, so I've had to download the entire book to test it.
Add a chapter range in square brackets after the URL. Only works with "Download by URL", but you can enter URLs for existing books.

http://www.wuxiaworld.com/wmw-index/[90-105]
http://www.wuxiaworld.com/wmw-index/[90-]
http://www.wuxiaworld.com/wmw-index/[-5]
http://www.wuxiaworld.com/wmw-index/[102]
JimmXinu is offline   Reply With Quote
Old 04-21-2017, 11:29 AM   #2014
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,022
Karma: 587496
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Quote:
Originally Posted by Tanjamuse View Post
Can I convert this to epub and get FFF to collect the metadata?
Converting text to epub is a Calibre function.

FanFicFare will not find the story URL in the text file, but if you enter the story URL into calibre's Identifiers field as url:http://www.fanfiction.net/s/2620848/1/ you can use FFF's 'Update Calibre Metadata from Web Site' feature.
JimmXinu is offline   Reply With Quote
Old 04-21-2017, 11:40 AM   #2015
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,022
Karma: 587496
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Quote:
Originally Posted by taratears View Post
I lost access to a computer for awhile, so I'm just getting back to you on this.
I can't say I remembered anything about this, but it has been like 8 months.

I've added download.archiveofourown.org as an acceptable domain for AO3. It will be in the next test version.
JimmXinu is offline   Reply With Quote
Advert
Old 04-21-2017, 12:31 PM   #2016
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,022
Karma: 587496
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Need a check from some users.

GComyn has kindly written code to add the site deandamage.com. The problem is, I can't see it from my home network--it comes up 'Forbidden' by the site. But I can see it from my cell network.

So who can see this site and who gets forbidden? You can PM me if you'd rather not speak up publicly.

http://deandamage.com/
http://deandamage.com/viewstory.php?sid=169

Thanks!
JimmXinu is offline   Reply With Quote
Old 04-21-2017, 01:54 PM   #2017
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,022
Karma: 587496
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
New Test Version Posted

2017-04-21
- Add Story Notes to base_efiction_adapter.
- Don't send Referer:None -- hpfanficarchive.com doesn't like it.
- New site www.webnovel.com - thanks GComyn
- Additional tags collected for wuxiaworld--thanks GComyn
- Add download.archiveofourown.org for AO3 due to old downloaded AO3 epubs
- Fix for author including <b>Updated</b> in desc in adapter_ashwindersycophanthexcom.
- Fix "got more than 100 headers"-issue adapter_royalroadl.py only.
- Fix ffnet referer for cover images.
JimmXinu is offline   Reply With Quote
Old 04-21-2017, 03:50 PM   #2018
Atherton25
Connoisseur
Atherton25 has learned how to buy an e-book online
 
Posts: 54
Karma: 94
Join Date: May 2016
Device: Kindle Paperwhite
@gcomyn
Again thank you! Wuxiaworld has recently added a whole lot more fics.
As for the Wuxuiaworld adapter, there were some updates after my post that were made, I believe JimmXinu made those changes them. This corrected all of the problems I had if I remember right, one of them was implementing an empty-chapter setup which allowed for empty chapters and then fills them in later when the fic updates. The other was allowing for the https links that were in some of the indexes. And I'm not sure what caused the absolute choice index problem, but it got fixed as well.

I love translated webfiction sites, and I often have to use webtoepub Firefox plugin to get them easily downloaded on my kindle. It's a clunky program, but it works a whole lot better than manual downloads. I just wish they provided a way to 'update' their downloaded epubs rather than having to
1. Download new chapters and read them separately or merge them into an old download with epubmerge or
2. Re-download the whole story.

@JimmXinu
I can see the site deandamage.com just fine at home and I can see it fine on my VPN IP as well. Using both firefox and chrome in both cases. That... is a strange site based on their front page description of what it contains. However, if I go through Tor I get 403 Forbidden error.

Also, if you integrated gcomyn's changes adding those fixes by gcomyn, they... didn't come through. I just updated the adapter and then downloaded a couple of fics (new downloads) and didn't get the fixes he described in the earlier post. I got neither the chapter fix or description.

I'm not entirely sure how long this has been going on, but *any* stories on hpfanficarchive, by lostfanfiction gets the error: "HTTP Error 400: Bad Behavior" http://hpfanficarchive.com/stories/v...riesby&uid=283 is the author link. I tried downloading any of the stories on page 1 and every single one got the same error.

Last edited by Atherton25; 04-21-2017 at 04:03 PM. Reason: found tor may not work with deandamage.
Atherton25 is offline   Reply With Quote
Old 04-21-2017, 03:54 PM   #2019
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,022
Karma: 587496
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
New Test Version Posted

2017-04-21 (again)
- New sites from GComyn:
- gravitytales.com
- imrightbehindyou.com
- mtt.just-once.net
- obidala.net
- sword.borderline-angel.com
- tasteofpoison.inkubation.net
- unknowableroom.org
- www.13hours.org
- www.aneroticstory.com
- www.deandamage.com
- www.fiction.thebrokenworld.org
- www.narutofic.org
- www.starskyhutcharchive.net
- www.thedelphicexpanse.com
- www.thundercatsfans.org
JimmXinu is offline   Reply With Quote
Old 04-21-2017, 04:04 PM   #2020
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 3,022
Karma: 587496
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Quote:
Originally Posted by Atherton25 View Post
@JimmXinu
I can see the site deandamage.com just fine at home and I can see it fine on my VPN IP as well. Using both firefox and chrome in both cases. That... is a strange site based on their front page description of what it contains.
I've included that site in the latest test version. However, I'm strongly leaning towards removing it before the next release if it's blocked for others.

Quote:
Originally Posted by Atherton25 View Post
Also, if you integrated gcomyn's changes adding those fixes by gcomyn, they... didn't come through. I just updated the adapter and then downloaded a couple of fics (new downloads) and didn't get the fixes he described in the earlier post. I got neither the chapter fix or description.
Unless I've done something wrong, the latest two test versions should have had those changes. Make sure you have FFF v2.10.3.

Quote:
Originally Posted by Atherton25 View Post
I'm not entirely sure how long this has been going on, but *any* stories on hpfanficarchive, by lostfanfiction gets the error: "HTTP Error 400: Bad Behavior" http://hpfanficarchive.com/stories/v...riesby&uid=283 is the author link. I tried downloading any of the stories on page 1 and every single one got the same error.
Fixed in v2.10.3.
JimmXinu is offline   Reply With Quote
Old 04-21-2017, 07:03 PM   #2021
Atherton25
Connoisseur
Atherton25 has learned how to buy an e-book online
 
Posts: 54
Karma: 94
Join Date: May 2016
Device: Kindle Paperwhite
@JimmXinu
I had updated it... and apparently my version wasn't the latest version, it was 2.10.2... I'm not entirely sure how that happened, because I rename the zip with the date when I download it. When I did update it everything worked fine.

As for the site that doesn't work for everyone... my personal opinion is why don't you add it in with a proviso on the website and here that this may not work for everyone due to a website problem. Although I won't be use it, that's no reason to limit others who may use it. Having the option is better than limiting it.

@gcomyn
Wow, all those new sites, you've been busy.

And GravityTales! Awesome, BUT I found a problem with some of the ones I wanted to download. A few of them had flat out errors because I had the exact same title/author and it error'ed, I took care of those. However, beyond that, there was some that had the following error:
"local variable 'synopsis' referenced before assignment"
the list of the ones that i had happened on:
http://gravitytales.com/novel/aethernea
http://gravitytales.com/novel/how-to...-a-daily-basis
http://gravitytales.com/novel/the-ex...the-crazy-lich
http://gravitytales.com/novel/dungeon-hunter
http://gravitytales.com/novel/reincarnator

There may be more, but those are the ones that I tried that gave me an error.

Last edited by Atherton25; 04-21-2017 at 11:04 PM.
Atherton25 is offline   Reply With Quote
Old 04-22-2017, 04:01 AM   #2022
gcomyn
Member
gcomyn began at the beginning.
 
Posts: 18
Karma: 22
Join Date: Dec 2016
Location: Glendale, AZ
Device: Laptop, Tablet (nothing specific)
Quote:
Originally Posted by Atherton25 View Post
And GravityTales! Awesome, BUT I found a problem with some of the ones I wanted to download. A few of them had flat out errors because I had the exact same title/author and it error'ed, I took care of those. However, beyond that, there was some that had the following error:
"local variable 'synopsis' referenced before assignment"
the list of the ones that i had happened on:
http://gravitytales.com/novel/aethernea
http://gravitytales.com/novel/how-to...-a-daily-basis
http://gravitytales.com/novel/the-ex...the-crazy-lich
http://gravitytales.com/novel/dungeon-hunter
http://gravitytales.com/novel/reincarnator

There may be more, but those are the ones that I tried that gave me an error.
I'll look at it... there is no easy HTML seperation for the synopsis, and each author seems to title it differently... I'll figure something out.

GComyn
gcomyn is offline   Reply With Quote
Old 04-22-2017, 04:01 AM   #2023
miceandmen
Enthusiast
miceandmen knows the difference between 'who' and 'whom'miceandmen knows the difference between 'who' and 'whom'miceandmen knows the difference between 'who' and 'whom'miceandmen knows the difference between 'who' and 'whom'miceandmen knows the difference between 'who' and 'whom'miceandmen knows the difference between 'who' and 'whom'miceandmen knows the difference between 'who' and 'whom'miceandmen knows the difference between 'who' and 'whom'miceandmen knows the difference between 'who' and 'whom'miceandmen knows the difference between 'who' and 'whom'miceandmen knows the difference between 'who' and 'whom'
 
Posts: 31
Karma: 10000
Join Date: Apr 2017
Device: none
Hi,

is it possible to add the site https://noveltrove.com? It's an erotic stories website, with almost 1k stories.

Last edited by miceandmen; 04-22-2017 at 05:29 AM.
miceandmen is offline   Reply With Quote
Old 04-22-2017, 05:01 AM   #2024
gcomyn
Member
gcomyn began at the beginning.
 
Posts: 18
Karma: 22
Join Date: Dec 2016
Location: Glendale, AZ
Device: Laptop, Tablet (nothing specific)
Quote:
Originally Posted by Atherton25 View Post
And GravityTales! Awesome, BUT I found a problem with some of the ones I wanted to download. {--cut--}
I've sent an updated adapter to Jim. I basically changed it so that the title and author are only gotten from the headers, and any title or author listed are added to the synopsis (description/summary)...

Also, I commented out the code that retrieves the cover page, because everyone I tried got a 403: Forbidden error, but other images will be retrieved.

GComyn
gcomyn is offline   Reply With Quote
Old 04-22-2017, 06:13 AM   #2025
gcomyn
Member
gcomyn began at the beginning.
 
Posts: 18
Karma: 22
Join Date: Dec 2016
Location: Glendale, AZ
Device: Laptop, Tablet (nothing specific)
Quote:
Originally Posted by miceandmen View Post
Hi,

is it possible to add the site https://noveltrove.com? It's an erotic stories website, with almost 1k stories.
It has the title, author, authorURL, submission date, and categories in a specified division, and the body of the story seems easy to get... so it shouldn't be too hard.

It's also a 1 story/page site, so any multi-chapter stories would have to be downloaded one chapter at a time.

I'm working on another right now, when I get it done, I'll work on this one. It may take a few days, or be done later today... not sure.

GComyn
gcomyn is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] Open With kiwidude Plugins 316 06-12-2017 06:30 PM
[GUI Plugin] KindleUnpack - The Plugin DiapDealer Plugins 402 03-05-2017 10:31 AM
[GUI Plugin] Marvin XD Philantrop Plugins 126 01-29-2017 12:48 PM
[GUI Plugin] KiNotes -axel- Plugins 0 07-14-2013 06:39 PM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 12:27 PM


All times are GMT -4. The time now is 08:19 PM.


MobileRead.com is a privately owned, operated and funded community.