Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 01-15-2022, 11:07 PM   #6826
chrisric
Junior Member
chrisric began at the beginning.
 
Posts: 8
Karma: 10
Join Date: Jan 2020
Device: iPhone/Voice Dream Reader
Is there a way to save partial chapter downloads of books/novels? I can't see the option, I might be blind though.

I thought I seen a "save failed downloads" option (timeout/not all chapters downloaded etc) once but now I can't see it. Might be wishful thinking.

Thanks.

-Chris
chrisric is offline   Reply With Quote
Old 01-15-2022, 11:09 PM   #6827
ownedbycats
Wizard
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 3,376
Karma: 14100982
Join Date: Oct 2018
Device: Kobo Aura HD (retired), Kobo Libra H2O
Code:
## Because some adapters can pull chapter URLs from human posts, the
## odds of errors in the chapter URLs can be higher for some
## sites/stories.  You can set continue_on_chapter_error:true to
## continue on after failing to download a chapter and instead record
## an error message in the ebook for that chapter.
continue_on_chapter_error:false
ownedbycats is online now   Reply With Quote
Old 01-16-2022, 01:27 PM   #6828
Emerald_Lilies
Junior Member
Emerald_Lilies began at the beginning.
 
Posts: 3
Karma: 10
Join Date: Jan 2022
Device: none
First off, thank you so much for all your work!

I've been going through the forum (and slowly teaching myself regex) and I haven't been able to figure this out. I have my personal.ini set up with onlyromships to only include pairings with a "/". When I get a fic that only has an "&" gen pairing in ships, it won't remove that pairing.

https://archiveofourown.org/works/36...pters/90879328

The relevant (I think?) bit of my personal.ini (and the whole thing attached):

Spoiler:
Code:
[archiveofourown.org]
## adds to include_subject_tags instead of replacing it.
extra_subject_tags:fandoms,freeformtags,ao3categories

include_in_onlyromships:ships

add_to_include_metadata_post:
 onlyromships=~[ ]*/[ ]*

#add_to_exclude_metadata_post:
#onlyromships=~&

add_to_extra_valid_entries:,ships2chars

include_in_ships2chars:ships.NOREPL
# NOREPL prevents any ships patterns from being applied to ships2chars.

add_to_replace_metadata:
 ships2chars=>[ ]*/[ ]*=>/
 ships2chars=>[ ]*&[ ]*=>/
 ships2chars=>([^/]+)/([^/]+)/([^/]+)/(.+)=>\1\,\2\,\3\,\4
 ships2chars=>([^/]+)/([^/]+)/(.+)=>\1\,\2\,\3
 ships2chars=>([^/]+)/(.+)=>\1\,\2

include_in_characters:characters,ships2chars


I've tried it with the add_to_include_metadata_post and the add_to_exclude_metadata_post bits both included and individually. Not sure where to go from here.
Attached Files
File Type: txt personal ini.txt (12.0 KB, 1 views)
Emerald_Lilies is offline   Reply With Quote
Old 01-16-2022, 01:59 PM   #6829
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 5,130
Karma: 945296
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Quote:
Originally Posted by chrisric View Post
Is there a way to save partial chapter downloads of books/novels? I can't see the option, I might be blind though.

I thought I seen a "save failed downloads" option (timeout/not all chapters downloaded etc) once but now I can't see it. Might be wishful thinking.
There isn't anything that will save a partial chapter.

But continue_on_chapter_error:true will save the chapters that succeeded and mark the chapters that failed in a download.

You can manually save a partial story download by specifying a chapter range after the storyURL[1-5].

There's also the ignore_chapter_url_list setting, but that's getting a bit esoteric.
JimmXinu is offline   Reply With Quote
Old 01-16-2022, 02:17 PM   #6830
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 5,130
Karma: 945296
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Quote:
Originally Posted by Emerald_Lilies View Post
I've been going through the forum (and slowly teaching myself regex) and I haven't been able to figure this out. I have my personal.ini set up with onlyromships to only include pairings with a "/". When I get a fic that only has an "&" gen pairing in ships, it won't remove that pairing.
You are very nearly there.

You need to define onlyromships so FFF knows it's there, and you need to do something with onlyromships so it's visible somewhere.

Some options shown below.

Code:
[archiveofourown.org]

## add onlyromships as well as ships2chars
add_to_extra_valid_entries:,ships2chars,onlyromships

## Adds to Calibre's Tags.  
add_to_include_subject_tags:,onlyromships

## Although you'd likely want to set it instead to replace ships
include_subject_tags: extratags, genre, category, characters, onlyromships, status

## Adds to Title Page:
add_to_extra_titlepage_entries:,onlyromships
## And a nice label:
onlyromships_label:Romantic Ships

## Set in a custom column:
add_to_custom_columns_settings:
 onlyromships=>#your_onlyromships_column
JimmXinu is offline   Reply With Quote
Old 01-16-2022, 03:13 PM   #6831
Emerald_Lilies
Junior Member
Emerald_Lilies began at the beginning.
 
Posts: 3
Karma: 10
Join Date: Jan 2022
Device: none
Quote:
Originally Posted by JimmXinu View Post
You are very nearly there.

You need to define onlyromships so FFF knows it's there, and you need to do something with onlyromships so it's visible somewhere.
So I did have some of that in already, but didn't think to copy it in the post. I added what I was missing (except the Title Page section - I use the original ships for that). Here is the whole of my AO3 section (the only place I use onlyromships):

Spoiler:
Code:
[archiveofourown.org]
username:XXXXXXXX
password:XXXXXXXX
is_adult:true
always_login:true

## Some adapters collect additional meta information beyond the
## standard ones.  They need to be defined in extra_valid_entries to
## tell the rest of the FanFicFare system about them.  They can be
## used in include_subject_tags, titlepage_entries,
## extra_titlepage_entries, logpage_entries, extra_logpage_entries,
## and include_in_* config items.  You can also add additional entries
## here to build up composite metadata entries.
## archiveofourown.org, for example, fills genre (a standard
## entry) as the composite of freeformtags, ao3categories in
## include_in_genre.  If there's ever more than 4 series, add
## series04,series04Url etc.
extra_valid_entries:fandoms, freeformtags, freefromtags,
 ao3categories, comments, chapterslashtotal, chapterstotal, kudos,
 hits, bookmarks, collections, byline, bookmarked, bookmarktags,
 bookmarksummary, bookmarkprivate, bookmarkrec, restricted, series00,
 series01, series02, series03, series00Url, series01Url, series02Url,
 series03Url, series00HTML, series01HTML, series02HTML, series03HTML,
 ships2chars,onlyromships
fandoms_label:Fandoms
freeformtags_label:Freeform Tags
freefromtags_label:Freeform Tags
ao3categories_label:AO3 Categories
comments_label:Comments
chapterslashtotal_label:Chapters/Total Chapters
chapterstotal_label:Total Chapters
kudos_label:Kudos
hits_label:Hits
collections_label:Collections
## Count of bookmarks on story by all users
bookmarks_label:Bookmarks
## Tags & Summary from *your* bookmark on the story.  Only collected
## if always_login:true
bookmarked_label:I Bookmarked Story
bookmarktags_label:My Bookmark Tags
bookmarksummary_label:My Bookmark Summary
bookmarkprivate_label:My Bookmark Private
bookmarkrec_label:My Bookmark Rec
restricted_label:Restricted to Registered Users
series00HTML_label:Series
series01HTML_label:Additional Series
series02HTML_label:Additional Series
series03HTML_label:Additional Series

## Assume entryUrl, apply to "<a class='%slink' href='%s'>%s</a>" to
## make entryHTML.
make_linkhtml_entries:series00,series01,series02,series03

## chapterslashtotal contains 1/3 or 1/1 or 3/? etc as reported by AO3.
## chapterstotal is just the total chapters part after the /
include_in_chapterstotal:chapterslashtotal.NOREPL
add_to_replace_metadata:
 chapterstotal=>^([0-9])+/(.+)$=>\2

keep_in_order_freeformtags:true
keep_in_order_ao3categories:true
keep_in_order_fandoms:true
keep_in_order_genre:true
keep_in_order_category:true
keep_in_order_characters:true
keep_in_order_ships:true

## AO3 doesn't have anything it calls 'genre'.  The adapter used to be
## hardcoded to include the site specific metadata freeformtags &
## ao3categories in the standard metadata field genre.  By making it
## configurable, users can change it.
include_in_genre: freeformtags, ao3categories

## AO3 uses the word 'category' differently than most sites.  The
## adapter used to be hardcoded to include the site specific metadata
## fandom in the standard metadata field category.  By making it
## configurable, users can change it.
include_in_category:fandoms

## freeformtags was previously typo'ed as freefromtags.  This way,
## freefromtags will still work for people who've used it.
include_in_freefromtags:freeformtags

## adds to titlepage_entries instead of replacing it.
#extra_titlepage_entries: fandoms,freeformtags,ao3categories,comments,
#chapterslashtotal,kudos,hits,bookmarks,bookmarked,bookmarktags,
#bookmarksummary,series01HTML,series02HTML,series03HTML
titlepage_entries: seriesHTML,rating,warnings,ao3categories,fandoms,
 ships,characters,freeformtags,status,datePublished,dateUpdated,
 numWords,chapterslashtotal,comments,kudos,hits,bookmarks,bookmarked,
 bookmarktags,bookmarksummary,series01HTML,series02HTML,series03HTML,
 site,description

## adds to include_subject_tags instead of replacing it.
extra_subject_tags:fandoms,freeformtags,ao3categories,onlyromships

include_in_onlyromships:ships

add_to_include_metadata_post:
 onlyromships=~[ ]*/[ ]*

#add_to_exclude_metadata_post:
#onlyromships=~&amp;

include_in_ships2chars:ships.NOREPL
# NOREPL prevents any ships patterns from being applied to ships2chars.

add_to_replace_metadata:
 ships2chars=>[ ]*/[ ]*=>/
 ships2chars=>[ ]*&amp;[ ]*=>/
 ships2chars=>([^/]+)/([^/]+)/([^/]+)/(.+)=>\1\,\2\,\3\,\4
 ships2chars=>([^/]+)/([^/]+)/(.+)=>\1\,\2\,\3
 ships2chars=>([^/]+)/(.+)=>\1\,\2

include_in_characters:characters,ships2chars

add_to_custom_columns_settings:	
 chapterslashtotal=>#chapters
 freeformtags=>#freeformtags
 onlyromships=>#ships
 ships=>#gcships
 description=>#description
 bookmarked=>#bookmarked

extra_logpage_entries:fandoms,freeformtags,ao3categories,comments,
 chapterslashtotal,kudos,hits,bookmarks,collections,byline,bookmarked,
 bookmarktags,bookmarksummary,bookmarkprivate,bookmarkrec,restricted,series00,
 series01,series02,series03


I still can't get it to work with the fic I linked last post. It works fine for other fics, as long as the "&" ship isn't the only one. Like it works for this fic:
https://archiveofourown.org/works/35839024

But not this fic (the first fic under the Gen tag on AO3 currently):
https://archiveofourown.org/works/35...pters/87480472

I'm feeling very confused lol. Will it just not let you leave a blank field?
Emerald_Lilies is offline   Reply With Quote
Old 01-16-2022, 04:31 PM   #6832
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 5,130
Karma: 945296
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Emerald_Lilies,

I copied your code into an empty library, commented out always_login:true, and changed the column for onlyromships to one I already had, and downloaded those three stories.

I got 'Jaskier | Dandelion/Yennefer z Vengerbergu | Yennefer of Vengerberg' for Jarring Realities and nothing for the other two.

I believe that's what you wanted, yes? It looks like it's working to me.

Do you have a custom_columns_settings for #ships in a different section like [defaults]? You may be setting it twice.
JimmXinu is offline   Reply With Quote
Old 01-16-2022, 05:43 PM   #6833
Emerald_Lilies
Junior Member
Emerald_Lilies began at the beginning.
 
Posts: 3
Karma: 10
Join Date: Jan 2022
Device: none
Quote:
Originally Posted by JimmXinu View Post
Do you have a custom_columns_settings for #ships in a different section like [defaults]? You may be setting it twice.
That's what it was! Under Configure FanFicFare>Custom Columns, I had the drop down for my ships columns set wrong. And it wouldn't actually update the column until I deleted and then redownloaded the fic. I tried all the different update modes and none would update it, including with Keep Existing Tags When Updating Metadata? unchecked, but downloading fresh worked. I don't understand this stuff nearly enough to understand why though.

Emerald_Lilies is offline   Reply With Quote
Old 01-16-2022, 07:19 PM   #6834
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 5,130
Karma: 945296
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Voyage
Have you read the wiki page about UpdateModes?
JimmXinu is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] Open With kiwidude Plugins 387 01-17-2022 10:37 AM
[GUI Plugin] KindleUnpack - The Plugin DiapDealer Plugins 484 01-14-2022 01:49 PM
[GUI Plugin] Marvin XD Philantrop Plugins 126 01-29-2017 01:48 PM
[GUI Plugin] KiNotes -axel- Plugins 0 07-14-2013 07:39 PM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 01:27 PM


All times are GMT -4. The time now is 02:15 AM.


MobileRead.com is a privately owned, operated and funded community.