Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 05-12-2023, 03:44 PM   #8416
theducks
Well trained by Cats
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 31,390
Karma: 62500066
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
There is only 1 'Official' cover in any book.
All the rest are just a page with an image.
So... Collect the images of the covers from your Fav site(s)
Insert a blank page where you want , Use the Editor (on that page): Click the Insert Image icon (on the page toolbar). Add CSS styling to taste.

Repeat for each image

Alternately, you could walk the (canceled) covers to their new home

Add a cover (tools:add cover), then remove the 'cover' semantics for both the XHTML and image /It looks like you need to edit the OPF/
The advantage is Add Cover does all the SVG code
theducks is online now   Reply With Quote
Old 05-12-2023, 04:31 PM   #8417
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 7,202
Karma: 5006097
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by jherazob View Post
Yes, it makes no difference whether i add the cover via editing the metadata or generated using the plugin (which is nicer, honestly), same result, an EPUB file with no cover. Calibre insists that the book has a cover, but it's absent from the file, logic would say that editing the epub metadata would keep the cover but doesn't look like it does.
...
Calibre displays and updates the cover in the library.

If you want the cover you made in Calibre to be in the epub on disk, you also have use Calibre's built-in Polish book feature or the Modify Epub plugin to update/inject the cover into the existing epub.

The situation is further complicated by the fact that when you send a book from Calibre to a device, one of the metadata that Calibre automatically injects is the cover. So many users may never realize that their epubs on disk don't have covers in them.
JimmXinu is offline   Reply With Quote
Old 05-12-2023, 04:50 PM   #8418
jherazob
Junior Member
jherazob began at the beginning.
 
jherazob's Avatar
 
Posts: 8
Karma: 10
Join Date: May 2023
Device: Android tablet
Quote:
Originally Posted by JimmXinu View Post
If you want the cover you made in Calibre to be in the epub on disk, you also have use Calibre's built-in Polish book feature or the Modify Epub plugin to update/inject the cover into the existing epub.
The Modify Epub plugin did the trick! Thanks!
jherazob is offline   Reply With Quote
Old 05-13-2023, 11:54 PM   #8419
DandalfTheWhite
Enthusiast
DandalfTheWhite shines like a glazed doughnut.DandalfTheWhite shines like a glazed doughnut.DandalfTheWhite shines like a glazed doughnut.DandalfTheWhite shines like a glazed doughnut.DandalfTheWhite shines like a glazed doughnut.DandalfTheWhite shines like a glazed doughnut.DandalfTheWhite shines like a glazed doughnut.DandalfTheWhite shines like a glazed doughnut.DandalfTheWhite shines like a glazed doughnut.DandalfTheWhite shines like a glazed doughnut.DandalfTheWhite shines like a glazed doughnut.
 
Posts: 29
Karma: 8692
Join Date: Nov 2011
Device: Kindle Paperwhite 4
This seems to be a new policy on ao3. Do you recommend changing any settings? I think I recall already slowing down ao3 down on my system, but how slow should we go? I haven’t updated or downloaded anything in a while. https://www.transformativeworks.org/...n-the-archive/

Thanks!
DandalfTheWhite is offline   Reply With Quote
Old 05-14-2023, 07:31 AM   #8420
ownedbycats
Custom User Title
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 11,436
Karma: 81367635
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
It's measures against large-scale data-scraping. I would not worry too much unless you're trying to pull down the entire archive (in which case, don't do that).

Do email notifications instead of updating your entire library, though.

Last edited by ownedbycats; 05-14-2023 at 07:40 AM.
ownedbycats is online now   Reply With Quote
Old 05-14-2023, 08:53 AM   #8421
DandalfTheWhite
Enthusiast
DandalfTheWhite shines like a glazed doughnut.DandalfTheWhite shines like a glazed doughnut.DandalfTheWhite shines like a glazed doughnut.DandalfTheWhite shines like a glazed doughnut.DandalfTheWhite shines like a glazed doughnut.DandalfTheWhite shines like a glazed doughnut.DandalfTheWhite shines like a glazed doughnut.DandalfTheWhite shines like a glazed doughnut.DandalfTheWhite shines like a glazed doughnut.DandalfTheWhite shines like a glazed doughnut.DandalfTheWhite shines like a glazed doughnut.
 
Posts: 29
Karma: 8692
Join Date: Nov 2011
Device: Kindle Paperwhite 4
Quote:
Originally Posted by ownedbycats View Post
It's measures against large-scale data-scraping. I would not worry too much unless you're trying to pull down the entire archive (in which case, don't do that).

Do email notifications instead of updating your entire library, though.
Yeah that’s what I figured but I didn't want them to like ban my ip. I do the email notifications updating already and I was hoping it was just large scale stuff but wanted to make sure. Thanks!
DandalfTheWhite is offline   Reply With Quote
Old 05-14-2023, 09:25 AM   #8422
ownedbycats
Custom User Title
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 11,436
Karma: 81367635
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
Also note this:

Quote:
However, we don’t have a policy against responsible data collection — such as those done by academic researchers, fans backing up works to Wayback Machine or Google’s search indexing. Putting systems in place that attempt to block all scraping would be difficult or impossible without also blocking legitimate uses of the site.
AO3 allows downloads of fics for backup/viewing on different places. Using FanFicFare to do pretty much the same thing likely falls under the same scope.
ownedbycats is online now   Reply With Quote
Old 05-14-2023, 11:30 AM   #8423
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 7,202
Karma: 5006097
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
AO3 has, for some time now, had a blocking mechanism when a user (or IP? we don't know how it's implemented) makes too many requests.

What counts as 'too many' is unknown. I would speculate it's somewhere between dozens and hundreds of downloads/update attempts in a short period of time--which is another parameter we don't know.

Only a few users bumped into this problem at the time, but a default setting of slow_down_sleep_time:2 was added under [archiveofourown.org], which was enough for almost all users.

Unless we start seeing it happen, we won't know what may be changed.

As for settings, if you are particularly paranoid about it, you could set slow_down_sleep_time to a higher value.
JimmXinu is offline   Reply With Quote
Old 05-14-2023, 01:44 PM   #8424
ownedbycats
Custom User Title
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 11,436
Karma: 81367635
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
When I was populating the long-text metadata column a year or two back, I found updating more than 50 stories at once with the default sleep-time would usually trigger a temporary block.
ownedbycats is online now   Reply With Quote
Old 05-17-2023, 06:36 PM   #8425
ownedbycats
Custom User Title
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 11,436
Karma: 81367635
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
Dumb question: Would it be possible to download this as a 'fic'? The link isn't accepted by the downloader.
https://archiveofourown.org/admin_posts/10851

I'd like to have a copy in my library for quick reference.

Last edited by ownedbycats; 05-17-2023 at 06:48 PM.
ownedbycats is online now   Reply With Quote
Old 05-17-2023, 08:21 PM   #8426
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 7,202
Karma: 5006097
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Not story is not a story.
JimmXinu is offline   Reply With Quote
Old 05-19-2023, 06:05 AM   #8427
sios00
Enthusiast
sios00 began at the beginning.
 
Posts: 31
Karma: 10
Join Date: May 2022
Device: Kobo Libra 2
How to gather all AO3 story links from Gmail into one place to copy into Fanficfare

In case anyone is interested, I made a Google Apps Script that will copy all AO3 story links in your Gmail inbox and then print it out so that you can just copy all of that and immediately add it to FanficFare.

How I use this:
- For me, all AO3 story updates or new stories from followed authors are immediately set to be in the Updates category by Gmail.
- I have Gmail set to automatically match all emails from @archiveofourown.org and apply the label "Fanfic" to those emails.
- Whenever I have a few emails of new story updates or new stories from authors I follow, I leave them in the inbox under the Updates category *and* the Fanfic label.
- I then run this script from script.google.com and then copy the contents of the last Log printout, then paste it in Fanficfare's "Download from URLs" tab.
- All the story links will then be immediately downloaded by Fanficfare.
- I then archive all of those emails so they are no longer in my inbox and won't be gathered again the next time I run the script.

Why I do this:
- Previously I had to manually look at each email and then right click on the story name, click on "Copy Link" and then paste it into Fanficfare. It was troublesome to do so especially if there are multiple fics that have been updated since the last time I saved all of them.
- Now I can just ensure that all the AO3 emails that are in my inbox and are labelled with "Fanfic" are the stories that I want to download, then run the script to copy all the emails' story links into one easy place to copy into Fanficfare, instead of copying the links one by one, email by email.

How to set this up:
1. Go to https://script.google.com/ and create a new project.
2. Replace whatever code is in there by default with the following. Change the label or category as needed.

Code:
function collectLinks() {
  // Get the label to search
  var label = "Fanfic";

  // Get the category to search
  var category = "Updates";

  // Get the regex expression for the email subject
  var subjectRegex = /[AO3]/;

  // Get the regex expression for the link
  var linkRegex0 = /http:\/\/archiveofourown.org\/works\/(\d+)/;
  var linkRegex = new RegExp(linkRegex0, "g");

  var links = new Set(); // So that only unique links will be stored (n)

  // Get all messages in the label and category that are in the inbox (ie. not deleted or archived)
  var threads = GmailApp.search('label:' + label + ' category:' + category + " in:inbox");

  // Iterate over the threads
  for (var i = 0; i < threads.length; i++) {
    // Get all messages in the thread
    var messages = threads[i].getMessages();

    // Iterate over the messages
    for (var j = 0; j < messages.length; j++) {
      // Get the subject of the message
      var subject = messages[j].getSubject();

      Logger.log("Subject: "+ subject);

      // If the subject matches the regex expression
      if (subjectRegex.test(subject)) {
        var body = messages[j].getBody();

        // Get the link from the message
        var extractedLinks = body.match(linkRegex);
        // var extractedLinks = body.matchAll(linkRegex);

        // Print the link
        Logger.log("Extracted link: "+ extractedLinks);

        // Add the extracted links into the set of links
        for (var link of extractedLinks) {
          links.add(link);
        }

      }
    }
  }
  
  // Log out all collected links
  var uniqueLinks = Array.from(links);
  Logger.log(uniqueLinks);

}
3. Click on Run
4. Copy the contents of the last Log Info line, excluding the open and close square brackets.
5. Go to Fanficfare in Calibre and click on the down arrow, then click on "Download from URLs".
6. The contents of whatever was copied should be automatically pasted inside.
7. Change the download options if needed, then click on OK.

If there are any better ways to do this, I'm also open to hearing about it!

Last edited by sios00; 10-01-2023 at 06:29 AM. Reason: Updated code
sios00 is offline   Reply With Quote
Old 05-21-2023, 12:48 PM   #8428
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 7,202
Karma: 5006097
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
New Test Version Posted

2023-05-21
- wuxiaworld.co -> wuxiaworld.xyz changes most data collection #953

Also fixes www.novelupdates.cc which shares code.
JimmXinu is offline   Reply With Quote
Old 05-22-2023, 05:12 AM   #8429
internetkeno
Junior Member
internetkeno began at the beginning.
 
Posts: 2
Karma: 10
Join Date: May 2023
Device: none
Hi,

if i try to download or updaate my fiction collection

it gives me this 403 error:

Code:
Status Title Author Comment URL Error Unknown Unknown HTTP Error in FFF '403 Client Error: Forbidden for url: https://www.fanfiction.net/s/13833982/1/Fixing-the-Wizarding-World'(403) https://www.fanfiction.net/s/13833982/1/Fixing-the-Wizarding-World
internetkeno is offline   Reply With Quote
Old 05-22-2023, 07:59 AM   #8430
theducks
Well trained by Cats
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 31,390
Karma: 62500066
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
Quote:
Originally Posted by internetkeno View Post
Hi,

if i try to download or updaate my fiction collection

it gives me this 403 error:

Code:
Status Title Author Comment URL Error Unknown Unknown HTTP Error in FFF '403 Client Error: Forbidden for url: https://www.fanfiction.net/s/13833982/1/Fixing-the-Wizarding-World'(403) https://www.fanfiction.net/s/13833982/1/Fixing-the-Wizarding-World
403 means Forbidden ((a standard response type code)
Has it (the plugin) ever worked for you?

Possibly, you made too many attempts (quickly or in a row) and got locked out
Did you login?

The link works for me in a browser (I am not a FFF user)
theducks is online now   Reply With Quote
Reply

Tags
fanfiction

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] KindleUnpack - The Plugin DiapDealer Plugins 527 08-15-2025 02:36 PM
[GUI Plugin] Open With kiwidude Plugins 404 02-21-2025 06:42 AM
[GUI Plugin] Marvin XD Philantrop Plugins 126 01-29-2017 01:48 PM
[GUI Plugin] KiNotes -axel- Plugins 0 07-14-2013 07:39 PM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 01:27 PM


All times are GMT -4. The time now is 01:37 AM.


MobileRead.com is a privately owned, operated and funded community.