[Metadata Source Plugin] Romance.io

[plain-cover]

Originally Posted by DNSB

I did some testing on 1.1.1 and it seems to function well. The summary now has paragraph breaks. The cover images are still small but as near as I can tell from looking at the website, that is how romance.io stores them.

Thanks for testing and glad the summary is working for you! You're right that the cover images are directly from Romance.io and tend to be smaller than the ones from other sites, but I can't find any larger versions that I could pull instead, so I think we're stuck with them unfortunately.

Let me know if anything else comes up!

[DNSB]

Originally Posted by plain-cover

Thanks for testing and glad the summary is working for you! You're right that the cover images are directly from Romance.io and tend to be smaller than the ones from other sites, but I can't find any larger versions that I could pull instead, so I think we're stuck with them unfortunately.

Let me know if anything else comes up!

When I was looking at the romance.io images URLs, those small images are in the /large/ and in /small/ are the slightly larger than the average thumbnail images. So unless there is another directory I couldn't find, what we see is what we get.


https://s3.amazonaws.com/romance.io/books/large/5455786f87eac3369a912a3f.jpg

https://s3.amazonaws.com/romance.io/...369a912a3f.jpg

[scarlettruin]

So it still doesn't find anything (updated log below) and it's weird as I don't have a VPN on, I've turned off all my extensions for Chrome, and when i try accessing the website normally (romance.io i mean) the cloudflare protector page comes up but i pass it easily each time (and that is in chrome too). Could it be something like fanficfare where it needs AO3 login details to be able to access the website?


****************************** Romance.io (1, 1, 2) ******************************
Found 0 results
Downloading from Romance.io took 12.089999437332153
identify - start. title=Throne of Vengeance: An Arranged Marriage Mafia Romance (Throne Duet Book 2), authors=['Rina Kent'], identifiers={'mobi-asin': 'B08QZ8KV2X', 'romanceio': '6007e3a2a4d3c80e0e00f50a'}
System info: OS=Windows 11 (10.0.26200), Python=3.14.2, Calibre=9.4.0
Found 1 match(es), fetching detailed metadata...
Attempting JSON API fetch for 6007e3a2a4d3c80e0e00f50a...
JSON API request: https://www.romance.io/json/books/60...d3c80e0e00f50a
JSON API request failed: HTTPError 403: HTTP Error 403: Forbidden
✗ JSON API fetch attempt 1 failed: JsonApiAccessDeniedError: HTTP Error 403: Forbidden
JSON API blocked (403 Forbidden) - likely Cloudflare protection.
Marking all JSON endpoints dead for this session; subsequent books will go straight to Chrome.
JSON API had technical failures. Falling back to HTML scraping for 6007e3a2a4d3c80e0e00f50a...
HTML fetch: requesting book page for 6007e3a2a4d3c80e0e00f50a
Vendored import path: 'C:\\Users\\xxwil\\AppData\\Roaming\\calibre\\plug ins\\Romance.io.zip'
seleniumbase: loaded via direct zipimport
chromedriver found at 'C:\\Users\\xxwil\\.calibre_selenium\\drivers\\chr omedriver.exe'
Chrome version: 147.0.7727.102, chromedriver version: 147.0.7727.57
Page loaded successfully (40945 bytes)
Not-found marker detected, returning page early
Invalid Romance.io ID (404): https://www.romance.io/books/6007e3a2a4d3c80e0e00f50a
HTML fetch: page is invalid (404 or wrong content) for 6007e3a2a4d3c80e0e00f50a
○ HTML scraping completed successfully, but no match found
HTML scraping completed but found no data for 6007e3a2a4d3c80e0e00f50a.
Failed to fetch details for 6007e3a2a4d3c80e0e00f50a from 'https://www.romance.io/books/6007e3a2a4d3c80e0e00f50a'

[DNSB]

For what it may be worth, I do not have a login for romance.io and I seem to have no issues with fetching metadata. I seldom use Chrome so there are no out of the box add-ons installed. My Chrome version seems to be the same as yours (Version 147.0.7727.102 (Official Build) (64-bit)) though as I was writing this, it updated to Version 147.0.7727.117. I also do not have romance.io IDs.

Have you tried opening Chrome and connecting to romance.io, leaving Chrome open on that page and then trying a metadata download?

[plain-cover]

Originally Posted by scarlettruin

So it still doesn't find anything (updated log below) and it's weird as I don't have a VPN on, I've turned off all my extensions for Chrome, and when i try accessing the website normally (romance.io i mean) the cloudflare protector page comes up but i pass it easily each time (and that is in chrome too). Could it be something like fanficfare where it needs AO3 login details to be able to access the website?

Sorry for the delay, I weirdly wasn't getting emails when people posted on the thread. Can you try the latest v1.2.0? I added an HTTP metadata parser that doesn't use Chrome and shouldn't trigger Cloudflare at all, which just might avoid your problem entirely (and be much faster!).

If you are still seeing issues, please post your new log, since I also added additional logging in the new version.

[JohnnyBook]

When looking for metadata on books, I have noticed I have extra instances of Chrome popping up in the background. (icons on the taskbar.) I can't click them to open them, but can mouse over them and a small image will pop up showing me the site.

Its Romance.io

If calibre does not find metadata on Romance.io, the icon disappears as the background tab is closed. BUT, if it finds metadata the background tab stays open, and I start getting more and more icon added for each book it finds metadata for.

I can click them and select close, and the will go away.

This is probably a recent change in the last couple weeks, but I only noticed in in the last few days, (my computer was down for about 10 days.)
So I guess something on the site changed.

[plain-cover]

Originally Posted by JohnnyBook

When looking for metadata on books, I have noticed I have extra instances of Chrome popping up in the background. (icons on the taskbar.) I can't click them to open them, but can mouse over them and a small image will pop up showing me the site.

Its Romance.io

If calibre does not find metadata on Romance.io, the icon disappears as the background tab is closed. BUT, if it finds metadata the background tab stays open, and I start getting more and more icon added for each book it finds metadata for.

I can click them and select close, and the will go away.

This is probably a recent change in the last couple weeks, but I only noticed in in the last few days, (my computer was down for about 10 days.)
So I guess something on the site changed.

Thanks for reporting this! I’ve just released v1.4.0 which should address the issue.

Romance.io appears to have changed how it handles automated requests, which caused the plugin to fall back to using Chrome more often instead of the higher-priority methods that don't need a browser. Chrome windows should close automatically - having them accumulate is definitely not intentional!

The update adds a new method of downloading book details without opening Chrome first, and improves browser window cleanup when we do still have to fall back to a browser. Please update the plugin, restart Calibre, and let me know if you still see windows staying open afterward!

[JohnnyBook]

That did fix it, no Chrome pop-up on my task bar.

BUT, the description I got back, had lost all the text formatting that was in the description section on book's page on Romance.io and was just one long run on sentence.

Checking, I see the description for the books on the Author's All Book list is run on sentences, but the individual book's page is correctly formatted.

[JSWolf]

Originally Posted by DNSB

When I was looking at the romance.io images URLs, those small images are in the /large/ and in /small/ are the slightly larger than the average thumbnail images. So unless there is another directory I couldn't find, what we see is what we get.


https://s3.amazonaws.com/romance.io/books/large/5455786f87eac3369a912a3f.jpg

https://s3.amazonaws.com/romance.io/...369a912a3f.jpg

This is odd. I have a copy of Tinker added to calibre sometime in 2020 and the cover is a different.

[DNSB]

Originally Posted by JSWolf

This is odd. I have a copy of Tinker added to calibre sometime in 2020 and the cover is a different.

The cover image I choose was the one used by Baen on my original hardcover edition. There are several others. The other one that downloaded for me in calibre, I personally did not like since the image of Tinker did not come close to matching my visualization of her.

[JSWolf]

Originally Posted by DNSB

The cover image I choose was the one used by Baen on my original hardcover edition. There are several others. The other one that downloaded for me in calibre, I personally did not like since the image of Tinker did not come close to matching my visualization of her.

I had AI make a new cover and I rather like it.