[GUI Plugin] Ask Grok

[cgrapski]

Call 911! Seriously though - was excited to see this plug-in. Installed it and got the message of needing an API. Thought I would explore more - clicked the button to see if it would give me a hint where to get it (of course I came here - after this - because I was just trying a guess) ... but the window for the API entry has opened and stays in the upper left hand side of Calibre - without the close button showing - and I can't get rid of it!

[sheldonrrr]

Originally Posted by cgrapski

Call 911! Seriously though - was excited to see this plug-in. Installed it and got the message of needing an API. Thought I would explore more - clicked the button to see if it would give me a hint where to get it (of course I came here - after this - because I was just trying a guess) ... but the window for the API entry has opened and stays in the upper left hand side of Calibre - without the close button showing - and I can't get rid of it!

Looks like there is big error when user input no API Key. I will fix this bug.

You just need force-exit calibre, and input the API Key in Ask Grok(Plug-Menu-Configuration), and click the Save button.

v.1.2.3 will fix this crash bug. This bug won't hurt your calibre app.

[sheldonrrr]

Originally Posted by cgrapski

Call 911! Seriously though - was excited to see this plug-in. Installed it and got the message of needing an API. Thought I would explore more - clicked the button to see if it would give me a hint where to get it (of course I came here - after this - because I was just trying a guess) ... but the window for the API entry has opened and stays in the upper left hand side of Calibre - without the close button showing - and I can't get rid of it!

Bug fixed, and plz update the newest version v1.2.3.

[sheldonrrr]

Hey Guys, many people may not want to directly purchase APIs for different services before using this plugin. I've discovered a free and reliable channel for obtaining free API keys (probably a marketing promotion for Nvidia Build). I've written down the detailed steps here: https://www.reddit.com/r/AskGrokPlug...k_grok_plugin/
If you're interested, feel free to follow the steps and test the results.

Disclaimer: I have no vested interest in Nvidia Build.

[Comfy.n]

Today I finally tested your plugin, using a local model, and it worked great:

[sheldonrrr]

Originally Posted by Comfy.n

Today I finally tested your plugin, using a local model, and it worked great:

Thanks, through recent other users’ feedback, online AI model is better than local LLM, especially the model which can switch export mode support RAG or Web search feature.

But local LLM is great for privacy.

So far, Nvidia Build’s free API Key is good for me. But the online model like Grok is great.

[sheldonrrr]

For better experience, you can try embedding model in local LLM. That will be better.

[vyau]

Hello:

I am running into a problem.
I have the latest Calibre on Linux
I am using Ollama with Qwen2.5 models.

On any PDF books, when I ask any kind of question, I would get a read timed out error (60).
I am guessing 60 is 60 seconds.

Is there anyway I can increase this timeout? I believe this maybe an http timeout error.
I am on a CPU only laptop, no Nvidia.

thanks

[sheldonrrr]

Originally Posted by vyau

Hello:

I am running into a problem.
I have the latest Calibre on Linux
I am using Ollama with Qwen2.5 models.

On any PDF books, when I ask any kind of question, I would get a read timed out error (60).
I am guessing 60 is 60 seconds.

Is there anyway I can increase this timeout? I believe this maybe an http timeout error.
I am on a CPU only laptop, no Nvidia.

thanks

Hey vyan,

This message indicates that your request exceeded the 60-second generation time and was aborted.

I tested two small models locally on a Mac mini M2 machine: qwen2.5:latest (you must specify qwen2.5 on the configuration page to run successfully) and qwen2.5:0.5b. There were no issues.

I recommend testing with a smaller model first. It's possible that the generation time is too long due to a mismatch between your machine and the model size.

I will fix this issue and try to increase the maximum request time. Thank you for your valuable feedback!

---

Latest update:

The Max Request Time feature has been added in the latest plugin update. If you want to try it before most users, you can download it at this URL:
https://www.mobileread.com/forums/sh...77#post4547077

[vyau]

Originally Posted by sheldonrrr

Hey vyan,

This message indicates that your request exceeded the 60-second generation time and was aborted.

I tested two small models locally on a Mac mini M2 machine: qwen2.5:latest (you must specify qwen2.5 on the configuration page to run successfully) and qwen2.5:0.5b. There were no issues.

I recommend testing with a smaller model first. It's possible that the generation time is too long due to a mismatch between your machine and the model size.

I will fix this issue and try to increase the maximum request time. Thank you for your valuable feedback!

Hey Sheldon: Thanks for your reply.
I will try your "small model" advice. Also, can you make this "max request time" a configurable item? I could imagine different hardware prowess may warrant a different value.
Just my $0.0.1

[vyau]

I have another question.

Most of the time, when I tried asking a question about a document, Ask Grok would come back telling me that "it does not have access to the document". That is not true since I can open the document inside Calibre. These are mostly PDFs. Why am I getting this "do not have access" message?

[sheldonrrr]

Originally Posted by vyau

I have another question.

Most of the time, when I tried asking a question about a document, Ask Grok would come back telling me that "it does not have access to the document". That is not true since I can open the document inside Calibre. These are mostly PDFs. Why am I getting this "do not have access" message?

Hey vyau,

Ask Grok Plugin only works after you selected a book in calibre library, now this plugin is only works in library not in viewer.

So if you didn't selected any books and you clicked Ask Grok button, the message will appear. I think this message still has its problem and will polished it later.

Recently I will update this Plugin, now it is in last polishing progress.

Max Request Time feature(what you mentioned) is done now. Thanks for your asking, it works for me!

If a new version is uploaded and plugin was updated, and I will let you know.

[sheldonrrr]

Originally Posted by Comfy.n

Today I finally tested your plugin, using a local model, and it worked great:

Now I am facing a issue to deal with plugin name's changing.

I want to change this plugin `Ask Grok` into another name like `Ask AI Plugin`, you know in early dev progress, there is only Grok AI in it, so what I thought is simple, finished it firstly and then we will see what happened later.

Now more AI are and will be supported, `Ask Grok` even will mislead users. So I changed it's name.

But when I tested in local. What I found confused myself. Now seems like I have only 1 choice.

1. Start a new thread named `Ask AI Plugin`
2. Upload new package file into the new thread.
3. Updated a new `Ask Grok` and say something in About page, like `You need to install New version in Ask AI Plugin` balabala. But certainly it will give users a lot of confusing, like why I need to reinstall a newly plugin?

If I do not, just upload a new version with name(Ask AI Plugin), and if users download and update, old plugin's name will remain in Menu Bar, and New version will not appear, because the index name will appear in Actions List firstly, they need to set it into Menu Tools by themself.

So my question is:
What should I do?

Is this possible?

1. Update a new version package named a new name;
2.0 And you help me change this post thread's name into a new name.
2.1 After you changed this name, Index will get a new name and push this new version to old users.
3. After user update this plugin, and they will found the new name plugin in their calibre's Menu Tool's menu.

Hope to see your guidance. Thanks a lot.

And this new version is great for me, I want to shared to people earilier.

[DNSB]

You may want to check the DeACSM/ACSM plugin thread for some of the issues when the plugin name was changed.

[sheldonrrr]

Originally Posted by DNSB

You may want to check the DeACSM/ACSM plugin thread for some of the issues when the plugin name was changed.

Thanks a lot, this is what I want to find.