Bookit plugin for Firefox - Page 6

beowulf573 · 06-08-2008, 10:34 AM

If you use the "Create" menu item from the context menu, or "Bookit with Options" toolbar button it will first bring up the options dialog that lets you change settings for that run only. I'm thinking of moving the meta-data tab to the front since I get the feeling that would be used the most.

As for turning & into & - can you give me a little context? Is this in the title or the body of the document? An example would be helpful.

As for changing the proxy, that's something that should be possibly but it's not a trivial fix. I'm not sure if I can determine the current proxy from inside the plugin. I imagine that it's possible, I just don't know how to do it off the top of my head.

Also there doesn't appear to be a way to pass proxy information to web2lrf but if there is or Kovid adds support then I can try to take advantage of it.

kovidgoyal · 06-08-2008, 04:14 PM

calibre reads proxy information from the http_proxy environment variable

beowulf573 · 06-08-2008, 06:00 PM

Ah, then if I can figure it from with in the extension I can set that environment variable before calling web2lrf. I'll look it into. Does it works with SOCKS proxies too or just http proxies?

kovidgoyal · 06-08-2008, 06:32 PM

i've only tried it with http proxies (but basically it uses pythons urllib2, you can checks its docs to see if it supports SOCKS)

=X= · 06-09-2008, 05:53 PM

Quote:

Originally Posted by beowulf573

If you use the "Create" menu item from the context menu, or "Bookit with Options" toolbar button it will first bring up the options dialog that lets you change settings for that run only. I'm thinking of moving the meta-data tab to the front since I get the feeling that would be used the most.

Cool!
As for moving the meta-data tab to the front. Yes that is more practical and I tend to modify that field on every run (also the max recursion/link level)

Quote:

Originally Posted by beowulf573

As for turning & into & - can you give me a little context? Is this in the title or the body of the document? An example would be helpful.

I've attached the created LRF.

Something very interesting. I noticed this '&' on my PRS-505. However when I double checked the LRF file with lrfview the viewer shows '&' correctly. The SONY eReader software does show the & so if you don't want to download the LRF to your reader make sure you use the SONY software.

=X=

beowulf573 · 06-09-2008, 06:36 PM

I can recreate the & issue with just launching web2lrf (0.4.67), so perhaps Kovid can help.

beowulf573 · 06-09-2008, 06:49 PM

I put up a quick update, 0.3.5, that includes support for more characters in a filename and moved the meta-data tab.

I'm looking at proxy support and for creating a lrf file from the current selection, but both require a bit of research so it may be a bit before I have something working.

beowulf573 · 06-10-2008, 11:46 PM

I tried posting another version of this earlier but I must have clicked preview instead of post....

So I've been thinking about a couple outstanding issues and have an idea on how to solve them, but it may not fit how most folks are using the plugin and wanted to get a bit of feedback.

Right now I'm passing the current document url to web2lrf. This means all of the proxy settings and ad blocking software is bypassed. What I could do is save the current document to a temporary file and run html2lrf on it. I could try to grab any images to be displayed and update the html to point to the local copy.

This would work well for me, since I usually switch to a printable, single page version of the document if it's available and generate the ebook from there. This won't work so well if folks are generally creating ebooks from multipage sites.

So it's a trade off, better control over the content vs spaning multiple pages. It thought about spidering the page from inside the plugin, but that may be more work than I have time to do right now.

Thoughts?

kovidgoyal · 06-11-2008, 12:21 AM

How does firefox do adblocking? By a list of regexps?

Peto · 06-11-2008, 03:33 AM

Hello Beowulf,

Not understanding the difference between the two procedures, I would like to know the advantage of using this new way. As far as I am concerned, the feature of your plugin I like best is the chance of picking links, so I would miss it, should it go away.

However, you could leave all you have done so far as it is and add this new way as an option for short documents.

Thanks again, both for the effort and for asking.

alexxxm · 06-11-2008, 09:06 AM

Quote:

Originally Posted by kovidgoyal

How does firefox do adblocking? By a list of regexps?

personally I use ADBlockPlus http://adblockplus.org/en/.
When first enabled it allows you to choose between different subsciption lists.
You can moreover add your own rules, using regexps, e.g. /banner\d+\.gif$/.

alessandro

beowulf573 · 06-11-2008, 11:12 AM

The main advantage to saving the current document and working on it is you can take advantage of all the current firefox settings; proxies, ad-blocking, fonts, etc. None of these are passed on to web2lrf. I can also add a 'zap' feature to hide various elements. For example, if there are elements in the document you don't want to appear in the ebook you could right click on it and select 'Hide' and it would be hidden temporarily. A refresh would load the original document back.

This model breaks down if you are using recursion to download the current document and all other say two links away.

Peto · 06-11-2008, 11:58 AM

Mmmmm... sounds good too. Can't you add both options? From my ignorant point of view, having one already implemented and working on the second, adding both should be easy.

=X= · 06-11-2008, 12:43 PM

Quote:

Originally Posted by beowulf573

... So I've been thinking about a couple outstanding issues ... run html2lrf on it.
So it's a trade off, better control over the content vs spaning multiple pages. ...

Thoughts?

Beowulf, will you be saving of HTML off recursively too? That is the nice feature of web2lrf. If you are then I say go for it, taking advantage of Netscape is a good idea.

Comment on the proxy. The proxy information is located in the pref.js for Firefox. I've noticed your Plugin data is stored there too. If there is an API where you can read/write to the pref.js file. Then you should be able to get the proxy info.
You would have to make one check first before setting the proxy to calibe and that is if the proxy is enabled or disabled.

beowulf573 · 06-11-2008, 01:11 PM

Quote:

Originally Posted by Peto

Mmmmm... sounds good too. Can't you add both options? From my ignorant point of view, having one already implemented and working on the second, adding both should be easy.

Yeah, I can, I just didn't know how folks were really using it and if having both methods would be too confusing for the average user.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
New Plugin Type Idea: Library Plugin	cgranade	Plugins	3	09-15-2010 12:11 PM
BookIt and 64 bit	jlbfoot	LRF	0	03-09-2009 03:24 PM
Idea for a "Bookit" Plugin -- Maybe Kovid?	dsuden	Sony Reader	55	01-03-2009 11:22 AM
Great new Idea! Bookit button	=X=	Feedback	0	10-27-2008 01:49 PM
Making MobiRead Threads BookIt Friendly	=X=	Feedback	3	08-11-2008 11:24 PM

06-08-2008, 10:34 AM	#76
beowulf573 Addict Posts: 208 Karma: 1523 Join Date: Jul 2007 Location: Houston,TX Device: PRS-T1	If you use the "Create" menu item from the context menu, or "Bookit with Options" toolbar button it will first bring up the options dialog that lets you change settings for that run only. I'm thinking of moving the meta-data tab to the front since I get the feeling that would be used the most. As for turning & into & - can you give me a little context? Is this in the title or the body of the document? An example would be helpful. As for changing the proxy, that's something that should be possibly but it's not a trivial fix. I'm not sure if I can determine the current proxy from inside the plugin. I imagine that it's possible, I just don't know how to do it off the top of my head. Also there doesn't appear to be a way to pass proxy information to web2lrf but if there is or Kovid adds support then I can try to take advantage of it.

06-08-2008, 04:14 PM	#77
kovidgoyal creator of calibre Posts: 45,364 Karma: 27230406 Join Date: Oct 2006 Location: Mumbai, India Device: Various	calibre reads proxy information from the http_proxy environment variable

06-08-2008, 06:00 PM	#78
beowulf573 Addict Posts: 208 Karma: 1523 Join Date: Jul 2007 Location: Houston,TX Device: PRS-T1	Ah, then if I can figure it from with in the extension I can set that environment variable before calling web2lrf. I'll look it into. Does it works with SOCKS proxies too or just http proxies?

06-08-2008, 06:32 PM	#79
kovidgoyal creator of calibre Posts: 45,364 Karma: 27230406 Join Date: Oct 2006 Location: Mumbai, India Device: Various	i've only tried it with http proxies (but basically it uses pythons urllib2, you can checks its docs to see if it supports SOCKS)

06-09-2008, 06:36 PM	#81
beowulf573 Addict Posts: 208 Karma: 1523 Join Date: Jul 2007 Location: Houston,TX Device: PRS-T1	I can recreate the & issue with just launching web2lrf (0.4.67), so perhaps Kovid can help.

06-09-2008, 06:49 PM	#82
beowulf573 Addict Posts: 208 Karma: 1523 Join Date: Jul 2007 Location: Houston,TX Device: PRS-T1	I put up a quick update, 0.3.5, that includes support for more characters in a filename and moved the meta-data tab. I'm looking at proxy support and for creating a lrf file from the current selection, but both require a bit of research so it may be a bit before I have something working.

06-10-2008, 11:46 PM	#83
beowulf573 Addict Posts: 208 Karma: 1523 Join Date: Jul 2007 Location: Houston,TX Device: PRS-T1	I tried posting another version of this earlier but I must have clicked preview instead of post.... So I've been thinking about a couple outstanding issues and have an idea on how to solve them, but it may not fit how most folks are using the plugin and wanted to get a bit of feedback. Right now I'm passing the current document url to web2lrf. This means all of the proxy settings and ad blocking software is bypassed. What I could do is save the current document to a temporary file and run html2lrf on it. I could try to grab any images to be displayed and update the html to point to the local copy. This would work well for me, since I usually switch to a printable, single page version of the document if it's available and generate the ebook from there. This won't work so well if folks are generally creating ebooks from multipage sites. So it's a trade off, better control over the content vs spaning multiple pages. It thought about spidering the page from inside the plugin, but that may be more work than I have time to do right now. Thoughts?

06-11-2008, 12:21 AM	#84
kovidgoyal creator of calibre Posts: 45,364 Karma: 27230406 Join Date: Oct 2006 Location: Mumbai, India Device: Various	How does firefox do adblocking? By a list of regexps?

06-11-2008, 03:33 AM	#85
Peto Legal Alien Posts: 288 Karma: 105 Join Date: Jan 2008 Device: Sony PRS-505/T1/Kindle PW2	Hello Beowulf, Not understanding the difference between the two procedures, I would like to know the advantage of using this new way. As far as I am concerned, the feature of your plugin I like best is the chance of picking links, so I would miss it, should it go away. However, you could leave all you have done so far as it is and add this new way as an option for short documents. Thanks again, both for the effort and for asking.

06-11-2008, 11:12 AM	#87
beowulf573 Addict Posts: 208 Karma: 1523 Join Date: Jul 2007 Location: Houston,TX Device: PRS-T1	The main advantage to saving the current document and working on it is you can take advantage of all the current firefox settings; proxies, ad-blocking, fonts, etc. None of these are passed on to web2lrf. I can also add a 'zap' feature to hide various elements. For example, if there are elements in the document you don't want to appear in the ebook you could right click on it and select 'Hide' and it would be hidden temporarily. A refresh would load the original document back. This model breaks down if you are using recursion to download the current document and all other say two links away.

06-11-2008, 11:58 AM	#88
Peto Legal Alien Posts: 288 Karma: 105 Join Date: Jan 2008 Device: Sony PRS-505/T1/Kindle PW2	Mmmmm... sounds good too. Can't you add both options? From my ignorant point of view, having one already implemented and working on the second, adding both should be easy.