How convert websites with links?

ganymede · 11-13-2009, 02:57 AM

Does anybody know how to convert websites with links with Calibre (just like iSilo or Plucker)?

Thanks!
Gany

mrmikel · 11-13-2009, 06:19 AM

If you want to convert a web site with links to an ebook, you can use WinHHTrack web site copier to put a copy on your computer. In that way all the links will be internal.

Then you can edit them with sigil or an HTML editor, clean it up and get rid of external links.

You can specify which types of files to copy and which branches of the web site not to copy, like a return to Center for Military History link at the bottom of each page. This is important as otherwise it can copy an entire website will all its links, which will clog your drive, take forever and make you unpopular with the web site owner as your rooting around drains resources. Along that line, do not set it up for a large number of simultaneous downloads as it would have some characteristics of a Denial of Service attack!

You can save the file out of sigil as an epub, or you can point to the table of contents in calibre and save it as an epub.

LRFs work best as one file in my experience, so you can use a program like Merger to join them all together in order, but will have to recreate the various links. It is a lot of work, which I now tend not to do if the site if many files despite the very glaring shortcomings of epub in the Sony at this current stage of development.

kovidgoyal · 11-13-2009, 10:44 AM

calibre comes witha web2disk command that will download a website following as many levels of links as you specify. You can then convert the downloaded html as normal.

ganymede · 11-13-2009, 01:45 PM

Quote:

Originally Posted by kovidgoyal

calibre comes witha web2disk command that will download a website following as many levels of links as you specify. You can then convert the downloaded html as normal.

When I start it I get the following error:

Traceback (most recent call last):
File "/usr/bin/web2disk", line 15, in <module>
loader = open(loader_path, 'w')
IOError: [Errno 13] Permission denied: '/Applications/Mobil/calibre.app/Contents/Resources/loaders/web2disk.py'

11-13-2009, 02:57 AM	#1
ganymede Connoisseur Posts: 57 Karma: 10 Join Date: Nov 2009 Device: Kindle 3	How convert websites with links? Does anybody know how to convert websites with links with Calibre (just like iSilo or Plucker)? Thanks! Gany

11-13-2009, 06:19 AM	#2
mrmikel Color me gone Posts: 2,089 Karma: 1445295 Join Date: Apr 2008 Location: Central Oregon Coast Device: PRS-300	web sites with links If you want to convert a web site with links to an ebook, you can use WinHHTrack web site copier to put a copy on your computer. In that way all the links will be internal. Then you can edit them with sigil or an HTML editor, clean it up and get rid of external links. You can specify which types of files to copy and which branches of the web site not to copy, like a return to Center for Military History link at the bottom of each page. This is important as otherwise it can copy an entire website will all its links, which will clog your drive, take forever and make you unpopular with the web site owner as your rooting around drains resources. Along that line, do not set it up for a large number of simultaneous downloads as it would have some characteristics of a Denial of Service attack! You can save the file out of sigil as an epub, or you can point to the table of contents in calibre and save it as an epub. LRFs work best as one file in my experience, so you can use a program like Merger to join them all together in order, but will have to recreate the various links. It is a lot of work, which I now tend not to do if the site if many files despite the very glaring shortcomings of epub in the Sony at this current stage of development.

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Download websites with links like iSiloX	baboyak	Calibre	2	08-12-2010 11:45 AM
E-book websites ?	ghazali	Sony Reader	8	05-25-2009 06:42 AM
iliad for websites	e-enker	iRex	15	08-17-2008 09:26 PM
Convert offline websites into a single pdf?	magogo	Sony Reader	7	05-12-2007 12:05 PM

11-13-2009, 10:44 AM	#3
kovidgoyal creator of calibre Posts: 43,826 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	calibre comes witha web2disk command that will download a website following as many levels of links as you specify. You can then convert the downloaded html as normal.

Advert