How to bulk convert documents from a website

nikev · 06-14-2019, 12:28 AM

Hello,

I am not sure if this is the right place to post this question, but it seems close enough.

I would like to download and convert the free books and stories that are located at https://madameulalie.org so that I have them for offline reading.

For instance, I would like to scrape every story listed on the page

https://madameulalie.org/captain/CaptainMenu.html

and convert them to EPUB/KEPUB for off-line reading.

Is there a convenient way to do this in Calibre? For instance, some "recipe" that I can modify?

Thanks in advance for the help.

Nike

kovidgoyal · 06-14-2019, 12:45 AM

There is no pre-built solution, you would basically need to write a recipe that scrapes the pages and returns a list of articles. Then when yo urun the recipe calibre will convert that list f articles into a book for you automaticlly.

lumpynose · 06-14-2019, 03:49 AM

It would be a great contribution to the community if it were carefully done by hand; for example, see some of the books here done by GrannyGrump. If you're interested in learning how, let me know.

nikev · 06-14-2019, 11:28 AM

Thanks! I am happy to try, but I don't know anything about coding.

One immediate problem is that there's no RSS feed on the site -- it's just static HTML. The Calibre recipe editor won't accept it, at least not in automatic mode.

I would definitely be interested in learning how to do this, and I agree that it would be great for the community. Please send me a DM to figure out how to proceed, if you are not averse to working with a newbie (albeit one who learns quickly).

kovidgoyal · 06-14-2019, 11:34 AM

Sorry I dont have time to work with you, but maybe someone else does. You wil lneed ot code to get data from sites without RSS feeds.

06-14-2019, 12:28 AM	#1
nikev Connoisseur Posts: 53 Karma: 10 Join Date: Sep 2009 Device: PRS 505	How to bulk convert documents from a website Hello, I am not sure if this is the right place to post this question, but it seems close enough. I would like to download and convert the free books and stories that are located at https://madameulalie.org so that I have them for offline reading. For instance, I would like to scrape every story listed on the page https://madameulalie.org/captain/CaptainMenu.html and convert them to EPUB/KEPUB for off-line reading. Is there a convenient way to do this in Calibre? For instance, some "recipe" that I can modify? Thanks in advance for the help. Nike

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Bulk convert Word to Mobi?	Storm27	Workshop	10	08-24-2013 11:26 AM
Need Help, Bulk Convert	pcworkman10000	Conversion	1	06-07-2011 05:34 AM
Bulk Convert From	atjnjk	Conversion	5	02-08-2011 05:59 AM
Bulk Convert	atjnjk	Calibre	2	11-03-2010 09:58 AM
Bulk Convert error	seajewel	Calibre	1	08-06-2008 05:13 PM

06-14-2019, 12:45 AM	#2
kovidgoyal creator of calibre Posts: 45,347 Karma: 27182818 Join Date: Oct 2006 Location: Mumbai, India Device: Various	There is no pre-built solution, you would basically need to write a recipe that scrapes the pages and returns a list of articles. Then when yo urun the recipe calibre will convert that list f articles into a book for you automaticlly.

06-14-2019, 03:49 AM	#3
lumpynose Wizard Posts: 1,086 Karma: 6719822 Join Date: Jul 2012 Device: Palm Pilot M105	It would be a great contribution to the community if it were carefully done by hand; for example, see some of the books here done by GrannyGrump. If you're interested in learning how, let me know.

06-14-2019, 11:28 AM	#4
nikev Connoisseur Posts: 53 Karma: 10 Join Date: Sep 2009 Device: PRS 505	Thanks! I am happy to try, but I don't know anything about coding. One immediate problem is that there's no RSS feed on the site -- it's just static HTML. The Calibre recipe editor won't accept it, at least not in automatic mode. I would definitely be interested in learning how to do this, and I agree that it would be great for the community. Please send me a DM to figure out how to proceed, if you are not averse to working with a newbie (albeit one who learns quickly).

06-14-2019, 11:34 AM	#5
kovidgoyal creator of calibre Posts: 45,347 Karma: 27182818 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Sorry I dont have time to work with you, but maybe someone else does. You wil lneed ot code to get data from sites without RSS feeds.

Advert

Advert