Splicing parts of webpages

emceephd · 03-06-2003, 12:46 PM

I was wondering if there was an elegant (program available) or other (more challenging) way to splice a webpage for viewing in iSilo. I have a favorite news website that includes lots of nice content but do not want to download the whole front page (e.g. ads, subscriber links). I read the source code and saw that there are comments that begin and the content I want.

Any ideas?

Alexander Turcic · 03-06-2003, 12:56 PM

Hmm this is my personal most wanted feature for a future version of iSiloX. To define what parts of a web page to download through Regular Expressions for instance. Currently there is no direct way of doing this. You can use some other tool like Sitescooper which does exactly this, prepares the web page content for you and runs it through the console version of iSiloX at the end.

gvtexas · 03-06-2003, 01:47 PM

Quote:

Originally posted by emceephd@Mar 6 2003, 11:46 AM
I was wondering if there was an elegant (program available) or other (more challenging) way to splice a webpage for viewing in iSilo.

You can do this cleanly with HandStory's scripting language. It works by identifying points in the page code to start and stop. But I haven't mastered it yet to the point where I can reliably apply it to a page, nor has anyone else that I've seen comment about the script language. But it is possible, and it does work by grabbing only the sections of the page you want.

Alexander Turcic · 03-06-2003, 02:03 PM

Had a longer icq chat with emceephd and we solved the "problem". Wrote him a quick perl script that does its job using RegEx.

Tell me guys if you want me to attach it here... for you to see how it works.

Alexander Turcic · 03-06-2003, 03:30 PM

Ok I attached it. Must be installed as a perl script.

If you have interest, we can start a little thread on how to do regex and write scripts such as this one.

Only if you are interested....

Cheers!

PS: You must save the file and rename it to weekly.cgi before using it.

emceephd · 03-07-2003, 10:07 AM

A thread would be a great idea. We're all pretty lucky that Alexander is providing this site. Thanks so much!

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Not getting parts in the right order	pedz	Calibre	3	04-09-2010 08:31 AM
DR1000 for parts	DSAzevedo	iRex	0	03-30-2010 02:12 PM
New to these parts...	stacynak	Introduce Yourself	2	02-27-2009 02:03 PM
how to do, webpages to?¿	whopper	Workshop	0	11-24-2008 07:31 PM
Webpages to Mobi?	flashman	Alternative Devices	0	07-29-2007 04:36 PM

03-06-2003, 12:46 PM	#1
emceephd Member Posts: 11 Karma: 30 Join Date: Nov 2002 Location: Maryland	I was wondering if there was an elegant (program available) or other (more challenging) way to splice a webpage for viewing in iSilo. I have a favorite news website that includes lots of nice content but do not want to download the whole front page (e.g. ads, subscriber links). I read the source code and saw that there are comments that begin and the content I want. Any ideas?

03-06-2003, 12:56 PM	#2
Alexander Turcic Fully Converged Posts: 18,163 Karma: 14021202 Join Date: Oct 2002 Location: Switzerland Device: Too many to count here.	Hmm this is my personal most wanted feature for a future version of iSiloX. To define what parts of a web page to download through Regular Expressions for instance. Currently there is no direct way of doing this. You can use some other tool like Sitescooper which does exactly this, prepares the web page content for you and runs it through the console version of iSiloX at the end.

03-06-2003, 02:03 PM	#4
Alexander Turcic Fully Converged Posts: 18,163 Karma: 14021202 Join Date: Oct 2002 Location: Switzerland Device: Too many to count here.	Had a longer icq chat with emceephd and we solved the "problem". Wrote him a quick perl script that does its job using RegEx. Tell me guys if you want me to attach it here... for you to see how it works.

03-07-2003, 10:07 AM	#6
emceephd Member Posts: 11 Karma: 30 Join Date: Nov 2002 Location: Maryland	A thread would be a great idea. We're all pretty lucky that Alexander is providing this site. Thanks so much!