Data from Webpages To Datastage

hhh · Post by **hhh** » Thu Mar 09, 2006 4:52 am

Hello,

In my application i want to read the data from web pages .

Webpages inclue jpeg,text etc data but i need to extract only text data from the webpages so extracted data, i can pass through datastage.

could you people share your exeperience on this issue.

Thanks
HH

ArndW · Post by **ArndW** » Fri Mar 10, 2006 6:07 am

Where are your webpages being read from? Normally the pages will contain only HTML text and reference other non-text data. There is a Click Pack to help you work with the log files, but it doesn't help with the actual pages.

You can strip out unprintable text (using the ;'MCP' conversion) to clean out binary data from a text stream, but in DataStage you would still need to parse the data into useable information.

ray.wurlod · Post by **ray.wurlod** » Fri Mar 10, 2006 6:27 am

If you have direct access to the web pages you can "View Source" and use DataStage to parse that HTML.