Search found 3 matches

by stewarthanna
Fri Jun 10, 2011 11:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hadoop - Jaql - Pig [Big Insights]
Replies: 5
Views: 3499

Oh I've been around for a while.....but only so many hours in the day to multi-task.
by stewarthanna
Fri Jun 10, 2011 11:30 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hadoop - Jaql - Pig [Big Insights]
Replies: 5
Views: 3499

Sounds on par with my assumptions. I was told it was integrated but no surprise that it isn't. It sounds like an interesting concept but to me it's just more languages to learn.... Maybe I will hear about it at IOD :twisted: Big Data in short is a new kind of data problem (and opportunity) not some...
by stewarthanna
Mon Mar 09, 2009 8:21 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Help DataStage in a public ETL benchmark test
Replies: 9
Views: 10423

They should change to lookup. Use Configuration files that match the volume, scaling from 1node to 2, 3, 4....using a larger config file will only incur startup time when processing small volumes Remove unnecessary partitioning and sorting, lookup does not require it Add -readers to Sequential File ...