Search found 239 matches

by devidotcom
Sat May 24, 2008 5:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Read a webpage data
Replies: 3
Views: 1135

Read a webpage data

Hi All, I have a scenerio not sure if it is possible with DataStage. I have a webpage URL address which contains records that I need to read and process. Is there a way we can read these records. I read about external source stage but not sure if it works with this. The webpage would have that looks...
by devidotcom
Tue May 20, 2008 3:24 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup Clarification
Replies: 5
Views: 1640

You get this warning when your reference links have multiple matching records with input records. So DataStage randomly choose one of them and get the lookup value.

You can ignore this for only one of the reference links with an option on the condition tab of the lookup stage.

Devi
by devidotcom
Wed May 14, 2008 5:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Compress datasets
Replies: 6
Views: 1663

Why is that ArndW? Why not store the compressed file in a dataset?
by devidotcom
Tue May 13, 2008 11:30 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: A quick verification for Sort stage
Replies: 5
Views: 4847

Thank you Ray for you reply.
Will close this post.
by devidotcom
Tue May 13, 2008 11:28 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Compress datasets
Replies: 6
Views: 1663

Thank you ArndW for your reply.

Sure will take your inputs. But our dataset has just 8 columns but the number of records is huge. Hence I may have to compress the dataset along with the sequential files.
by devidotcom
Tue May 13, 2008 9:40 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Compress datasets
Replies: 6
Views: 1663

Whenever we use a compress stage on the output tab wherein we need to mention the column name and the datatype. I am not sure what we need to define. Is there a way we calculate and then define some columns based on the number of columns input to the compress stage.

Thanks
Devi
by devidotcom
Tue May 13, 2008 8:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Compress datasets
Replies: 6
Views: 1663

Compress datasets

Hi All, We create a huge dataset close to 25GB in size which is later used for processing. We have along with these many small datasets and flat files created. The size estimated is really huge as the source file sizes are close to 100GB too. We are looking at compressing the huge dataset which is c...
by devidotcom
Mon May 12, 2008 2:07 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: A quick verification for Sort stage
Replies: 5
Views: 4847

Any help!! wonder anyone saw this post...
by devidotcom
Fri May 09, 2008 5:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading the Copy Book in the Complex Flat File stage
Replies: 6
Views: 4504

Sure...

For every column in the CFF stage in the properties options we have Nullable option. Add appropriate value for a field. For eg. If the column is Integer (5) then add 5 zeros

Devi
by devidotcom
Fri May 09, 2008 3:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading the Copy Book in the Complex Flat File stage
Replies: 6
Views: 4504

Is it a fixed width or variable record file?

What are the settings on File Options tab.
Make sure you have selected the correct option there for the record type.

Also check for record options tab.

Devi
by devidotcom
Fri May 09, 2008 3:16 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading the Copy Book in the Complex Flat File stage
Replies: 6
Views: 4504

Make sure you have flatten all the arrays when you load the metadata. If not do this. Also try reading this copybook using a sequential file stage if it does not contain words like Occurs, redefines, defines... etc. The error you obtained is because the record length is not matching with the metadat...
by devidotcom
Wed May 07, 2008 10:00 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sequential file viewing problem
Replies: 6
Views: 5317

Is this a fixed width file or a delimited file?
by devidotcom
Wed May 07, 2008 9:59 pm
Forum: General
Topic: problem of join stage
Replies: 5
Views: 2653

Why don't you seat calmly and check what kind of join types you have applied.

The Operator logic error appears when the code has some faults.... I mean coded wrongly.

I understand as the job is complex its a pain but thats the solution.