Search found 9 matches

by longma98
Thu Feb 04, 2016 8:24 am
Forum: IBM QualityStage
Topic: Data duplicate result set from 2 source matching
Replies: 3
Views: 5656

All 7 outputs are selected and linked to datasets
by longma98
Mon Feb 01, 2016 10:41 pm
Forum: IBM QualityStage
Topic: Data duplicate result set from 2 source matching
Replies: 3
Views: 5656

Data duplicate result set from 2 source matching

Hi all, I am trying to work out an example of 2 source matching (multiple-to-one multiple). In the source data set i have created 2 rows with exactly the same values for all columns. I have also created 2 matching rows in the reference data set. After the job is run, both rows in the source data set...
by longma98
Thu Apr 30, 2015 8:12 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parallel job reports failure (code 13)
Replies: 1
Views: 2044

Parallel job reports failure (code 13)

HI all, Got an error message "Parallel job reports failure (code 13)" in a production job. Never seen it before in lower environment. The server version is 8.5. I did a search couldn't find what code 13 means. Does any one know? There are no other error messages. The data source is Sybase ...
by longma98
Mon Feb 09, 2015 12:10 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Set maximum heap size for xml stage
Replies: 0
Views: 2183

Set maximum heap size for xml stage

We have to run a job with xml stage with pretty large input file size. The job works in production environment. Once we get it into dev project it fails. We suspect we need to increase the memory heap size in xml stage because that is one of the differences we see. However inside the xml stage, it d...
by longma98
Tue Mar 17, 2009 9:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Performance concern for SCD stage for very large dimension
Replies: 3
Views: 2745

Hi, Search the forum for CDC topics. That should give you more information on how to handle SCDs as well as to generate SKs. HTH --Rich I don't have a problem using CDC or SK. My question is that if the new SDC stage is rigorous enough for us to throw some heavy stuff at it. The new SCD stage centa...
by longma98
Thu Mar 12, 2009 12:02 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Performance concern for SCD stage for very large dimension
Replies: 3
Views: 2745

Performance concern for SCD stage for very large dimension

Our company is getting version 8 very soon, and is considering implement type 2 SCD using SCD stage. I have read SCD stage use in-memory lookup. If we have a monster-type SCD type 2, (I have talking about potentially hundreds of millions rows with at least dozens of type-2 columns), is SCD stage sti...
by longma98
Fri Jul 09, 2004 9:41 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: merging multiple line as one record -- Seq data file
Replies: 3
Views: 3136

You can try to preprocess it if it is a unix flat file using sed. Here is one I stole and modified. Save it in a file and do: sed -f mySedFile input.dat > output.dat Basicly, it searches and loops for lines that are not ended with "}" + possible trailing spaces, and removes the "\n&qu...
by longma98
Thu Sep 11, 2003 3:55 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Link Order in transform stage
Replies: 1
Views: 3379

Link Order in transform stage

I need to do an update (conditional) and insert (unconditional) in order. I have 2 output links from a transformation stage, and specified the link order in the tranformation stage with update link before the insert link. However, it seems the ordering is not strictly enforced in PE. Sometimes the u...
by longma98
Mon Sep 08, 2003 9:07 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Question on partition method for lookup or Join stage
Replies: 2
Views: 4538

Question on partition method for lookup or Join stage

I have question on what to set for partition method for lookup or join stage. If the main source is partitioned DB2 source, and I need to do lookups and join using separate stages, what partition method should I be using on the lookup/join stage? DB2, Auto, or Full? The reason I am asking is that af...