Search found 210 matches

by sbass1
Tue Mar 17, 2009 4:56 am
Forum: General
Topic: Input to Merge Stage
Replies: 3
Views: 1231

Yep, that would be a crude workaround.

Is that a tacit admission that the server merge stage is poorly designed?
by sbass1
Tue Mar 17, 2009 4:54 am
Forum: General
Topic: Best practice for handling a large variable list
Replies: 5
Views: 2464

Thanks for the reply. I should have explained the problem better. My sequential file is something like: Key1 Key2 Var1 Var2 Key3 Var3 Var4 Var5 ... VarN VarX I want to create the output: Key1 Key2 Key3 Var1:@VM:Var2:@VM:Var3:@VM:...@VM:VarN In other words, I want to copy the key variables, then conc...
by sbass1
Tue Mar 17, 2009 1:37 am
Forum: General
Topic: Best practice for handling a large variable list
Replies: 5
Views: 2464

Best practice for handling a large variable list

Say I have a file or table: Column1 Column2 Column3 ... Column100 with no real structure to the column names (Column1 etc is just for illustration) I want to concatenate the values of all these columns together separated by @VM. Right now I: * create stage variables V1 - V100 (real names, keep them ...
by sbass1
Tue Mar 17, 2009 12:34 am
Forum: General
Topic: Input to Merge Stage
Replies: 3
Views: 1231

Input to Merge Stage

If I have a job that does: Seq_1 --> xfm --> Seq_1_New Seq_2 --> xfm --> Seq_2_New and I then want to merge Seq_1_New and Seq_2_New, how do I ensure that the Merge stage waits until the files are written? I tried a "naked" merge stage with no input streams, but it was executing synchronous...
by sbass1
Tue Mar 17, 2009 12:27 am
Forum: General
Topic: Can the Row Merger stage concatenate a subset of the columns
Replies: 6
Views: 3525

Can the Row Merger stage concatenate a subset of the columns

If my input file has: Key1 Key2 Var1 Var2 Key3 Var4 Var5 ... VarN I want the output of the Row Merger stage to be: Key1 Key2 Key3 Var4 ... VarN In other words, I want to output my Key fields (properly delimited), then a merged column with a subset of my input columns. I know the help says "It m...
by sbass1
Mon Mar 16, 2009 8:41 pm
Forum: General
Topic: Can I write to /dev/null on a reject link?
Replies: 7
Views: 4526

Oops, I had the reject link set to overwrite file. When I changed it to append (like the target file), it worked.

Would still be interested in answers to the other questions...
by sbass1
Mon Mar 16, 2009 8:32 pm
Forum: General
Topic: Can I write to /dev/null on a reject link?
Replies: 7
Views: 4526

Can I write to /dev/null on a reject link?

I created a test job: Seq_1 --> xfm --> Seq_2 Seq_1: Uses filters /dev/null echo "AAA" xfm: Straight pipe to Seq_2 Seq_2: Output file /dev/null This compiled and ran fine. I then added a reject link writing to Seq_3, where the output file is /dev/null. This job compiled OK but experienced ...
by sbass1
Mon Mar 16, 2009 12:57 am
Forum: General
Topic: Performance differences between the DRS and native stages
Replies: 7
Views: 2521

http://www.acronyms.ch/

http://www.acronyms.ch/searchResults;js ... hText=pita

Perhaps http://www.acronyms.ch/ can be added to the FAQ, which of course everyone reads before ever posting.

Yes, pita is a homonym for the acronymn p.i.t.a.
by sbass1
Mon Mar 16, 2009 12:49 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Debug - Aborting for one user but not another
Replies: 9
Views: 3626

Thanks for the Ray. But, as I saw you say in another post, this is a workaround, not a fix.

So, have IBM fixed this bug? Is it still an issue in 8.x?
by sbass1
Sun Mar 15, 2009 11:05 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Ensuring hashed file is created when the job executes
Replies: 11
Views: 5379

Edit/Delete post is only letting me edit, not delete the extra post caused by hitting back in my browser. So sorry for the extra post (this one).
by sbass1
Sun Mar 15, 2009 11:03 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Ensuring hashed file is created when the job executes
Replies: 11
Views: 5379

If you don't wish to unconditionally refresh the hashed file, you can replace your DRS (2) with a transformer stage having a stage variable and an output constraint of @FALSE. That will create the hashed file if it does not exist. Mike Thanks Mike, slick trick. The hashed file never gets updated si...
by sbass1
Sun Mar 15, 2009 10:58 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Debug - Aborting for one user but not another
Replies: 9
Views: 3626

Bump...

Does anyone know if IBM have issued a hotfix for this bug? I run into this issue ALL the time.
by sbass1
Sun Mar 15, 2009 7:10 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Using CRC32() to detect changed data in SCD2 implementation
Replies: 9
Views: 8792

No. The new data MUST be the driver. One useful technique is called "bucket table". In this technique you identify all the keys in source and load these into a table in your database. You can then perform a join of this "bucket table" with the existing dimension table to retriev...
by sbass1
Sun Mar 15, 2009 4:49 pm
Forum: General
Topic: Performance differences between the DRS and native stages
Replies: 7
Views: 2521

Thanks Craig. And my apologies for not doing a better job of searching before posting. I'm trying to develop my own best practice for which stage to use when connecting to a database. To summarize your reply and the thread you linked to, I intend to: * Use the DRS stage most of the time. There shoul...
by sbass1
Sun Mar 15, 2009 4:34 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Using CRC32() to detect changed data in SCD2 implementation
Replies: 9
Views: 8792

Thanks for pointing me to Kim Duke's website. I gotta say after further review I'm not too impressed with the http://etl-tools.info/en/datastage-tutorial-L008_scd-implementation-datastage.htm tutorial. I think it also has the source and lookup tables reversed. If my source (new data, sequential file...