Yep, that would be a crude workaround.
Is that a tacit admission that the server merge stage is poorly designed?
Search found 210 matches
- Tue Mar 17, 2009 4:56 am
- Forum: General
- Topic: Input to Merge Stage
- Replies: 3
- Views: 1231
- Tue Mar 17, 2009 4:54 am
- Forum: General
- Topic: Best practice for handling a large variable list
- Replies: 5
- Views: 2464
Thanks for the reply. I should have explained the problem better. My sequential file is something like: Key1 Key2 Var1 Var2 Key3 Var3 Var4 Var5 ... VarN VarX I want to create the output: Key1 Key2 Key3 Var1:@VM:Var2:@VM:Var3:@VM:...@VM:VarN In other words, I want to copy the key variables, then conc...
- Tue Mar 17, 2009 1:37 am
- Forum: General
- Topic: Best practice for handling a large variable list
- Replies: 5
- Views: 2464
Best practice for handling a large variable list
Say I have a file or table: Column1 Column2 Column3 ... Column100 with no real structure to the column names (Column1 etc is just for illustration) I want to concatenate the values of all these columns together separated by @VM. Right now I: * create stage variables V1 - V100 (real names, keep them ...
- Tue Mar 17, 2009 12:34 am
- Forum: General
- Topic: Input to Merge Stage
- Replies: 3
- Views: 1231
Input to Merge Stage
If I have a job that does: Seq_1 --> xfm --> Seq_1_New Seq_2 --> xfm --> Seq_2_New and I then want to merge Seq_1_New and Seq_2_New, how do I ensure that the Merge stage waits until the files are written? I tried a "naked" merge stage with no input streams, but it was executing synchronous...
- Tue Mar 17, 2009 12:27 am
- Forum: General
- Topic: Can the Row Merger stage concatenate a subset of the columns
- Replies: 6
- Views: 3525
Can the Row Merger stage concatenate a subset of the columns
If my input file has: Key1 Key2 Var1 Var2 Key3 Var4 Var5 ... VarN I want the output of the Row Merger stage to be: Key1 Key2 Key3 Var4 ... VarN In other words, I want to output my Key fields (properly delimited), then a merged column with a subset of my input columns. I know the help says "It m...
- Mon Mar 16, 2009 8:41 pm
- Forum: General
- Topic: Can I write to /dev/null on a reject link?
- Replies: 7
- Views: 4526
- Mon Mar 16, 2009 8:32 pm
- Forum: General
- Topic: Can I write to /dev/null on a reject link?
- Replies: 7
- Views: 4526
Can I write to /dev/null on a reject link?
I created a test job: Seq_1 --> xfm --> Seq_2 Seq_1: Uses filters /dev/null echo "AAA" xfm: Straight pipe to Seq_2 Seq_2: Output file /dev/null This compiled and ran fine. I then added a reject link writing to Seq_3, where the output file is /dev/null. This job compiled OK but experienced ...
- Mon Mar 16, 2009 12:57 am
- Forum: General
- Topic: Performance differences between the DRS and native stages
- Replies: 7
- Views: 2521
http://www.acronyms.ch/
http://www.acronyms.ch/searchResults;js ... hText=pita
Perhaps http://www.acronyms.ch/ can be added to the FAQ, which of course everyone reads before ever posting.
Yes, pita is a homonym for the acronymn p.i.t.a.
http://www.acronyms.ch/searchResults;js ... hText=pita
Perhaps http://www.acronyms.ch/ can be added to the FAQ, which of course everyone reads before ever posting.
Yes, pita is a homonym for the acronymn p.i.t.a.
- Mon Mar 16, 2009 12:49 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Debug - Aborting for one user but not another
- Replies: 9
- Views: 3626
- Sun Mar 15, 2009 11:05 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Ensuring hashed file is created when the job executes
- Replies: 11
- Views: 5379
- Sun Mar 15, 2009 11:03 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Ensuring hashed file is created when the job executes
- Replies: 11
- Views: 5379
If you don't wish to unconditionally refresh the hashed file, you can replace your DRS (2) with a transformer stage having a stage variable and an output constraint of @FALSE. That will create the hashed file if it does not exist. Mike Thanks Mike, slick trick. The hashed file never gets updated si...
- Sun Mar 15, 2009 10:58 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Debug - Aborting for one user but not another
- Replies: 9
- Views: 3626
- Sun Mar 15, 2009 7:10 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Using CRC32() to detect changed data in SCD2 implementation
- Replies: 9
- Views: 8792
- Sun Mar 15, 2009 4:49 pm
- Forum: General
- Topic: Performance differences between the DRS and native stages
- Replies: 7
- Views: 2521
Thanks Craig. And my apologies for not doing a better job of searching before posting. I'm trying to develop my own best practice for which stage to use when connecting to a database. To summarize your reply and the thread you linked to, I intend to: * Use the DRS stage most of the time. There shoul...
- Sun Mar 15, 2009 4:34 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Using CRC32() to detect changed data in SCD2 implementation
- Replies: 9
- Views: 8792
Thanks for pointing me to Kim Duke's website. I gotta say after further review I'm not too impressed with the http://etl-tools.info/en/datastage-tutorial-L008_scd-implementation-datastage.htm tutorial. I think it also has the source and lookup tables reversed. If my source (new data, sequential file...