You need to partition by your key column.
Imagine you have this
DataSet
ColA ColB
1 x
2 y
Transformer
ColA ColB
1 y
2 x
If you partition by ColA it is likely that your matching records x=x and y=y will be on separate partitions so will not match.
Search found 215 matches
- Sun May 13, 2007 4:45 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: mismatch in join stage
- Replies: 4
- Views: 2222
- Thu May 10, 2007 11:29 pm
- Forum: General
- Topic: Processing files in a directory
- Replies: 44
- Views: 14939
- Thu May 10, 2007 5:37 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Source Data Truncated
- Replies: 9
- Views: 3653
- Thu May 10, 2007 4:38 pm
- Forum: General
- Topic: Processing files in a directory
- Replies: 44
- Views: 14939
or you could use wildcards if your file names are amenable) Ray, I recently found that I couldn't use wildcards in the filter command. Craig also found the same issue. Do you know that it can be done? Is there some specific syntax to get it to work? Or is it just not working in our versions of DS. ...
- Thu May 10, 2007 4:03 pm
- Forum: General
- Topic: moving master in server to sequencer
- Replies: 4
- Views: 3411
Find it slightly hard to understand what you mean here. If you are using Plug-ins in your server job, you simply need to add your server job to the sequence job and it will work. You don't need to add anything to the sequence for the plug-ins. A sequence job simply invokes other jobs or activities. ...
- Thu May 10, 2007 3:57 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: StringtoTimestamp
- Replies: 1
- Views: 1082
have you missed a space before 00:00:00StringToTimestamp(lnkAgentInLoad.LIC_EXPIRTON_DT: "00:00:00","%yyyy-%mm-%dd %hh:%nn:%ss")
Code: Select all
StringToTimestamp(lnkAgentInLoad.LIC_EXPIRTON_DT: " 00:00:00","%yyyy-%mm-%dd %hh:%nn:%ss")
- Wed May 09, 2007 9:55 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Executing everything in one transaction
- Replies: 6
- Views: 3508
If it was Oracle you could use Transaction grouping so that all the delete statements could be rolled back together. Unfortunately I don't know much about the Informix stage, the only thing I could recommend to make it work would be to make sure your link ordering is correct for the order you want t...
- Wed May 09, 2007 9:13 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Executing everything in one transaction
- Replies: 6
- Views: 3508
I would also go along the lines of stored procedure for this one. You're not doing anything with the data so there's no real advantage of using datastage, it's just a step that needs to be executed. The database is better suited to performing this operation and you should get more control over rolli...
- Wed May 09, 2007 4:20 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Routine Output question
- Replies: 2
- Views: 1535
Code: Select all
Ereplace(yourString, @FM, '')
- Wed May 09, 2007 4:05 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: substring function
- Replies: 2
- Views: 1683
Do you mean if there is anything other than a number in the substring then reject that substring?
If yes
If yes
Code: Select all
If Num(string[11,4]) Then ....... Else reject.....
- Wed May 09, 2007 3:55 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: IsValid and SetNull
- Replies: 12
- Views: 4940
Descriptions of the APT variables are in the back of the Advanced Parallel job developers guide. ...just came to me....when your dates are Not Valid, are they null? I have faint recollection that you can't pass a null into IsValid, so you have to check whether the input is null first, then check if ...
- Tue May 08, 2007 4:27 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Carriage Returns...
- Replies: 3
- Views: 2599
2 things to try 1) When you ftp the files from DOS to UNIX make sure you are doing it in Ascii mode (not binary), that should be sufficient for the FTP process to convert the CR/LF. 2) If you can't do the above or still have the CR/LF on the end of each line you can tell DS that the file is in DOS m...
- Tue May 08, 2007 4:14 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Not showing up link count
- Replies: 6
- Views: 2332
- Tue May 08, 2007 4:05 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Errors on a Lookup Stage
- Replies: 4
- Views: 1769
- Tue May 08, 2007 4:00 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: number of jobs in a project
- Replies: 5
- Views: 1679
I don't think so, at least can't think of a reason for there being a limit, but someone else will need to confirm that. As long as you organize your jobs well you should be able to have a large number of them before it becomes unwieldy. We currently have just under 1000 jobs and have no issues. It w...