Search found 72 matches
- Wed Dec 14, 2016 2:23 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Hierarchical Regroup - Multiple children-on the right track?
- Replies: 5
- Views: 8342
Thanks, Ernie. Yes, Claim and Conviction are independent children of Driver, and they are joined upstream. As I said, I am a Hierarchical stage newbie, and HJoin was on my list of the next things to try. But surely this should be achievable using Regroup? I have to observe, however that the I am fin...
- Wed Dec 14, 2016 6:51 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Hierarchical Regroup - Multiple children-on the right track?
- Replies: 5
- Views: 8342
- Wed Dec 14, 2016 5:50 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Hierarchical Regroup - Multiple children-on the right track?
- Replies: 5
- Views: 8342
Hierarchical Regroup - Multiple children-on the right track?
Hierarchical Regroup - Multiple children - Am I on the right track? Problem: I have a flat record coming in, representing a motor insurance quote. The quote may have multiple drivers, and each driver may have multiple claims and multiple convictions. So a tree structure with quote at the top, then d...
- Tue Dec 04, 2012 4:23 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: RCP In remove duplicates and to pass the keys as param
- Replies: 3
- Views: 5077
This is something I've been musing on for some time - there are numerous occasions where I'd like to be able to use RCP and identify key column names as parameters, for sorting, de-duping, change capture etc. The ideal solution would be a reusable component - probably a shared container - with the f...
- Tue Dec 04, 2012 4:02 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Equivalent of Translate fn which can be used on Modify Stage
- Replies: 4
- Views: 2688
The Modify Stage is basically a wrapper round the Modify Operator (See the Orchestrate documentation or The Datastage Advanced Parallel Developers Guide under Operators). You're limited to the conversion functions built into this operator and the type of string translation you want is not one of the...
- Mon Dec 03, 2012 8:26 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: RCP and performing a database update
- Replies: 7
- Views: 11058
Just came across this and thought I'd post an alternative:- If your target is Oracle, you can retrieve the column list from the metadata table all_tab_columns. It's not pretty, but here is some working code, this generates a SQL statement which is written to a file used as the SQL file in the update...
- Wed Nov 28, 2012 4:08 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: What am I doing wrong?
- Replies: 3
- Views: 2532
What am I doing wrong?
So I have a sequential file with dates in the form 2012-11-25. On the format tab of the sequential file I set the format string for dates to be %yyyy-%mm-%dd. The help text for this property is 'The string format of a date. By default, the format of the date string is %yyyy-%mm-%dd. reinforced by th...
- Tue Aug 07, 2012 9:12 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: String to Decimal Validation
- Replies: 6
- Views: 3183
- Tue Aug 07, 2012 8:33 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: String to Decimal Validation
- Replies: 6
- Views: 3183
String to Decimal Validation
In a transformer, fitted with a reject link, I am mapping a string to a decimal type. What I want to happen:- If the incoming data is not a numeric string, e.g. 'aaaa' I want the row to be shunted into the reject link. What actually happens (to my surprise) The value is defaulted to zero, a warning ...
- Fri Oct 28, 2011 9:49 am
- Forum: General
- Topic: Detect if a job is multi-instance?
- Replies: 1
- Views: 1415
Detect if a job is multi-instance?
Is it possible to detect if a job is multi-instance in code? I have a shared container and it generates a string based on the Job Name and Invocation ID. But when embedded in a single-instance job the call to the DSInvocationID macro throws a warning. We have a zero-tolerance policy towards warnings...
- Wed Mar 16, 2011 4:00 am
- Forum: General
- Topic: Capturing Job run stats
- Replies: 2
- Views: 4111
Thanks Kim. I grabbed ETLStats and had a look last night. Very nice. It gets me a long way towards where I want to go. I think using my self-imposed rules of no undocumented access to Datastage internals and 'Keep It Simple' I am going to end up with something that compromises on my 'ideal world' so...
- Tue Mar 15, 2011 10:23 am
- Forum: General
- Topic: Capturing Job run stats
- Replies: 2
- Views: 4111
Capturing Job run stats
Quick question for all ETLStats/joblogging gurus... I have been tasked with developing/upgrading a 'framework' into which production sequences/jobs can be inserted. The framework will provide various common functions, one of which is capturing job runtimes, statuses, row counts, parameters to Oracle...
- Tue Feb 15, 2011 5:06 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Complex Flat File and multple, conditional record types.
- Replies: 6
- Views: 5344
Try reading the file as single column. process the records sequentially. using stage variables you can combine the transaction and addenda record. Yep. I am reading, using a sequential file stage, the whole record into a single column RECORD, type char, substringing column 1 to get the record type,...
- Tue Feb 15, 2011 3:43 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Complex Flat File and multple, conditional record types.
- Replies: 6
- Views: 5344
Thanks for the suggestions - Ray - Can't you send 6 and 5 along separate links into a Funnel? Well, yes I could but (a) they have different metadata and (b) how would I guarantee sort order? Maybe I did not express the requirement sufficiently clearly - A Type 5 record may or may not be immediately ...
- Mon Feb 14, 2011 10:20 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Complex Flat File and multple, conditional record types.
- Replies: 6
- Views: 5344
Doh!
Well that's not gonna work is it? :roll: The CFF only permits you to interrogate a single Record Id column and send all rows of that record type down the same link. I need to send Types 5 AND 6 down the same link, and as the sequence is the only thing that connects them, to preserve the sort order. ...