Data in the job will be lesser,so better i ll go for option 1.
As suggested i am making transformer to run sequentially and sort stage will remain run in parallel mode.
But do you think that due to partition in the sort we could get wrong sorted sequence in transformer(running in sequence)..??
Search found 531 matches
- Mon Dec 05, 2011 4:12 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Timestamp sort issue
- Replies: 5
- Views: 2143
- Sun Dec 04, 2011 2:58 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Timestamp sort issue
- Replies: 5
- Views: 2143
- Fri Dec 02, 2011 1:28 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Timestamp sort issue
- Replies: 5
- Views: 2143
- Fri Dec 02, 2011 6:26 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Timestamp sort issue
- Replies: 5
- Views: 2143
Timestamp sort issue
Hi All, I have job design where i need to sort the data based on timestamp column(microsecond) and after sort apply transormation logic in transformer which should pick the max timestamp and populate for rest of records. Stage veriable value is:- If srt_to_tfm.LastChgDateTime>= svEFFDT then srt_to_t...
- Mon Oct 24, 2011 2:12 am
- Forum: General
- Topic: passsing before routine's output in job
- Replies: 1
- Views: 824
passsing before routine's output in job
Hi,
How can i pass before subroutine's output to job parameter.
Actually i am writing a routine which will run the script and give as an ouptut with scema name.
How can i pass this schema name to job as job paramter.
Thanks
Prasoon
How can i pass before subroutine's output to job parameter.
Actually i am writing a routine which will run the script and give as an ouptut with scema name.
How can i pass this schema name to job as job paramter.
Thanks
Prasoon
- Thu Oct 20, 2011 1:45 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: previous date
- Replies: 6
- Views: 4023
- Wed Jul 06, 2011 4:41 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Row into columns
- Replies: 6
- Views: 3831
Re: Row into columns
Hi All, This can be easily done in Datastage 8.5. Step 1:- Read the source as it is in single column. Step2:- Define two stage veriables . Svar1=Field(incol," ",1) Svar2=Field(incol," ",2) Define Loop Condition as:- AITERATION=1 Or RemainingRecord="" Loop Derivation:- I...
- Tue Jun 14, 2011 7:04 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Use of Vertical Pivot Stage
- Replies: 2
- Views: 1735
Use of Vertical Pivot Stage
Hi, I am testing a vertical pivot stage in DS8.5. I have input like this:- "abc","def","jim" "abc","def","bob" "abc","def","tom" And i want output like:- "abc","def","jim","bo...
- Wed Apr 13, 2011 3:05 am
- Forum: General
- Topic: After subroutine to see the log
- Replies: 5
- Views: 2239
- Wed Apr 13, 2011 2:15 am
- Forum: General
- Topic: After subroutine to see the log
- Replies: 5
- Views: 2239
- Tue Apr 12, 2011 11:38 pm
- Forum: General
- Topic: After subroutine to see the log
- Replies: 5
- Views: 2239
After subroutine to see the log
Hi All, I need help in creating a routine which will display director log in output. I have created routine as:- $INCLUDE DSINCLUDE JOBCONTROL.H JobName = Arg1 hJob1 = DSAttachJob(JobName, DSJ.ERRNONE) jobStart = DSGetJobInfo (hJob1, DSJ.JOBSTARTTIMESTAMP) latestID = DSGetNewestLogId(hJob1,DSJ.LOGAN...
- Mon Jan 17, 2011 6:06 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Teradata Enterprise -Error message
- Replies: 1
- Views: 1371
Teradata Enterprise -Error message
I have a job having source as Oracle and Target as Teradata Enterprise stage.We are extracting data from oracle and loading data into TD using TD EE stage as Target. In Oracle one column INDV_ID has datatype as Number(9) and same column in Teradata has datatype as Decimal(9,0). We are reading this c...
- Mon Dec 20, 2010 5:20 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Dataset comparision from Oracle and Teradata
- Replies: 6
- Views: 4043
- Mon Dec 20, 2010 3:55 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Dataset comparision from Oracle and Teradata
- Replies: 6
- Views: 4043
Dataset comparision from Oracle and Teradata
Hi All,
I have dataset generating using Oracle and Teradata.
One job has source as Oracle and other has source as Teradata.
I need to compare two datasets generating from these two jobs.Is there any way i can compare datasets.
Thanks
I have dataset generating using Oracle and Teradata.
One job has source as Oracle and other has source as Teradata.
I need to compare two datasets generating from these two jobs.Is there any way i can compare datasets.
Thanks
- Tue Sep 14, 2010 10:57 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Create C++ routines in windows
- Replies: 6
- Views: 4943