Search found 89 matches
- Fri Mar 28, 2008 1:18 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: View data problem in Teradata Enterprise Stage
- Replies: 7
- Views: 2513
View data problem in Teradata Enterprise Stage
Hi, I am running a user defined SQL in Terdata Enterprise stage and writing it to a txt file. The same query is running fine and returning rows out side the datastage without any problems, but this job is aborting without returning any rows. Its aborting giving the following warning 7 sessions were ...
- Thu Mar 20, 2008 5:00 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Basic Transformer in Parallel job Processing palette
- Replies: 11
- Views: 2421
- Thu Mar 20, 2008 2:44 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Basic Transformer in Parallel job Processing palette
- Replies: 11
- Views: 2421
I just found out these two functions - MonthFromDate() and YearFromDate() that would work in Parallel Transformer. About, how I figured out the Month and Year from D-X in server job is thru a series of manipulations. Here is how it goes - D - System Date X- number of months ((YearFromDate(D)*12)+Mon...
- Thu Mar 20, 2008 1:54 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Basic Transformer in Parallel job Processing palette
- Replies: 11
- Views: 2421
- Thu Mar 20, 2008 1:26 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Basic Transformer in Parallel job Processing palette
- Replies: 11
- Views: 2421
But, the standards here require using only parallel jobs. That's a silly 'standard'. Use whatever job type is appropriate to the task. Apart from the standards, My production system is in MPP, So, seems like I can't use the Basic Transformer eitherway. Any other thoughts as of how to achieve that f...
- Thu Mar 20, 2008 1:25 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Basic Transformer in Parallel job Processing palette
- Replies: 11
- Views: 2421
But, the standards here require using only parallel jobs. That's a silly 'standard'. Use whatever job type is appropriate to the task. Apart from the standards, My production system is in MPP, So, seems like I can't use the Basic Transformer eitherway. Any other thoughts as of how to achieve that f...
- Thu Mar 20, 2008 1:01 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Basic Transformer in Parallel job Processing palette
- Replies: 11
- Views: 2421
Dont use it if your code is going to end up in an MPP enviornment. What functionality do you want to sqeeze out of a basic transformer? I need a bunch of functions actually, like .. getting a month and year from a given date and getting a month and year out of SYSDATE-Xnumber of months. I got it al...
- Thu Mar 20, 2008 12:39 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Basic Transformer in Parallel job Processing palette
- Replies: 11
- Views: 2421
Basic Transformer in Parallel job Processing palette
Hi, I have two questions - 1. I am not able to see Basic Transformer in the Parallel job processing palette, So I tried to customize and added the the Transformer from the server job processing palette, It gets added to the palette but not available to use. Its grayed out. Is there something else I ...
- Wed Nov 14, 2007 5:34 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Can Build Stage read a file?
- Replies: 1
- Views: 1085
Can Build Stage read a file?
I have a job sequence which has an execute command stage looking for a specific file pattern, and when the file is found another job is invoked to load the file into the database after applying transformations. So far, files have been coming in from two different sources with same metadata. Now, as ...
- Mon Oct 08, 2007 9:27 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Teradata table record count mismatch performance statistics
- Replies: 4
- Views: 3430
To insert 2 million records you might have used one of the database stages which call one of the Teradata Utilities like MultiLoad, FastLoad... DataStage writes all the records into a named pipe or file and loading to Teradata table happens using one of the utility mentioned above. Records rejected...
- Mon Oct 01, 2007 9:14 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Teradata table record count mismatch performance statistics
- Replies: 4
- Views: 3430
Teradata table record count mismatch performance statistics
I am loading a sequential file which has about 2 million rows into a teradata table. I am creating the table through the ETL. The ETL runs fine with couple of warnings about running sequentially and stuff and the job finishes saying that all the rows have been imported successfully and 0 records rej...
- Wed Sep 05, 2007 4:05 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Cartesian Join in PX
- Replies: 6
- Views: 2845
Hey Ann, This topic is marked as having a work around. Do you mind to share how you resolved this issue? I have two files with around 1500 disctinct values (including the non key columns) in both. Here is the lay out. file-1 x 1 x 2 x 3 x 4 x 5 file -2 x null 12 34 x null 13 24 x null 11 22 x null 4...
- Mon Jul 30, 2007 2:22 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: LDR_CNTRL=MAXDATA
- Replies: 1
- Views: 2033
LDR_CNTRL=MAXDATA
Hi, We have a DS Server edition installed on AIX platform, and have been having severe performance problems. I was going thru the documentation and found out that the DSEngine is shipped with minimum configuration to be able to run on servers with minimal hardware and we will have to reconfigure the...
- Tue May 15, 2007 12:13 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Abnormal termination of stage
- Replies: 1
- Views: 1234
Abnormal termination of stage
I have a job failing with the Abnormal termination error. Below is the log entry I got from resetting the job. I understand that the memory is the issue, but I have increased the buffer size in Inter processup to 1024 and time out to 30 sec and still getting the same error. Its a pretty big table, i...
- Thu Mar 15, 2007 12:36 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Writing to ORAOCI9 stage - Performance improvement
- Replies: 4
- Views: 1593
Is this Server or PX? What's the DML like? What's the load on the DS Server? (prstat, topas, top, glance,etc) If Server, why not use multiple job instances with a query partitioning scheme? If PX, why not use Enterprise stages? This is a server job and DML truncates the table and inserts rows. I ra...