Search found 89 matches

by Nagin
Fri Mar 28, 2008 1:18 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: View data problem in Teradata Enterprise Stage
Replies: 7
Views: 2513

View data problem in Teradata Enterprise Stage

Hi, I am running a user defined SQL in Terdata Enterprise stage and writing it to a txt file. The same query is running fine and returning rows out side the datastage without any problems, but this job is aborting without returning any rows. Its aborting giving the following warning 7 sessions were ...
by Nagin
Thu Mar 20, 2008 5:00 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Basic Transformer in Parallel job Processing palette
Replies: 11
Views: 2421

DSguru2B wrote:Sure. If thats the logic you are using then you can still use Field() function in px transformer, for rounding you can use StringToDecimal and round it up.
Cool, I got it working. I used ceil function to round up.

Thanks alot for the help.
by Nagin
Thu Mar 20, 2008 2:44 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Basic Transformer in Parallel job Processing palette
Replies: 11
Views: 2421

I just found out these two functions - MonthFromDate() and YearFromDate() that would work in Parallel Transformer. About, how I figured out the Month and Year from D-X in server job is thru a series of manipulations. Here is how it goes - D - System Date X- number of months ((YearFromDate(D)*12)+Mon...
by Nagin
Thu Mar 20, 2008 1:54 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Basic Transformer in Parallel job Processing palette
Replies: 11
Views: 2421

The functionality I am looking for is -
1. Given a date , I need to get month and year from that
2. Given a date (D) and number of months (X), I need to do subtract 'X' from 'D' and get the year and month at that point in time.
by Nagin
Thu Mar 20, 2008 1:26 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Basic Transformer in Parallel job Processing palette
Replies: 11
Views: 2421

But, the standards here require using only parallel jobs. That's a silly 'standard'. Use whatever job type is appropriate to the task. Apart from the standards, My production system is in MPP, So, seems like I can't use the Basic Transformer eitherway. Any other thoughts as of how to achieve that f...
by Nagin
Thu Mar 20, 2008 1:25 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Basic Transformer in Parallel job Processing palette
Replies: 11
Views: 2421

But, the standards here require using only parallel jobs. That's a silly 'standard'. Use whatever job type is appropriate to the task. Apart from the standards, My production system is in MPP, So, seems like I can't use the Basic Transformer eitherway. Any other thoughts as of how to achieve that f...
by Nagin
Thu Mar 20, 2008 1:01 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Basic Transformer in Parallel job Processing palette
Replies: 11
Views: 2421

Dont use it if your code is going to end up in an MPP enviornment. What functionality do you want to sqeeze out of a basic transformer? I need a bunch of functions actually, like .. getting a month and year from a given date and getting a month and year out of SYSDATE-Xnumber of months. I got it al...
by Nagin
Thu Mar 20, 2008 12:39 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Basic Transformer in Parallel job Processing palette
Replies: 11
Views: 2421

Basic Transformer in Parallel job Processing palette

Hi, I have two questions - 1. I am not able to see Basic Transformer in the Parallel job processing palette, So I tried to customize and added the the Transformer from the server job processing palette, It gets added to the palette but not available to use. Its grayed out. Is there something else I ...
by Nagin
Wed Nov 14, 2007 5:34 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Can Build Stage read a file?
Replies: 1
Views: 1085

Can Build Stage read a file?

I have a job sequence which has an execute command stage looking for a specific file pattern, and when the file is found another job is invoked to load the file into the database after applying transformations. So far, files have been coming in from two different sources with same metadata. Now, as ...
by Nagin
Mon Oct 08, 2007 9:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Teradata table record count mismatch performance statistics
Replies: 4
Views: 3430

To insert 2 million records you might have used one of the database stages which call one of the Teradata Utilities like MultiLoad, FastLoad... DataStage writes all the records into a named pipe or file and loading to Teradata table happens using one of the utility mentioned above. Records rejected...
by Nagin
Mon Oct 01, 2007 9:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Teradata table record count mismatch performance statistics
Replies: 4
Views: 3430

Teradata table record count mismatch performance statistics

I am loading a sequential file which has about 2 million rows into a teradata table. I am creating the table through the ETL. The ETL runs fine with couple of warnings about running sequentially and stuff and the job finishes saying that all the rows have been imported successfully and 0 records rej...
by Nagin
Wed Sep 05, 2007 4:05 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Cartesian Join in PX
Replies: 6
Views: 2845

Hey Ann, This topic is marked as having a work around. Do you mind to share how you resolved this issue? I have two files with around 1500 disctinct values (including the non key columns) in both. Here is the lay out. file-1 x 1 x 2 x 3 x 4 x 5 file -2 x null 12 34 x null 13 24 x null 11 22 x null 4...
by Nagin
Mon Jul 30, 2007 2:22 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: LDR_CNTRL=MAXDATA
Replies: 1
Views: 2033

LDR_CNTRL=MAXDATA

Hi, We have a DS Server edition installed on AIX platform, and have been having severe performance problems. I was going thru the documentation and found out that the DSEngine is shipped with minimum configuration to be able to run on servers with minimal hardware and we will have to reconfigure the...
by Nagin
Tue May 15, 2007 12:13 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Abnormal termination of stage
Replies: 1
Views: 1234

Abnormal termination of stage

I have a job failing with the Abnormal termination error. Below is the log entry I got from resetting the job. I understand that the memory is the issue, but I have increased the buffer size in Inter processup to 1024 and time out to 30 sec and still getting the same error. Its a pretty big table, i...
by Nagin
Thu Mar 15, 2007 12:36 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Writing to ORAOCI9 stage - Performance improvement
Replies: 4
Views: 1593

Is this Server or PX? What's the DML like? What's the load on the DS Server? (prstat, topas, top, glance,etc) If Server, why not use multiple job instances with a query partitioning scheme? If PX, why not use Enterprise stages? This is a server job and DML truncates the table and inserts rows. I ra...