Search found 36 matches

by prasad_chennai
Sun Nov 18, 2012 11:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Comparing stage variables in transformer
Replies: 1
Views: 1438

Comparing stage variables in transformer

I have a parallel job which gets its data from a Exec command in Sequence job. The output of the Exec cmd (lets say A) is appended to the data in the text file. Delimiter is | . The text file can have 2 records. So A is appended at the end of both the records. The Sequence file in the parallel job w...
by prasad_chennai
Mon Jun 14, 2010 4:45 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to read a column with newline characters
Replies: 2
Views: 1863

How to read a column with newline characters

Hi All, I have a requirement where in I am getting data in a pipe delimited file which is having data with newline characters in it. Below is the sample content of the data:- 060707394|CUSC|08-JUN-10|77620138|0|11-JUN-10|SOCIAL SECURITY ADMINISTRATION|08-JUN-10|08-JUN-10|10-JUN-10|||/HCGS/520317 /MB...
by prasad_chennai
Wed Feb 10, 2010 8:00 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance issue while loading frm flat file to oracle tab
Replies: 9
Views: 3696

Thanks for the inputs Craig & Vivek. I am using hash file in between the table and transformer now but there are many constraints and validation that are being performed. The lookup queries are quite fast and its around 12000 rec/sec but at the source it is 600rec/sec and after passing from the ...
by prasad_chennai
Wed Feb 10, 2010 7:57 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance issue while loading frm flat file to oracle tab
Replies: 9
Views: 3696

The lookup queries are quite fast and its around 12000 rec/sec but at the source it is 600rec/sec and after passing from the transformer its writing to the table at 400 rec /sec though I have changed the arraysize to 10000.
by prasad_chennai
Wed Feb 10, 2010 7:21 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance issue while loading frm flat file to oracle tab
Replies: 9
Views: 3696

The performance is drastically going down as soon as it reaches the transformer stage. Is it something to do with the stage variables?
There is slowdown in performance while reading from the file and while reading from the lookup as well.

Thanks,
Prasad
by prasad_chennai
Wed Feb 10, 2010 6:59 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance issue while loading frm flat file to oracle tab
Replies: 9
Views: 3696

Performance issue while loading frm flat file to oracle tab

Hello Everyone, I have a requirement to update else insert a record while reading from a flat file into an oracle table. The job flow is as below: Oracle table(lookup table) | | | Flat File(21M records) --->Transformer------->Oracle table(with update else insert) My source is a flat file and I am do...
by prasad_chennai
Mon Nov 17, 2008 3:18 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Replace Linefeed Characters coming from the source with null
Replies: 1
Views: 1317

Replace Linefeed Characters coming from the source with null

Hi All, I have a simple datastage job where I am extracting the data from a table and I am creating a flat file(text file). These flat files are used to generate reports. But I am getting linefeeds embedded with some of the values coming from certain columns. How can I replace these linefeeds with a...
by prasad_chennai
Tue Oct 21, 2008 7:01 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Replace null field in record with double pipe
Replies: 2
Views: 1747

Replace null with double pipes

Sorry for the typing error Chulett. Actually I want to replace the null field with a double pipe. And I want to implement this in my transformer.
Is there any way to implement this? As there are lots of coulmns involved.

Thanks again.
Prasad
by prasad_chennai
Sat Jul 26, 2008 2:18 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Timestamp value comparision in transformer
Replies: 4
Views: 1871

Timestamp value comparision in transformer

Hi, I have requirement like this i need to make a look up between hashfile which has one of the output column as Timestamp(Column name Start_date ) and A table which has one of the output column as Timestamp( Begin_date ).This output is generated by User defined SQL. Iam using To_Date and To_Char fu...
by prasad_chennai
Wed Mar 12, 2008 2:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: stored procedure
Replies: 6
Views: 2380

I asked my admin about the same and ha sdone some setttings and code working fine now.i will get the setup been done i will update about this. In my stored procedure. iam just passing the Input parameter and it wont return any OUT parameter.So if the procedure fails due to any exceptions,then will m...
by prasad_chennai
Mon Mar 10, 2008 7:50 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: stored procedure
Replies: 6
Views: 2380

Oracle itself.
can't we make our job wait, till procedure execute completely.
by prasad_chennai
Mon Mar 10, 2008 7:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: stored procedure
Replies: 6
Views: 2380

stored procedure

I am calling a stored procedure through the stored procedure stage from datastage.When i call stored procedure,i just fire the call statement and my datastage job finishes.My datastage Job will not wait until the stored procedure executes successfully.So then how i will come to know that procedure i...
by prasad_chennai
Tue Feb 26, 2008 2:59 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Date Conversation
Replies: 3
Views: 1716

Source is In Varchar while target is date(mm/dd/yyyy).
by prasad_chennai
Tue Feb 26, 2008 1:59 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Date Conversation
Replies: 3
Views: 1716

Date Conversation

Hi All, I need to Convert date format from 'dd-mmm-yyy ' to 'mm/dd/yyyy'. and i am using th efollowing function to achieve the same.But just the date value (dd) is getting truncated to month start date. StringToDate(DateToString(StringToDate(Trim(LNK_Read_Input.IND_DT), "dd-%mmm-%yy"), &qu...
by prasad_chennai
Fri Feb 22, 2008 8:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DSSendMailTester Rouitne
Replies: 3
Views: 3070

I have proposed same what you said,but users want it like this only.for every bad record they need mail. Oracle Source-------Transformer-----------Oracle target | | Basic Transformer | | Sequential File I have mentioned IsNotNull(LNK.XXXX) function in Transformer stage.if i get null values, those ar...