DSXchange

You can remove the duplicates in the sort stage itself if you are using same key for remove duplicates.. Increase the sort memory size in sort stage.Check whether it makes any difference in performance. We are performing on remove duplicates on diferent keys. My Target is DB2 table. No of rows per ...

Hi, One of my job is giving me serious bottleneck issues and any help in resolving that is highly appreciated. I am using following job design : Dataset --> joined to a DB2 table using join stage --> Filter Stage --> sort stage --> remove duplicate stage. From Join stage to filter stage processing i...

StageVar:
If Left(Trim(NullToEmpty(column)),1)='' Then '0' Else '1'

Reject in Transformer where StageVar=0

Problem Solved

Thanks to every body

Do a view of this sequential file in Seq File Stage. Are these values getting read as NULL or Blanks. What is the condistion you have given in Transformer. Can you post your code here. I am getting Nulls if there are no empty spaces i.e delimiter. If there are any empty spaces then it shows as blan...

StageVar: If StripWhiteSpace(NullToEmpty(Input Col))<>'' Then If IsNotNull(Input Col) Then 0 Else 0 Else InputCol Reject in Transformer where StageVar=0 I tried with this. But my Issue ha not resolved. As specified in the above error my seq file record is as follows " ,,Abhi,20100105" I h...

When i am using Trim(Input Col)="" then its working when input col has atleast one empty space. Actually source row is " ,,abhi ,20100115,". Then such record should be rejected. When I am using Trim(Input Col)="".I tried with Trim(NullT0Empty(InputCol))="". In...

My source file is Sequntial file.
And it contains empty spaces & without spaces i.e delimiter without spaces.
I have to reject both of them to rejected data.
For e.g " ,,Abhi,20100101,"
I have to rejecr both the columns

My source contains Empty spaces & Nulls in the primary key Columns.
So I have to Handle both to reject.

I had a situation where i have to reject Null records . The Null records may be with spaces in one row & not having spaces at other. I had used len(stripwhitespaces(col_name))=0 or isnull(col_name) but it is rejecting only the column which is having spaces. So i need to reject both columns which...

When I am executing the Job at first run i am facing the Error. The Error is as follows. SQLSTATE =23505 NATIVE ERROR=-803 "One or more values in the INSERT statement, UPDATE statement, or foreign key update caused by a DELETE statement are not valid because the primary key, unique constraint o...

Actually it should be able to create dataset at run time.

All the previous jobs are able to create the datsets & are working fine.

I am Writing to dataset.
And i have to use that Dataset.

Yes, I had given it as OverWrite itself.

Hi All When I try to run Job I am facing the following error. Data set initialization for "/home/abhik/tgt/sort.ds": This input-file data set does not exist:/home/abhik/tgt/sort.ds. I had given the full Permissions to tgt file. I had tried to create a sample job with Seq File & dta set...

I had replaced the DB2Instance Name at the Admin Level. Now i am facing different error the error is " Unable to connect to DB2 server 's456bp320'. I am able to load Columns from plug in meta data. I am able to connnect to DB2Control center and check the tables. But when i am executing datastag...