DSXchange

Hi,
I am working on a simple task which is just copy data from one table to another table. Number of rows on the table are 28 million. Can anyone suggest the best/efficient way to transfer data between two databases using datastage ?

Thank you,

stuartjvnorton,
As of now its just letter A but its not always A and S so the sort logic you explained wont work. Could you please suggest some other solution (plz make A and S as generic/variable) then how can I handle the same job?

Thanks,

Sorry Ray, What I mean was if we have more records with same ID number then take record with status A. Even if we have records with status A more than 1 for same ID then take the record which has max effective date. Even if we have more than 1 record with same Effective date then take record with po...

Hi, I have a source like this ID-- Status-- Position-- Date 1 T S 01/20/2012 1 R S 08/20/2012 1 D S 09/20/2011 1 A S 10/20/2012 1 A S 11/18/2012 2 T S 02/22/2011 2 A L 08/15/2012 2 A S 08/15/2012 Output: ID Status Position Date 1 A S 11/18/2012 2 A S 08/15/2012 Logic: If ID > 1 record then take reco...

I am getting data from different tables and schemas using Oracle connectors. My job contains 12-15 joins and at last before writing to a Oracle table this is the scenario, I want to join two tables I need the data from one table and whatever the columns I need from another stream. I am using right o...

We can use <> X in where condition in filter stage. (You can also use AND in where condition)

I want to use NOT IN condition in Datastage. I need records which are not 'X'. (If I need records which are X, I can use filter what about NOT X).

I restarted my Datastage server. Problem Solved...

All joins are left outer and I used some more joins in oracle connectors as well (in queries).

I have a job which has 3 joins, job is Oracle,Oracle --> Join, Oracle --> join, oracle --> join --> sequential file/Oracle table. At each oracle connector I am able to see data and while I ran the job it went successfully and it was showing as 74240 rows wrote in sequential file. But all the values ...

Hi, I am working on a job which has nearly 250+ columns in target. All these columns are coming from so many tables. I have another job and which has also pretty much same number of columns and it is using some of the columns which are generated in previous job. I dont want to create any intermediat...

Thanks Ray, I have a doubt, in my job I am not sure how many columns will come with same ID, so thats why I gave array size of 20 in PxPivot Stage. Previously I was writing to a sequential file after transformer stage (PxPIVOT stage --> Transformer --> Sequential file). In transformer stage I was ab...

Sorry Chulett, Job is like this oracle connectors(Source) --> joins --> transformer --> pivot (vertical) --> transformer --> oracle connector (Target). Columns are ID, PID, Name, Email. I am grouping on ID and pivoting remaining columns PID, Name and Email and I dropped one column intentionally afte...

Hi, I am able to write pivot (VERTICAL PIVOT) results to a sequential file without having any error but I am getting errors in the case of writing to a Oracle table. First of all, table is creating with all the Vertical PIVOT values instead of values in transformer stage (I am using transformer afte...

Hi, I am getting following error when I was using copy stage to handle blob data. "Copy_18,1: Fatal Error: Virtual data set.; output of "Copy_18": the record is too big to fit in a block; the length requested is: 139266, the max block length is: 131072.". Could you please give ad...