Search found 38 matches

by sharmabhavesh
Sun Oct 04, 2015 7:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading multiple files with same metadata from a list
Replies: 16
Views: 16707

Hi, Thanks all, the UNIX command really worked for opening all the files through list/indirect file. There's one problem which I am still facing. I am trying to remove the header by using the command `cat listfile.txt|grep -v 'HEADER'`. This is giving me a warning : Sequential_File_6,0: Field "...
by sharmabhavesh
Fri Oct 02, 2015 9:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading multiple files with same metadata from a list
Replies: 16
Views: 16707

Hi Thomas, The solution you suggested is going to run the job 300 times (once for each file). I want to run the job just once. Like we have file pattern in sequential file which reads multiple files with same pattern, is there a way I can read multiple files(may or may not be in the same directory) ...
by sharmabhavesh
Thu Oct 01, 2015 10:36 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading multiple files with same metadata from a list
Replies: 16
Views: 16707

Reading multiple files with same metadata from a list

Hi, I have 200-300 different files with the same metadata (which I will pass through schema file) which I want to load into a single table. Below are the limitations I have: 1. Files are in different folder 2. Each file has a header How can I read all these files at the same time in a single job. Is...
by sharmabhavesh
Thu Mar 05, 2015 2:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle table to cobol file output
Replies: 10
Views: 3763

Yes, quite similar is not identical. His is an insurance domain while mine is a banking domain. So the fields might be different but the transformation he is looking for is the same I am looking for. If you still think I need to create a new thread, I will do that. But I think solution to his proble...
by sharmabhavesh
Wed Mar 04, 2015 10:16 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle table to cobol file output
Replies: 10
Views: 3763

Yes, my problem is similar to UdayanGuha. I couldn't try much as I could not understand how to convert the different file records in a COBOL format. When I put the transformer between sequential file and CFF stage, I could not map the fields. But yes, Udayanguha's scenario is quite similar to my pro...
by sharmabhavesh
Wed Mar 04, 2015 1:58 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle table to cobol file output
Replies: 10
Views: 3763

Hi,
Any help on this? Even I am facing a same scenario with one of my code pieces.
by sharmabhavesh
Thu Feb 26, 2015 1:07 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reject file for Oracle connector in write method
Replies: 4
Views: 3036

Yes Chulett, I set up a reject link as well. But the job is aborting for unsuccessful load and is not sending anything to the reject. Tried with different properties as well. Is there some specific property which needs to be set up?
by sharmabhavesh
Thu Feb 26, 2015 12:03 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reject file for Oracle connector in write method
Replies: 4
Views: 3036

Also, I am using a normal load (write mode) and not a bulk load.
by sharmabhavesh
Thu Feb 26, 2015 11:59 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reject file for Oracle connector in write method
Replies: 4
Views: 3036

Reject file for Oracle connector in write method

Hi, I want to load some data into a Oracle table using oracle connector (in append mode). My job fails if there's some issue with the data load (like primary key violation, NULL value for not-NULL fields etc). I want the job to continue and insert whatever it can and reject records which can't be in...
by sharmabhavesh
Thu Oct 23, 2014 7:24 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Change capture: Duplicate records based on key
Replies: 3
Views: 2854

Hi,
We are currently on the Datastage job design phase and do not have access to Datastage thats why could not try myself. So if there are multiple 'not changed records' with the same key, will my change capture still work (If I sort and partition my before and after dataset based on my key).
by sharmabhavesh
Wed Oct 22, 2014 12:40 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Change capture: Duplicate records based on key
Replies: 3
Views: 2854

Change capture: Duplicate records based on key

Hi, I have a before and after dataset which have two columns PK(Primary key) and VK(Value key). Now in the Before dataset I have records like: PK VK A 1 A 2 A 3 In the after dataset I have all the records in before dataset plus some new records like: PK VK A 1 A 2 A 3 A 4 A 5 B 1 Will my change capt...
by sharmabhavesh
Wed Oct 15, 2014 2:53 pm
Forum: General
Topic: Retrieving already run job information to populate a table
Replies: 3
Views: 1321

Retrieving already run job information to populate a table

Hi, I ran a job wherein I am loading data from source to target after some transformations. Now I want to load the summary of this already run job into a table using Datastage. How can I retrieve the number of records passing through each link in the already run job. Also, in a Datastage job, is it ...
by sharmabhavesh
Sun Jun 29, 2014 12:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: UPPER function in Datastage filter stage
Replies: 1
Views: 2732

UPPER function in Datastage filter stage

Hi, I am trying to compare a record in Datastage filter stage with the following condition: upper(record) like '%PLAN%' when I run the job I get the following error Parse error: Expected comparison, 'between', or 'like' operator, got: "upper" When I remove the upper function, the code runs...
by sharmabhavesh
Tue Jun 03, 2014 9:46 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Copy stage during extraction of data from table
Replies: 1
Views: 918

Copy stage during extraction of data from table

I am trying to finetune some old Datastage jobs. There are some extraction jobs where we are extracting data from a table (using oracle connector) and putting the data into a dataset. Now in all the jobs I am seeing, a copy stage has been used in between the Oracle connector and Dataset. Since no tr...
by sharmabhavesh
Tue Jan 15, 2013 2:55 pm
Forum: General
Topic: DSParam and DSEnv file
Replies: 3
Views: 3524

Thanks Chulett
Actually niether me nor my manager knows much about Datastage :P:P. So he asked me to find out how DSParam file is created. Now you have answered to the creation part.
I am now curious to know if DSParam file is different from DSEnv file. If yes, how?