Search found 203 matches

by mouthou
Wed Apr 10, 2019 2:54 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Factors to decide the run mode of Oracle connector
Replies: 5
Views: 4830

Re: Factors to decide the run mode of Oracle connector

It is understood that you are trying to do some performance testing and that too using Join stage in DataStage. Is there any difficulty in joining the 2 queries using DB join itself? And what is the difficulty in creating table indexes and partitions which is much worth than dealing with DataStage f...
by mouthou
Wed Apr 10, 2019 2:38 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Run time column propogation
Replies: 6
Views: 5345

I also don't think there the inbuilt stages have options to accept the entire IF-THEN-CLAUSE as dynamic parameter. As an alternate approach, you can use MODIFY/FILTER STAGE which allows the dynamic columns based processing. Atleast you check the nullability of the parameter column there and set some...
by mouthou
Mon Mar 11, 2019 11:41 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Surrogate Key stage issue
Replies: 3
Views: 3379

Re: Surrogate Key stage issue

Assuming that your migration included the surrogate key files to new Linux platform, couple of things you could check: 1. if the files have been moved by the deployment team properly (as these are binary files) without errors 2. if the files have got any unusual permission attributes for making it i...
by mouthou
Mon Mar 11, 2019 11:27 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Put quotes around fields in sequential file only with commas
Replies: 2
Views: 2948

Question/scenario makes the brain to wander a little bit! In future, putting some sample input and expected output will help. Is this your clarification on when the quotes will be put by DataStage. Are you creating the file by using SeqFile stage in which you will get quotes for all fields and not f...
by mouthou
Mon Feb 18, 2019 2:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle connector - Deadlock issue
Replies: 9
Views: 7223

yes you are logically correct as per the link ordering but I am thinking in the lines of duplicate rows getting into one particular link itself. We had such issues with duplicate data getting processed by different partition in the same run. If you have test DB, try to load the data from one link at...
by mouthou
Thu Feb 14, 2019 1:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle connector - Deadlock issue
Replies: 9
Views: 7223

as the deadlock error comes out of Oracle, it is pretty obvious that there is same record going for more than one operation at the same time. For debugging purpose, try removing the one link each time and run the job. you will get to know the link and what combination is still receiving/processing t...
by mouthou
Mon Feb 04, 2019 10:55 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Datastage Director Monitor not displaying row counts
Replies: 2
Views: 3650

As chulett pointed out, the bottomline is the "JobMon" app to be running on the server. If not, contact your datastage admin to restart the service completely and verify till you see something in "ps -ef | grep JobMonApp"
by mouthou
Mon Feb 04, 2019 10:36 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lineage Report
Replies: 2
Views: 3625

It talks about IGC console only and administration there. May be your user id don't have necessary privileges to see the Admin section.

Try login with some admin user to see if you get Administration section visible.
by mouthou
Mon Feb 04, 2019 7:40 pm
Forum: General
Topic: Need to get Object list from Package (.pkg) file
Replies: 6
Views: 5770

What do you mean by DataStage package? Do you have list exported already. DataStage package means isx kind of packages here, so needing more clarity. Again your other question needs clarity too. With my implicit understanding, yes the compilation can be automated on JOBS and not on DSX file. If you ...
by mouthou
Sun Jan 20, 2019 11:15 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Check if multiple rows returned from Lookup Stage
Replies: 5
Views: 5028

I think your colleagues are not entirely correct and working up entirely in Datastage is a selective scenario. Best practice is to push the operation to DB so the minimal preprocessing like yours happens while selecting the data itself. 'Multiple rows returned option" did what it is supposed to...
by mouthou
Fri Jan 18, 2019 3:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Runtime comparision of tables using TD connector stage?
Replies: 8
Views: 5118

I think runtime could be in any scenario, be it one time or incremental batch loads. I meant the runtime as to pass the something like tablename when the validation job runs. This is a temporary validation process which will be run everyday on production for a month till the migration is signed off ...
by mouthou
Wed Jan 16, 2019 9:43 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Runtime comparision of tables using TD connector stage?
Replies: 8
Views: 5118

Thanks for everyone's comments. To answer few questions from Ray and Chulett - Yes I also expected a native solution to do within the DB but there isnt much known yet (It will be 2 different DB production servers and the options of playing around are limited). The kind of comparison is table-to-tabl...
by mouthou
Wed Jan 16, 2019 3:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Runtime comparision of tables using TD connector stage?
Replies: 8
Views: 5118

Runtime comparision of tables using TD connector stage?

Hi All, We have about 700-800 existing Teradata tables which required to be migrated to a different Teradata DB server and compare the new data set with the existing set as and when DataStage jobs run in both the Teradata DBs. Having left with no choice on the DB side as there is no database link et...
by mouthou
Sun Jul 22, 2018 6:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: identifying conductor node in default pool
Replies: 10
Views: 5018

Thanks Ray. I thought to clarify the question with 2 samples of config files. config1: node1 { fastname dsserver pools "" .......... ........... } node2 { fastname dsserver pools "conductor" .......... ........... } config2: node1 { fastname dsserver pools "" .............
by mouthou
Thu Jul 19, 2018 10:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: identifying conductor node in default pool
Replies: 10
Views: 5018

Thanks Ray and Paul. I am not quite clear on the response with the references of named node and default pool, both of which are mutually exclusive as far as my understanding goes. ie, if there is named node then it cannot be called as default pool. Please correct if it is not the case. If there is n...