Search found 219 matches

by parag.s.27
Tue Dec 23, 2008 11:03 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Preserving the Sorting after FILTER stage
Replies: 6
Views: 3163

Preserving the Sorting after FILTER stage

We are using the Oracle10 g as our source database. When we extract the data using OCI stage we sort the data by applying "Order By asc" on Keys and the Date at the end of query. After the data is extracted, we split the incoming data into 2 streams on the basis of dates where if records a...
by parag.s.27
Tue Dec 16, 2008 11:36 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Jobs getting killed in Master Sequence without any error
Replies: 3
Views: 1402

Can anyone please help in suggesting what can be the possible reason. We have even raised a PMR with IBM, but it is also pending.

What I had found that typically for records more than 3 million the jobs are having such problem. And it is also happening recently. Earlier it was not the case.
by parag.s.27
Tue Dec 16, 2008 1:10 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Jobs getting killed in Master Sequence without any error
Replies: 3
Views: 1402

No way for us to know, because we can't monitor your AIX system. You (or your UNIX admin) must do that. How busy is the system? ... Actually that is the problem. The server is on client site and we are not having the access to check the OS level settings. The infrastructure team on Client Site is s...
by parag.s.27
Mon Dec 15, 2008 12:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Jobs getting killed in Master Sequence without any error
Replies: 3
Views: 1402

Jobs getting killed in Master Sequence without any error

Hi All, In the IIS jobs we are facing a new problem for past few days. The jobs that were running fine till now are getting killed as if OS is killing the process. The detailed log does not show any warning or fatal or any information but when we check the job status in the status window, it shows t...
by parag.s.27
Tue Nov 25, 2008 3:15 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to make this condition in Job Sequence Restartability
Replies: 13
Views: 5558

No, anything at that level would be too late. That would abort the Sequence itself and possibly any currently running jobs as well, not the one that ended with warnings. ... We also had same problem and we resolved it. Write an After Stage Subroutine and in that routine check for job status using D...
by parag.s.27
Fri Nov 21, 2008 12:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Usage of BASIC transformer in IIS 8.0.1
Replies: 6
Views: 2558

Replace with Parallel Tranformer Stage, you will be fine or try to find that file in tmp directory and delete it. Actually we have to do a complex date transformation where we have to increase the time by 1 second if the date has timestamp value as 23:59:59. Now this will increase a day after addin...
by parag.s.27
Fri Nov 21, 2008 12:00 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Usage of BASIC transformer in IIS 8.0.1
Replies: 6
Views: 2558

Replace with Parallel Tranformer Stage, you will be fine or try to find that file in tmp directory and delete it. Actually we have to do a complex date transformation where we have to increase the time by 1 second if the date has timestamp value as 23:59:59. Now this will increase a day after addin...
by parag.s.27
Thu Nov 20, 2008 8:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Usage of BASIC transformer in IIS 8.0.1
Replies: 6
Views: 2558

Re: Usage of BASIC transformer in IIS 8.0.1

Refer to: http://www.dsxchange.com/viewtopic.php?t=123063&highlight= This was the error due to the following warning: - Unable to Read Temp_EDW_Trans_QuotePolicyHeader_Policy_07#02 from OMD.XML.DIR Now the job is not getting this earlier fatal error but it is throwing the above warning. Is ther...
by parag.s.27
Thu Nov 20, 2008 5:46 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Usage of BASIC transformer in IIS 8.0.1
Replies: 6
Views: 2558

Usage of BASIC transformer in IIS 8.0.1

We are getting a warning/fatal while executing a job that has BASIC transformer used in parallel IIS job. The error is: - BASIC_Transformer_117,0: dspipe_init(332276): open(/tmp/ade.HGI_DW_DMI_PRD.EDW_Trans_QuotePolicyHeader_Policy_07.#0.BASIC_Transformer_117.Lnk_Xfm_Lkp-Output) - No such file or di...
by parag.s.27
Sat Nov 08, 2008 12:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Modify Stage(Defining new column with value assigned to it)
Replies: 9
Views: 15249

Please back this kind of assertion with empirical evidence. That is, create both kinds of job and take measurements. You may be surprised. as a performance improvement task, we ... We can check for number of processes created by each stage used in a particular IIS job on the AIX box. If you check f...
by parag.s.27
Fri Nov 07, 2008 10:57 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Modify Stage(Defining new column with value assigned to it)
Replies: 9
Views: 15249

So... use a Transformer? Actually we were earlier using a transformer, but as a performance improvement task, we are replacing all those transformers those are performing operations that can be handled by another light weight stage. Just to add a column in the incoming stream of data, a transformer...
by parag.s.27
Thu Nov 06, 2008 8:13 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Modify Stage(Defining new column with value assigned to it)
Replies: 9
Views: 15249

Modify Stage(Defining new column with value assigned to it)

Can we create a new column in modify stage output link with some value assigned to that field. I want to create a column named 'TARGET_TABLE_NAME' with the value hard-coded as 'POLICY'. Is that feasible? And for this what function is needed to be mentioned as Specification? Please give me a suggesti...
by parag.s.27
Tue Feb 26, 2008 11:57 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ODBC stage returns incorrect microseconds value in timestamp
Replies: 10
Views: 4114

Hey even we are facing the same problem, but not in ODBC stage, but in OCI stage. While inserting in the table through the OCI stage, it is inserting the correct values, but while extracting the timestamp from the OCI stage, the timestamp microseconds appear as .000000. I dumped these values in a da...
by parag.s.27
Mon Feb 25, 2008 1:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Master Sequence is not restartable
Replies: 19
Views: 7068

I've said all I can say on this subject. I know how it works and it works just fine for me. So we're either missing some vital bit of information or they've broken some aspect of this in the 8.x version. Going to repeat this one last time... Open a case with your official Support provider. Have the...
by parag.s.27
Sat Feb 23, 2008 5:19 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Master Sequence is not restartable
Replies: 19
Views: 7068

Re: Master Sequence is not restartable

But still if any of the subsequence S1, S2 or S3 fails then the master sequence M1 is not getting aborted, but is showing Finished(See Log) Interesting thought. I've been assuming that the 'fails' mentioned above means 'aborted' but perhaps that's not the case. If the "sub-sequences" don'...