Search found 28 matches

by rohanf
Mon May 17, 2010 7:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Duplicate identifier created by state file
Replies: 7
Views: 4436

The surrogate stage has following properties:- 1: Source Type: Flat File 2: Generate key from last Highest Value=No The Partition is Auto for all the stages after the Surrogate stage. i.e. Tgt and the load job's stages. I haven't tried running on one node. Not even sure if this error can be re-creat...
by rohanf
Mon May 17, 2010 6:59 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Duplicate identifier created by state file
Replies: 7
Views: 4436

Hi, There are no errors in the log .... There is just sqlcode(1403) in the reject file .... Job design is as below: Transformation:- Join-> Transformer->Lookup->Filter->Modify->Surrogate->Tgt Load:- Tgt->Copy->Oracle enterprise**- - - - - - ->Reject file ** The options are: Write method: "Upser...
by rohanf
Mon May 17, 2010 5:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Duplicate identifier created by state file
Replies: 7
Views: 4436

Duplicate identifier created by state file

Hi All, I am using a Surrogate key generator stage to create a primary key identifier. However there are 254 load rejects out of 4312066 with the Sqplcode: 1403 (ORA 1403: No data found). I have searched the forum for 1403 issue and was unable to get a conclusive resolution. But, when I loaded all t...
by rohanf
Tue Mar 16, 2010 9:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Records not getting extracted from Oracle
Replies: 7
Views: 3445

Records not getting extracted from Oracle

Hi Sainath, Yes we have done all the below checks to the best of our knowledge: Validity/Accuracy of SQL: The sql has been running for a long time now, the code has been Unit/system tested and is in mid of UAT. Parameters passed: we have checked this as well. Logs as mentioned has only two NLS warni...
by rohanf
Tue Mar 16, 2010 7:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Records not getting extracted from Oracle
Replies: 7
Views: 3445

Records not getting extracted from Oracle

Hi Sainath, By saying 'changes as the count in dataset changes' I am referring to my comment in the first post message: "However when we run these there are a few records that do not get extracted. This issue moves from one job to another i.e. one day say Table1 had issue while extraction, and ...
by rohanf
Tue Mar 16, 2010 6:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Records not getting extracted from Oracle
Replies: 7
Views: 3445

Records not getting extracted from Oracle

Hi Sainath, We are doing a full extract everytime. Also apologies, my initial assumption of records belonging to a particular time frame was wrong, it was based on looking at a sample of data. Moreover to add to my previous post, we have also checked and confirmed that there were no parallel Update ...
by rohanf
Tue Mar 16, 2010 4:19 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Records not getting extracted from Oracle
Replies: 7
Views: 3445

Records not getting extracted from Oracle

Hi, We have a strange issue that has come up as soon as we switched to a new database. We have simple extraction jobs with design as below:- Oracle Enterprise -----> Copy (Force = True) -----> Dataset However when we run these there are a few records that do not get extracted. This issue moves from ...
by rohanf
Fri Jan 22, 2010 2:13 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Surrogate Stage causing job to hang
Replies: 2
Views: 2197

Surrogate Stage causing job to hang

Hi, I am facing a strange issue. When we run the job(having the surrogate stage) in a sequencer the job and the sequencer hangs. When we open the job and view performance stats, All records seem to stop at the surrogate stage and 0 records moving out of the stage. However when we abort the re-starta...
by rohanf
Mon Oct 05, 2009 10:03 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Euro Symbol not populating in Oracle
Replies: 6
Views: 5454

Euro Symbol not populating in Oracle

I am still having this issue.
Can anybody please help.

Regards
Rohan
by rohanf
Wed Sep 23, 2009 7:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Euro Symbol not populating in Oracle
Replies: 6
Views: 5454

Euro Symbol not populating in Oracle

In Datastage the NLS is set in dsenv as below:
export NLS_LANG=american_america.WE8ISO8859P15

In Oracle the Character set used is = "UTF - 8"
by rohanf
Mon Jun 01, 2009 4:30 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Pre partitioned - sorted Dataset read Very slow
Replies: 8
Views: 4379

Correct!

In the previous extraction job below are the steps performed:-

1: Sorting at oracle side using order by( on say K1)
2: Partitioning on datastage side on the same key K1
3: Write to dataset.


Now in the next job my join key is "K1".

Regards
Rohan
by rohanf
Mon Jun 01, 2009 4:05 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Pre partitioned - sorted Dataset read Very slow
Replies: 8
Views: 4379

I assume the inline stable sort option still utilize the scratch disk space. I have restrictions on the scratch space size as well. This is the reason I had sorted at Oracle side in my extraction step to generate this Partitioned and sorted dataset. However I assume the "Don't sort previously s...
by rohanf
Mon Jun 01, 2009 3:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Pre partitioned - sorted Dataset read Very slow
Replies: 8
Views: 4379

The stages after join in order is as below:

1: Filter (For capturing error failures)
2: Lookup
3: Transfomer
4: Surrogate key stage
5: Target dataset


Tell me if more info is needed.

Thanks & Regards
Rohan[/img]
by rohanf
Mon Jun 01, 2009 3:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Pre partitioned - sorted Dataset read Very slow
Replies: 8
Views: 4379

Pre partitioned - sorted Dataset read Very slow

Hi, I have Partitioned and sorted data in a dataset with approximately 26 Million records. When using the same dataset as a source in another job and not changing the Partition or sort order, i.e. using same partinioning as below:- Dataset(Set) ------>Join(Same Partitioning) For a very long time the...
by rohanf
Fri May 29, 2009 12:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle sort in Parallel jobs
Replies: 3
Views: 1735

Oracle sort in Parallel jobs

Hi miwinter, Does the Stable sort option not consume the scratch disk space if the data is already sorted? My problem is also the amount of space required for scratch disk in case 26 million recods are put into the scratch disk. However note that, I have tried what Ray had suggested, sorting on Orac...