Search found 49 matches
- Wed Feb 25, 2015 9:11 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: xml stage JVM issue
- Replies: 0
- Views: 1362
xml stage JVM issue
Hi, I am reading a xml file using xml stage and getting below waring and error XML_Validate,0: JVMDUMP006I Processing dump event "systhrow", detail "java/lang/OutOfMemoryError" - please wait. XML_Validate,0: JVMDUMP032I JVM requested Heap dump using I kept the heap size as 512MB ...
- Tue Feb 24, 2015 8:32 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Issue with Job run with XML stage
- Replies: 2
- Views: 3064
- Tue Feb 17, 2015 2:31 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Time-out Error with XML stage in DataStage 8.5
- Replies: 4
- Views: 4128
Re: Time-out Error with XML stage in DataStage 8.5
Hi,
Faced the same issue. Just restarted the seq and it's ran well.
Faced the same issue. Just restarted the seq and it's ran well.
- Wed Feb 11, 2015 4:35 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Issue with Job run with XML stage
- Replies: 2
- Views: 3064
Issue with Job run with XML stage
Hi, I have a job with xml stage as source. Job is running fine but when running from seq its giving below error main_program: Syntax error: Error in "pxbridge" operator: Error in input redirection: Expected input name, got: "?", line 11; text: <? earlier was running seq with id1 ...
- Mon Feb 09, 2015 10:55 am
- Forum: General
- Topic: Execute command activity output is not working
- Replies: 3
- Views: 3713
Hi Chulett, your reply worked :D I gave like this in execute command ls -lrt /path/*RATEE*.xml | wc -l > /dev/null Trigger condition File Missing Trim(ExecFileCheck.$CommandOutput,@FM) <> '' File Present Trim(ExecFileCheck.$CommandOutput,@FM) = '' Above Trigger condition gave correct output, Not sur...
- Mon Feb 09, 2015 3:45 am
- Forum: General
- Topic: Execute command activity output is not working
- Replies: 3
- Views: 3713
Execute command activity output is not working
Hi, I have seen many post but still not working for me. I just need to see if file is not present in directory need not to run job and send mail. I am checking as below In seq in execute command actvity ls -lrt /Path/*ABC*.xml | wc -l in trigger section am checking like this for no file Trim(ExecFil...
- Tue Apr 08, 2014 1:44 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: how to get max performance using upsert mode?
- Replies: 4
- Views: 2495
Re: how to get max performance using upsert mode?
Hi Sura,
Did you found the resolution.
I am also facing the same issue in insert then update job.
Did you found the resolution.
I am also facing the same issue in insert then update job.
- Fri Mar 14, 2014 9:41 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Improve performance of Join of Data Sets
- Replies: 3
- Views: 2799
Hi thompsonp, I am just having join the the job. and its same partition in join. speed is 1400-1600 row/ sec. Also have changed the buffer at join and kept it 6 MB. i/p Meta Data is around 500 bytes and out around 1000 bytes as am having full outer join in the job. earlier it was delete then insert ...
- Fri Mar 14, 2014 1:44 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Improve performance of Join of Data Sets
- Replies: 3
- Views: 2799
Improve performance of Join of Data Sets
Hi All, Even i am also facing the same issue as seen in this post. I have two data set as input to join stage and its extracting only 276 row/sec. below are the details Data Set 1 ----------- Total Records: 19199366 Total 32k Blocks: 19141 Total Bytes: 2430032178 Node Records blocks Bytes Node1 9593...
- Mon Mar 10, 2014 2:58 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Improving performance of deletes
- Replies: 9
- Views: 5205
- Sun Mar 09, 2014 1:18 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Improving performance of deletes
- Replies: 9
- Views: 5205
Re: Improving performance of deletes
Hi All, I am back with the same issue :( . Now job is giving deadlock issue. Let me give details Ds -> Tfm -> DRS connector Ds has single field, on which data is hash partitioned and index is present in table on same field(this field is part of composite key, so composite index is present). In DRS c...
- Fri Feb 21, 2014 5:12 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Improving performance of deletes
- Replies: 9
- Views: 5205
Improving performance of deletes
Thanks chulett for deleting multiple post. :D
Even was not able to find how come multiple post i made
Well yes table is indexed on field one, and am trying to run using DRS connector in place of oracle connector. will update you if any thing positive as so far facing space issue in DB.
Even was not able to find how come multiple post i made
Well yes table is indexed on field one, and am trying to run using DRS connector in place of oracle connector. will update you if any thing positive as so far facing space issue in DB.
- Wed Feb 19, 2014 6:49 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Improving performance of deletes
- Replies: 9
- Views: 5205
Improving performance of deletes
Hi All, I am facing the same issue as seen here. I have 3.7L record in file which i need to delete from table which contains 90M.I Am using below query DELETE FROM Table WHERE Field1 = ORCHESTRATE.Field1 Design is simple DS -> Tfm -> Oracle connector in designer till connector data is moving as 8779...
- Mon Feb 17, 2014 7:43 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Running Oracle connector in parallel mode
- Replies: 13
- Views: 10716
- Mon Feb 17, 2014 7:05 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Running Oracle connector in parallel mode
- Replies: 13
- Views: 10716
Re: Running Oracle connector in parallel mode
Hi BOB, I added DISTINCT in query and also changed some settings as below Array Size - 40000 PreFetch Row Count - 40000 PreFetch Buffer - 4096 Now job is taking just 4.5 mins, but results are not matching In DS select DISTINCT Field1 from Table giving o/p as 573684 records In Oracle DB select DISTIN...