Search found 500 matches
- Sat Jan 26, 2008 5:13 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Need an optimized solution
- Replies: 4
- Views: 1063
Thanks Ray, In production, I may have a chance to handle more than 5 Millions of records as a result of Extract2. Considering your sugesting, one value(Timestamp from Extract1) would be assigned to all records coming from Extract2 - shows undisirable to be considered as better solution but acceptabl...
- Sat Jan 26, 2008 4:45 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Performance: Remove Duplicates or Transformer?
- Replies: 1
- Views: 596
Performance: Remove Duplicates or Transformer?
All,
Fact: Remove Duplicate Stage functionality can be implemented in a Transformer Stage.
Does this fact quarantee for improvements on execution time consumption or Bulk records handling or any specific options.
Please suggest me to have profound view on this.
Fact: Remove Duplicate Stage functionality can be implemented in a Transformer Stage.
Does this fact quarantee for improvements on execution time consumption or Bulk records handling or any specific options.
Please suggest me to have profound view on this.
- Sat Jan 26, 2008 4:25 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Need an optimized solution
- Replies: 1
- Views: 544
Need an optimized solution
All, Requirement: I have two different queries to be executed in a DB Stage(Oracle) depending upon the value of the user defined parameter(ModeOfSchedule) But the metadata of SQL execution is same. The syntax of the Queries is, Query1:(ModeOfSchedule="MID") Select T1.C1, T1.C2, T2.C3, T3.C...
- Sat Jan 26, 2008 4:02 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Need an optimized solution
- Replies: 4
- Views: 1063
Need an optimized solution
All, Requirement : Extract Col1(DataType:TimeStamp) from Table1 where Col2="<value>". Based on the value of Col1, filter the records while extracting from some other table. In short: I need to pass the execution result of an SQL Query as the value of a Job parameter to the next DS Job havi...
- Fri Jan 25, 2008 12:43 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Partitioning information Needed
- Replies: 4
- Views: 1401
Partitioning information Needed
I have 2 keys to remove duplicate stage. It is partitioned and sorted on these 2 keys. The next stage is a transformer stage, where i have used a same partitioning. From remove duplicate stage to transformer stage I have not propagated one of the key. Question: Will the records of previous partition...
- Tue Jan 22, 2008 1:19 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to count he number of records in a dataset
- Replies: 9
- Views: 12078
This is the sample code. export DSHOME = '/appl/infoserver/Server/DSEngine' export APT_CONFIG_FILE = '/appl/infoserver/Server/Configurations/2node.apt' export APT_ORCHHOME = '/appl/infoserver/Server/PXEngine' export PATH = '%PATH%' : '/appl/infoserver/Server/PXEngine/bin' export ORCHBIN = APT_ORCHHO...
- Mon Jan 14, 2008 9:04 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: xml
- Replies: 1
- Views: 1043
xml
Hi, I am new to Datastage.I have to validate xml against xml schema.In XML guide, it is given that schemaLocation should be given as attribute in the root element of xml document.I have several doubts regarding this. 1)I cant alter the root element of xml input because it is generated by some other ...
- Wed Jan 09, 2008 7:11 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Error during running server routine for setting the path
- Replies: 3
- Views: 1180
Thanks. Just an info...this routine is one of the job activity in seqeucner. No need of setting environment variables. You are right. But when I open the routine in designer and tried to run that error was thrown. But when i ran the sequencer, routine was succesdful. Anyway problem is resolved but j...
- Wed Jan 09, 2008 3:19 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Error during running server routine for setting the path
- Replies: 3
- Views: 1180
Error during running server routine for setting the path
In the routine I am check the record counts in dataset. If there is no record i am returning 1 else I am returning 2. After running my routine I am getting this error. Message to be logged is... > dsrecords /appl/infoserver/Server/Projects/ILOS_Online_Shopping/datasets/OS_vanavailability_001_ex_TMS....
- Wed Jan 09, 2008 12:55 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: XML output Stage repetition columns
- Replies: 2
- Views: 1168
XML output Stage repetition columns
Hi, I need a XML like this below. <GROUP NAME="DPT0001 Users"> <USER>1480000</USER> <USER>1480003</USER> </GROUP> <GROUP NAME="DPT0002 Users"> <USER>1480001</USER> <USER>1480002</USER> <USER>1480005</USER> </GROUP> . . Also Please note number of Group name (ex:DPT001 Users) recor...
- Sat Dec 29, 2007 12:24 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: XML parsing...removal of parent element
- Replies: 1
- Views: 1024
XML parsing...removal of parent element
Hi Scenario: I am generating a XML chunk as below My job looks like this... DS | \|/ transformer | \|/ XMLputput1 | Lookup --->XMLputput3 /|\ | transformer /|\ | XMLoutput2 /|\ | DS XMloutput 1: header XML XMLoutput 2: Chunk XML generation XMLoutput :Final XML generation <Order> <LineItem> <a> <b> <...
- Wed Dec 26, 2007 3:15 am
- Forum: General
- Topic: XML input stage
- Replies: 2
- Views: 1048
XML input stage
I have to validate an xml input in xml input stage and reject the xml if it is not well formed ,i am getting xml from a sequential stage , if i try to reject that xml its giving a fatal error called record is too big to fit in a block.max block length is ...
- Tue Dec 25, 2007 6:58 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Previous instance status
- Replies: 5
- Views: 1532
- Sat Dec 22, 2007 2:17 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Previous instance status
- Replies: 5
- Views: 1532
Thanks. As per the document, it says this command will wait until the sequencer finishes its task and then it returns the exit code. But I want the status of the job immediately so that I will check the status; if it is running I will wait for 1 more minute by sleeping and check status, otherwise I ...
- Fri Dec 21, 2007 2:51 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Previous instance status
- Replies: 5
- Views: 1532
Previous instance status
Hi
I want to get the status of previous instance sequencer. If it is success then i need to trigger another instance of sequencer otherwise I should not trigger.
I need to do this logic in shell script.
can anyone help me which API I need to use to find the status of sequencer?
kamal
I want to get the status of previous instance sequencer. If it is success then i need to trigger another instance of sequencer otherwise I should not trigger.
I need to do this logic in shell script.
can anyone help me which API I need to use to find the status of sequencer?
kamal