There is a other way.
You split your input file in 4 small files (for example) and deinfe in the Sequential File stage the File Pattern = FileName*.
Assume your server has 4 nodes, when the job run each node read a one file and processing in parallel mode.
Search found 128 matches
- Thu May 05, 2011 2:11 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to run a sequential file in parallel mode?
- Replies: 6
- Views: 10170
- Fri Mar 25, 2011 1:38 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Loading files into Oracle tables
- Replies: 4
- Views: 5466
Re: Loading files into Oracle tables
Hi Srini You can make 150 jobs to load each table to Oracle, another idea you can group similary table (records) to load in a single job, in this case, you build fewer jobs. Another alternative would be create a single job and use parameters and enabled RCP. Your job must define this parameters 1) S...
- Thu Mar 17, 2011 2:56 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Find Strings in a String Field
- Replies: 13
- Views: 7397
Re: Find Strings in a String Field
Hi swapnilverma, The index function returns the position of a substring within a string, for your case: this select: select xyz from abc WHERE UPPER (DESC) like '% MANGO% ORANGE%' you can use the function as follows: Index (UPPER (DESC) 'MANGO', 1) > 0 and Index (UPPER (DESC) 'ORANGE', 1) > 0 and re...
- Wed Dec 15, 2010 11:33 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Tunning UPSERT using Oracle Connector Stage
- Replies: 11
- Views: 12510
Table size
Hi SwathiCh, Did you consider the size of the table in both environments? maybe in the production environment is more larger than the environments where you do the tests. The indexes also may be causing the load to be heavy. The upsert process involves running insert-update or update-insert, which o...
- Thu Nov 18, 2010 12:38 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Lookup Allowing dups..
- Replies: 4
- Views: 3932
Re: Lookup Allowing dups..
Hi Ray,
I check in the lookup stage and there isn't an option to define this features, and the plugin database is the same.
Can you tell us where is the option.
Thanks
I check in the lookup stage and there isn't an option to define this features, and the plugin database is the same.
Can you tell us where is the option.
Thanks
- Fri May 28, 2010 4:04 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Performace statistics inside the Containers
- Replies: 1
- Views: 1601
Performace statistics inside the Containers
Hi Forum :wink: In my jobs developed in the DataStage version 7.5.2 the statistics could be viewed inside the container stage, but in the version 8 this featured don't work, in the designer canvas thats work fine, but dont inside the container. Do i need to configure some property? Because the Show ...
- Fri May 28, 2010 7:21 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Dataset schema is disordered
- Replies: 3
- Views: 3125
- Thu May 27, 2010 7:15 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Dataset schema is disordered
- Replies: 3
- Views: 3125
Dataset schema is disordered
Hi Forum, I'm using a virtual machine running Linux and my job is reading a sequential file as bulk, one field defined as varchar (1000), and parsing the fields with column import stage. The next stage is a Transformer and finally write in a dataset. The parsing convert the input field in 3 new fiel...
- Tue Nov 10, 2009 9:52 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Unable to initialize plug-in
- Replies: 33
- Views: 26746
Re: Unable to initialize plug-in
RAI
you must to check if your datastage user have permissions on the oracle directory
you have to add the oracle group in the ds user, without that permissions you can't access to the oracle libraries.
apply this and tell us the results.
:D
you must to check if your datastage user have permissions on the oracle directory
you have to add the oracle group in the ds user, without that permissions you can't access to the oracle libraries.
apply this and tell us the results.
:D
- Thu Sep 17, 2009 10:50 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Constraint in Transformer not working Please help!!
- Replies: 5
- Views: 2805
Re: Constraint in Transformer not working Please help!!
Hi harsh_cs31, :D Is NLS installed in your server? When you import the metadata, what utilily do you used? odbc table definitions? If your field are Char you must apply Trim before the compare, in Varchar doesnt' needed. Please check the column Extend in the field definitions and blank the value, be...
- Wed Aug 19, 2009 3:34 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: aggregator issue
- Replies: 4
- Views: 3677
Hi cparru, :wink: The aggregator stage only accept numeric fields (integer, decimal, float, ect), and the result is dfloat, always, so, you must to make a conversion to the source field. Example: 2009-08-10 08:19:01 convert to 20090810081901. with this number you must to apply the MAX. The result mu...
- Wed Jul 22, 2009 9:34 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Invalid Close Command
- Replies: 4
- Views: 3285
Re: Invalid Close Command
Hi Suresh Nair What make your stored???? I was searching in the web and find the next link, may be you try to check this operation in your db.. Run this query in your db client ans review the results: select object_name, object_type from user_objects where object_name='<object name>'; you must to ch...
- Wed Jun 03, 2009 2:22 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Fresh Install...Compile problem with transformer
- Replies: 16
- Views: 14914
kaps in your post this messages appear ##W TBLD 000000 14:49:35(013) <main_program> Error when checking composite operator: Output from subprocess: sh: /usr/vacpp/bin/xlC_r: not found this file /usr/vacpp/bin/xlC_r exists in that path??? so, in the instalation guide appear the compiler certified by ...
- Tue Jun 02, 2009 4:52 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Fresh Install...Compile problem with transformer
- Replies: 16
- Views: 14914
Re: Fresh Install...Compile problem with transformer
Hi kaps,
Did you check the version for the compiler and the operating system??
Which OS and compiler are you installing??
I think that is a path problem, but i was expect for your answer to check.
Did you check the version for the compiler and the operating system??
Which OS and compiler are you installing??
I think that is a path problem, but i was expect for your answer to check.
- Fri Feb 27, 2009 4:56 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Problem with routine result and format insert
- Replies: 7
- Views: 3954
Hi Craig, 8) Thanks for your help, i was searching in the forum and found an old post about the date format with NLS. That post was similar with my case and check the procedure and found the answer... I verify the NLS Configuration in the administrator, and the Local Setting for Server jobs was US-E...