Search found 111 matches

by eph
Mon Feb 18, 2013 9:13 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Decimal Places getting truncated while moving data
Replies: 19
Views: 6499

Hi,

You could try APT_DECIMAL_INTERM_PRECISION and APT_DECIMAL_INTERM_SCALE to set at project level those properties.

Eric
by eph
Tue Feb 12, 2013 7:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: max how many stages we can use in single parallel job
Replies: 4
Views: 3280

Hi,

According to IBM, it is a best practice to keep that number under 30, for readability, easy debug and server load.

You can use more of course.

Eric
by eph
Mon Feb 11, 2013 2:52 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Fixed width ASCII file - Chinese Chars
Replies: 6
Views: 3023

Hi,

I don't think this is possible as noted in this technote :
http://www-01.ibm.com/support/docview.w ... wg21485843
Hence, a fixed length text file is not possible to generate with UTF-8.
Maybe someone else could give you a way to do it.

Eric
by eph
Fri Feb 08, 2013 11:24 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Fixed width ASCII file - Chinese Chars
Replies: 6
Views: 3023

Hi, I suggest you take a look at this technote (which is also true for 9.1 and for any application/program) : http://www-01.ibm.com/support/docview.wss?uid=swg21455000 It is definitely not possible to read a fixed length file using an unfixed character set length (like all UTF-xx). You should use on...
by eph
Mon Feb 04, 2013 10:55 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: handling non-english characters that is part of a string
Replies: 4
Views: 6342

Hi, You string contains 43 characters, whereas it is a 45 bytes string (in utf8 characters are coded on 1 or 2 bytes according to their position in the charset table). It seems that DS is counting the bytes, whereas your DB count in char. Maybe sybase has a similar command as Oracle's dump, which ca...
by eph
Fri Feb 01, 2013 8:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parallel job reports failure (code 134)
Replies: 8
Views: 8256

Hi, I suggest you to contact your provider/IBM support for more info. You can check this link http://www-01.ibm.com/support/docview.wss?uid=swg1JR30206 (you didn't mention you DS version), or this one http://www-01.ibm.com/support/docview.wss?uid=swg21410927 , which has been provided by IBM to my pr...
by eph
Wed Jan 23, 2013 7:52 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Transformer Derivations
Replies: 4
Views: 3119

Hi,

Maybe a simple click on first derivation+ MAJ=>click on last derivation=>right click=>Copy, then open the parallel transformer=>right click=>Paste Column should do the job.

Eric
by eph
Mon Jan 21, 2013 7:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Schema files - generation
Replies: 3
Views: 2961

First, I realize that I assumed in my answer that you wanted a file and not an import in DS as table definition (which is something different). If you know that most of you tables don't have LOB columns, you can use orchdbutil and process manually for the remaining ones. I updated the script, which ...
by eph
Mon Jan 21, 2013 5:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Schema files - generation
Replies: 3
Views: 2961

Hi, Why don't you use a script calling orchdbutil (which will fail for LOB columns) for each table? or you could build a script to get each table description in a file, then building the table definition by parsing them. I've started to build such script, but it's still a work in progress (for 1 yea...
by eph
Mon Dec 17, 2012 1:37 pm
Forum: General
Topic: Xmeta Database Tuning
Replies: 2
Views: 3469

I forgot to mention those technotes:

http://www-01.ibm.com/support/docview.w ... wg21370048
and
http://www-01.ibm.com/support/docview.w ... wg21407491

It should help you to monitor and reduce the amount of logs.

Eric
by eph
Mon Dec 17, 2012 11:18 am
Forum: General
Topic: Xmeta Database Tuning
Replies: 2
Views: 3469

Hi, Some things I have noticed concerning XMETA (personal experience): - the licensing logs can grow very large (hundred thousands of lines) => those can be purged (CATEGORYNAME_XMETA='0042' in the XMETA.LOGGING_LOGGINGEVENT********* table) - auto purge don't necessary purge aborted jobs' logs and k...
by eph
Tue Nov 13, 2012 7:10 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: JOIN STAGE takes hell lot of time
Replies: 6
Views: 4560

Hi,

Instead of partition and sort on links, you could do it using a sort stage and try to tune the Restrict Memory Usage to an higer value.

Eric
by eph
Fri Oct 26, 2012 6:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generic Data validation
Replies: 6
Views: 5355

Hi,

Couldn't that be possible through Column Import + reject link with use of schema files? That should be pretty generic and manage length/type validation?

Eric
by eph
Tue Oct 09, 2012 10:21 am
Forum: General
Topic: Sequencer with few stage to call multiple parallel
Replies: 7
Views: 2674

Hi,

You could check the UtilityRunJob routine which should be part of /Routines/sdk/Utility to get an idea of how you could handle this scenario.

Regards
Eric
by eph
Thu Sep 27, 2012 4:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parallel routine appears to have a memory leak
Replies: 18
Views: 15288

Hi,

I'm also interested in IBM answer as I have developed some C++ routines that could consume a lot of ram. The only job that consume a lot of ram for little number of rows is using 3-4 times in stages variable a px routine call.

Eric