Search found 172 matches

by mdbatra
Sun Jun 28, 2009 8:27 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Error while reading environment variable
Replies: 13
Views: 5441

Error while reading environment variable

Hi All, I am trying to read an environment variable in transformer but i am getting the following error. Output from transformer compilation follows: ##I IIS-DSEE-TFCN-00001 12:18:00(000) <main_program> IBM WebSphere DataStage Enterprise Edition 8.0.1.4989 Copyright (c) 2001, 2005-2007 IBM Corporati...
by mdbatra
Sun Jun 28, 2009 8:21 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Need help on parallel routines
Replies: 7
Views: 2439

i provided full path for the include statement & it worked.
Thanks !!!
by mdbatra
Wed Jun 24, 2009 10:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Need help on parallel routines
Replies: 7
Views: 2439

Need help on parallel routines

Hi All, i am trying to complie a C++ program to link it to parallel routine. But, there is some problem with the compilation . In administrator, i have: APT_COMPILER: /opt/SUNWspro/bin/CC APT_COMPILEROPT: -dalign -O -PIC -librar=iostream -c i am giving the following command for compliling <APT_COMPI...
by mdbatra
Sat May 02, 2009 6:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sortung on voluminous data
Replies: 3
Views: 1104

Actually, the sorting is required in the middle of the job & then some transformation rules to be applied upon.
Don't have third party sorting utilities either :( .
by mdbatra
Fri May 01, 2009 7:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sortung on voluminous data
Replies: 3
Views: 1104

Sortung on voluminous data

Hi, We are processing a data volume of more than 100 million records with each record having 304 columns. The business rules require them to be in a sorted manner. So, any performance improvement suggestion to be incorporated in the sort stage. Tried with keeping "Stable Sort" as False &am...
by mdbatra
Fri Mar 13, 2009 4:05 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading multiple files
Replies: 4
Views: 2985

1. Use "File" property again & again( if file format is identical but not file names)
2. Use "File Pattern" property( if file names are having an identical pattern as well)
by mdbatra
Thu Mar 12, 2009 10:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Providing parameters to all the jobs/Selective jobs
Replies: 3
Views: 1364

Providing parameters to all the jobs/Selective jobs

Hi,
I am defining user-defined variables in administrator. I need to set these variables for all the jobs/Selective jobs in a project, in a single shot, rather than adding from job properties parameters tab.
Any prefered approach !
by mdbatra
Sat Dec 27, 2008 10:19 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Audit File Log -
Replies: 8
Views: 2939

& metadata1... please confirm if that's not what you asked for !
by mdbatra
Sat Dec 27, 2008 10:16 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Audit File Log -
Replies: 8
Views: 2939

I meant.. metadata1 has some idea which DS functions he/she would require to obtain his/her results, as wriiten : It seems that DSgetjobinfo (arg...) and DSgetLinkInfo (arg....) will get it done. The problem aired was where these things need to be specified. Where and How do you actually call/run th...
by mdbatra
Fri Dec 26, 2008 4:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Audit File Log -
Replies: 8
Views: 2939

Hi Craig,
i think the moderator has a bit idea of what he's to use but the heck was , where !
& metadata1, after you know what to specify where, search'll surely assist you for the rest !
by mdbatra
Fri Dec 26, 2008 12:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Audit File Log -
Replies: 8
Views: 2939

For things like Project Name, Job name, start/end time, we can use DSMacros(availaible in transformer). For getting more detailed job information, we can write job control routines(in job properties). 1.)Design your actual job. Whatever additional information you require, pass that as parameters. 2....
by mdbatra
Tue Dec 23, 2008 10:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: CRC32/Checksum
Replies: 11
Views: 4340

well...pardon me for that ! 8)
by mdbatra
Tue Dec 23, 2008 4:11 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: CRC32/Checksum
Replies: 11
Views: 4340

Ok...that's fine !
Thanks
by mdbatra
Tue Dec 23, 2008 2:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: CRC32/Checksum
Replies: 11
Views: 4340

chulett wrote:You are talking about CRC32, not BASIC transformers in Parallel jobs, yes? I seem to recall some of the odd issues you had with it... ...
Yes Craig, i am just asking about how to use CRC32 in a parallel job, but without using a basic transformer.
by mdbatra
Mon Dec 22, 2008 6:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: CRC32/Checksum
Replies: 11
Views: 4340

CRC32/Checksum

I want to generate a unique number for the concatenation of all my columns in the records. We have CRC32/Checksum available in Server Transformer & same in parallel Basic transformer. I can't use a Server job & basic transformer as well. Any other way to acheive the functionality in a parall...