Search found 111 matches

by greggknight
Wed Feb 23, 2011 10:12 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Performance Statistics of a job
Replies: 5
Views: 4313

Where are you looking, In Designer?
If so are you running an instance of the job?
If so you will not see any statistics for the base job in designer.
by greggknight
Sun Feb 20, 2011 10:35 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Staging into ODBC
Replies: 4
Views: 2274

First if the table is being created on the right server in the correct database with the create table option in the ODBC being used then your connection is good. But looking at your error It says the object cannot be found. This gets me thinking that you are not defining the database in your connect...
by greggknight
Sun Feb 20, 2011 10:20 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: same hash file usage in multiple batch jobs
Replies: 10
Views: 4923

Well I beleive the original question was the basic use of hashed files. So I wasn't going into any details of tuning them or utilizing cach. If the question was how to tune a hash file and jobs usinging them I might of elaborated a little bit mor like saying. In order to pre-load a file into cache w...
by greggknight
Sun Feb 20, 2011 9:53 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Junk characters
Replies: 2
Views: 2770

That is the varchar size indicator which is placed in the front of a varchar field. You will see those if you look at the file in an editor but not from within the view data in the seq stage. I had the same thing when I am using the CDC and dropping the data down from DB2 with datamirror to a text f...
by greggknight
Sun Feb 20, 2011 9:46 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Help needed in converting code which is in DS Server routine
Replies: 17
Views: 9865

UNIXcmd = 'cat ':TDPATHbin:'/SurrKeyGen_Index_csv | grep -e ':LogSubject:' | grep -e ':NaturalKeyColumnName' ' CALL DSExecute("UNIX", UNIXcmd, ScreenOutput,ReturnCode) IF ReturnCode = 0 THEN UNIXcmd = 'cat ':TDPATHbin:'/SurrKeyGen_Index_csv | grep -e ':LogSubject:' | grep -e ':NaturalKeyC...
by greggknight
Sun Feb 20, 2011 9:21 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: same hash file usage in multiple batch jobs
Replies: 10
Views: 4923

A hashed file of that size is quite large, Just using it as a lookup in 1 job would require that you tune the building of that hash file for the best performance. Of course this depends on the structure of the record, num of columns and size. Because if you have x amount of jobs reading that same sl...
by greggknight
Sun Feb 20, 2011 12:39 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Need to call a file in Server routine
Replies: 3
Views: 2934

The file and path are passed in the file is read and the value returned. Just a simple one that reads a file with one column and one row. Function(FileName) **FileName = Trim(FilePath):Trim(Company):"_":Trim(TableName):".SKEY.Stat" Call DSLogInfo("FileName:":FileName, &...
by greggknight
Sun Feb 20, 2011 12:20 am
Forum: General
Topic: how to check whether source file is correct or not
Replies: 7
Views: 4373

I agree with kkalyanrao, I recieve trigger files everyday from an external process when they have completed their endday processing which contains an endday number that I use in a where clause to select my data. I use a wait for file and after the file arives and I have read its contents I move the ...
by greggknight
Sun Feb 20, 2011 12:05 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Define New Column
Replies: 6
Views: 5299

Well maybe the interviewer wanted to know if you knew anything about Runtime Column Propagation for Parallel Jobs ??
by greggknight
Sat Feb 19, 2011 9:36 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: node contraints
Replies: 12
Views: 8171

Optimizing parallelism The degree of parallelism of a parallel job is determined by the number of nodes you define when you configure the parallel engine. Parallelism should be optimized for your hardware rather than simply maximized. Increasing parallelism distributes your work load but it also add...
by greggknight
Sat Feb 19, 2011 12:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Heap allocation failed w/ looping
Replies: 4
Views: 4717

Yes I have a call in with IBM for a PMR on this issue. I placed it here because my search only found the one artical that was written containing the new function.There are a couple of other bugs I have found as well. In case anyone is interested.The surrogate key generator produces a warning which c...
by greggknight
Fri Feb 18, 2011 6:32 pm
Forum: General
Topic: Job Reset Issue
Replies: 5
Views: 3590

When A sequence of jobs fails , what is required is that you investigate the Job that failed rerun it and fix the issue THEN you can just execute the sequence and it will start at the last checkpoint.(which is the job that failed and then go on to the remainder of the jobs. It is not meant for jobs ...
by greggknight
Fri Feb 18, 2011 5:14 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Heap allocation failed w/ looping
Replies: 4
Views: 4717

Heap allocation failed w/ looping

I am running 8.5 on 32 bit and 64bit Windows 2008R2 We are using the looping and these new functions SaveInputRecord() GetSavedInputRecord() When we run the job for a small amount of records I can watch memory consumption climb continuosly almost to peek then the job finishes success. When we add mo...
by greggknight
Wed Jul 28, 2010 11:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Null handling in schema file
Replies: 19
Views: 25340

record

{final_delim=end, record_delim='\n', delim=',', null_field="", quote=double}

(

DM_TIMESTAMP:timestamp;

DM_TXID:string;

DM_OPERATION_TYPE:string;

DM_USER:string;

BEFORE_COMPANY:nullable string {null_field=''};

BEFORE_FACDIVN:nullable string {null_field=''};