Search found 41 matches

by dsuser7
Wed Mar 09, 2011 10:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Pivoting Dynamic number of columns
Replies: 5
Views: 3398

Pivoting Dynamic number of columns

Hi, I'm trying to obtain the below output. The below input sample comes in a csv file. I'm using V8.1 Input col1,col2,col3,col4,col3,col4 a,b,x1,y1,x2,y2 q,w,r,s Output a,b,x1,y1 a,b,x2,y2 q,w,r,s This is a case of pivoting but the set of col3,col4 may repeat any number of times. The column names co...
by dsuser7
Thu Feb 10, 2011 11:26 pm
Forum: General
Topic: Code Quality Tool for DataStage
Replies: 6
Views: 6887

Code Quality Tool for DataStage

Hi,

Is there any tool which determines the Quality of the Code for DataStage jobs.

The Client insists there is but we are not aware.

Thanks
by dsuser7
Thu Jun 11, 2009 4:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reduce time taken to read data/rows from sql table
Replies: 2
Views: 1185

Reduce time taken to read data/rows from sql table

Hi, I'm trying to read data from 1 SQL table in the DataStage parallel job and write it to a Sequential File. However it is taking around 2hrs of time for this process with near 760,000 records data (there is no transformer stage-just an ODBC stage, copy stage and the output Sequential stage). The o...
by dsuser7
Sat Nov 29, 2008 7:28 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Can a mail be generated reporting that the server is down?
Replies: 5
Views: 1706

There are numerous ways to do this. How about an hourly "AT" scheduled batch script that starts a small DS job and then checks the error code / status. If the status is invalid then send a mail. ... Forgive my ignorance, but can you please explain me, what an hourly "AT" schedul...
by dsuser7
Sat Nov 29, 2008 7:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Abort a job when data in a link has reached some threshold
Replies: 4
Views: 1081

If you only have a percentage as input then you cannot do this from within the job unless you know how many rows you are going to get. Then you can compute the trigger number of rows and make a reject ... Sorry, but I couldn't view your complete response as it was 'Premium Content'. What I understo...
by dsuser7
Sat Nov 29, 2008 7:03 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generating a mail after loading 10% of data into target
Replies: 5
Views: 1453

If the source is a sequential file, you can have DataStage report statistics to the log file, then write a job or script to examine the log file looking for the percentage figures. ... Yes, the source is sequential file. Is a log file created for every job by default or do we have to explicitly set...
by dsuser7
Sat Nov 29, 2008 7:01 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generating a mail after loading 10% of data into target
Replies: 5
Views: 1453

If the source is a sequential file, you can have DataStage report statistics to the log file, then write a job or script to examine the log file looking for the percentage figures. ... Yes, the source is sequential file. Is a log file created for every job by default or do we have to explicitly set...
by dsuser7
Sat Nov 29, 2008 6:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Abort a job when data in a link has reached some threshold
Replies: 4
Views: 1081

Yes, look at your Transform stage and the setting for "Abort after rows" ... But AndrW, the setting- Abort after rows will take only numerals...I mean I wouldn't be able to use a parameter there. But as the count of records in the input file is dynamic, I wouldn't be able to hardcode the ...
by dsuser7
Sat Nov 29, 2008 3:04 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Abort a job when data in a link has reached some threshold
Replies: 4
Views: 1081

Abort a job when data in a link has reached some threshold

Hi,

Is there a possibility to abort a job when the data in a particular link (say error link) has reached a threshold (i.e, 30% of the Input count - assuming the input count is available as a job parameter)

Any help/suggestions are highly appreciated.

Thanks,
DSUser7.
by dsuser7
Sat Nov 29, 2008 3:01 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Can a mail be generated reporting that the server is down?
Replies: 5
Views: 1706

Can a mail be generated reporting that the server is down?

Hi, In case the DataStage server goes down in the middle of the process (i.e, the jobs/sequences have been triggered for some time), can a mail be generated reporting that the server is down? I think a health check can be done before triggering the jobs and reporting if the DataStage server is down-...
by dsuser7
Sat Nov 29, 2008 2:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generating a mail after loading 10% of data into target
Replies: 5
Views: 1453

Generating a mail after loading 10% of data into target

Hi, After loading 10% of data into the target table, can a mail be generated reporting the same while the DataStage parallel job is being running (either through DataStage or through Unix script). Is there such a possibility in DataStage/unix scripting/through routines? Any help/suggestions are high...