Search found 41 matches
- Wed Mar 09, 2011 10:31 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Pivoting Dynamic number of columns
- Replies: 5
- Views: 3398
Pivoting Dynamic number of columns
Hi, I'm trying to obtain the below output. The below input sample comes in a csv file. I'm using V8.1 Input col1,col2,col3,col4,col3,col4 a,b,x1,y1,x2,y2 q,w,r,s Output a,b,x1,y1 a,b,x2,y2 q,w,r,s This is a case of pivoting but the set of col3,col4 may repeat any number of times. The column names co...
- Thu Feb 10, 2011 11:26 pm
- Forum: General
- Topic: Code Quality Tool for DataStage
- Replies: 6
- Views: 6887
Code Quality Tool for DataStage
Hi,
Is there any tool which determines the Quality of the Code for DataStage jobs.
The Client insists there is but we are not aware.
Thanks
Is there any tool which determines the Quality of the Code for DataStage jobs.
The Client insists there is but we are not aware.
Thanks
- Thu Jun 11, 2009 4:17 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Reduce time taken to read data/rows from sql table
- Replies: 2
- Views: 1185
Reduce time taken to read data/rows from sql table
Hi, I'm trying to read data from 1 SQL table in the DataStage parallel job and write it to a Sequential File. However it is taking around 2hrs of time for this process with near 760,000 records data (there is no transformer stage-just an ODBC stage, copy stage and the output Sequential stage). The o...
- Sat Nov 29, 2008 7:28 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Can a mail be generated reporting that the server is down?
- Replies: 5
- Views: 1706
- Sat Nov 29, 2008 7:08 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Abort a job when data in a link has reached some threshold
- Replies: 4
- Views: 1081
If you only have a percentage as input then you cannot do this from within the job unless you know how many rows you are going to get. Then you can compute the trigger number of rows and make a reject ... Sorry, but I couldn't view your complete response as it was 'Premium Content'. What I understo...
- Sat Nov 29, 2008 7:03 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Generating a mail after loading 10% of data into target
- Replies: 5
- Views: 1453
If the source is a sequential file, you can have DataStage report statistics to the log file, then write a job or script to examine the log file looking for the percentage figures. ... Yes, the source is sequential file. Is a log file created for every job by default or do we have to explicitly set...
- Sat Nov 29, 2008 7:01 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Generating a mail after loading 10% of data into target
- Replies: 5
- Views: 1453
If the source is a sequential file, you can have DataStage report statistics to the log file, then write a job or script to examine the log file looking for the percentage figures. ... Yes, the source is sequential file. Is a log file created for every job by default or do we have to explicitly set...
- Sat Nov 29, 2008 6:14 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Abort a job when data in a link has reached some threshold
- Replies: 4
- Views: 1081
- Sat Nov 29, 2008 3:04 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Abort a job when data in a link has reached some threshold
- Replies: 4
- Views: 1081
Abort a job when data in a link has reached some threshold
Hi,
Is there a possibility to abort a job when the data in a particular link (say error link) has reached a threshold (i.e, 30% of the Input count - assuming the input count is available as a job parameter)
Any help/suggestions are highly appreciated.
Thanks,
DSUser7.
Is there a possibility to abort a job when the data in a particular link (say error link) has reached a threshold (i.e, 30% of the Input count - assuming the input count is available as a job parameter)
Any help/suggestions are highly appreciated.
Thanks,
DSUser7.
- Sat Nov 29, 2008 3:01 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Can a mail be generated reporting that the server is down?
- Replies: 5
- Views: 1706
Can a mail be generated reporting that the server is down?
Hi, In case the DataStage server goes down in the middle of the process (i.e, the jobs/sequences have been triggered for some time), can a mail be generated reporting that the server is down? I think a health check can be done before triggering the jobs and reporting if the DataStage server is down-...
- Sat Nov 29, 2008 2:57 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Generating a mail after loading 10% of data into target
- Replies: 5
- Views: 1453
Generating a mail after loading 10% of data into target
Hi, After loading 10% of data into the target table, can a mail be generated reporting the same while the DataStage parallel job is being running (either through DataStage or through Unix script). Is there such a possibility in DataStage/unix scripting/through routines? Any help/suggestions are high...