Search found 48 matches
- Thu Aug 25, 2005 4:35 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Multiple Instance of a job
- Replies: 6
- Views: 3996
Multiple Instance of a job
Hi, I have a particular px job. I have set the multiple instance property for the job. I have 2 seperate shell scripts invoking the same job with different parameters . I want to run the jobs in parallel through these 2 shell scripts but i see that one of the jobs fails where as the other one runs f...
- Wed Aug 24, 2005 7:56 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Equivalent of first and last functions in sql in datastage
- Replies: 6
- Views: 3745
Grouping and summing are the preserve of the Aggregator stage (though it can be done more clumsily in a Transformer stage). Many other aggregate functions are available but First and Last are not among them. You therefore have two options; to use a Transformer stage and perform your change detectio...
- Tue Aug 23, 2005 4:19 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Equivalent of first and last functions in sql in datastage
- Replies: 6
- Views: 3745
Equivalent of first and last functions in sql in datastage
Hi, something equivalent of the below SQL select first(agent), last(nav_path), sum(page_cnt) sum(tot_file_size_num), web_site_id, event_session_id from sessn_event group by web_site_id, event_session_id is there any stage using which I can convert this sql into into a datastage PX job Because I have...
- Mon Jun 13, 2005 3:15 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Make Vector Stage
- Replies: 5
- Views: 2851
- Sat Jun 11, 2005 3:37 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Make Vector Stage
- Replies: 5
- Views: 2851
Make Vector Stage
Hi,
I have tried using the make vector stage, but the job gets aborted
I have a sequential file ans input send it to a make vector stage and later
again send it another sequential file, I have tried out the exaple given in
Parallel Extender Guide, but it does'nt seem to work
regards,
varsha
I have tried using the make vector stage, but the job gets aborted
I have a sequential file ans input send it to a make vector stage and later
again send it another sequential file, I have tried out the exaple given in
Parallel Extender Guide, but it does'nt seem to work
regards,
varsha
- Sat Jun 11, 2005 2:37 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: problem with handling nulls with timestamp field
- Replies: 4
- Views: 1763
In the transitional definition don't specify that the target column is nullable, and handle the incoming null so that it is replaced with a default value (or dropped). Eloborating on this I have read it as a timestamp field in datastage and handled it in a transformer, but the transformer slows the...
- Fri Jun 10, 2005 2:57 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: problem with handling nulls with timestamp field
- Replies: 4
- Views: 1763
problem with handling nulls with timestamp field
Hi,
I have a table which has a date column which can have a null value.
How do I use the modify stage to handle this the timestamp field.
and
regards,
varsha
I have a table which has a date column which can have a null value.
How do I use the modify stage to handle this the timestamp field.
and
regards,
varsha
- Wed Jun 08, 2005 1:28 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Pivot Stage
- Replies: 7
- Views: 2999
- Tue Jun 07, 2005 11:59 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Pivot Stage
- Replies: 7
- Views: 2999
Pivot Stage
Hi,
I have seen something strange in pivot stage.
The pivot stage does'nt work if it has any of the columns, either the key or the subsequent columns as decimal, but if converted to bigint it works.
Why is it so.
regards,
varsha
I have seen something strange in pivot stage.
The pivot stage does'nt work if it has any of the columns, either the key or the subsequent columns as decimal, but if converted to bigint it works.
Why is it so.
regards,
varsha
- Mon Jun 06, 2005 5:53 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Boosting the Performance of the job
- Replies: 8
- Views: 2612
- Mon Jun 06, 2005 10:09 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Boosting the Performance of the job
- Replies: 8
- Views: 2612
As suggessted by Ray, avoid using subquery and it will improve the performance. Why do you want to use this subquery? This can be achieved in a simple join itself. Regards Saravanan I have split the entire process the process which is selecting the data is and putting it into a dataset. Later anoth...
- Fri Jun 03, 2005 4:34 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Boosting the Performance of the job
- Replies: 8
- Views: 2612
Boosting the Performance of the job
Hi, I have a job which has an input of 380000 records, consists of the input sql query as follows SELECT A.ACCESS_KEY, A.START_DT_TM, A.QRY_STRNG_TEXT FROM ACCES_EVENT A WHERE A.START_DT_TM >= TO_DATE(#LOGDTTM#,'YYYYMMDD') AND A.START_DT_TM < (TO_DATE(#LOGDTTM#,'YYYYMMDD')+1) AND EXISTS ( SELECT WEB...
- Tue May 31, 2005 6:45 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: reading variable length data
- Replies: 12
- Views: 4159
- Tue May 31, 2005 10:57 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: reading variable length data
- Replies: 12
- Views: 4159
reading variable length data
Hi, I have a sequential file, the file has varaible length data, with each line which does not have the number of columns fixed. for example 1|12345|abcd|abef|1a 2|3456| 3|123456|abcde|abef|1a|12457 I would like to use PX and convert this information as follows 1,12345 1,abcd 1,abef 1,1a 2,3456 3,12...
- Fri May 20, 2005 12:46 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: $APT_ORACLE_LOAD_OPTIONS
- Replies: 0
- Views: 1054
$APT_ORACLE_LOAD_OPTIONS
I would like to use DataStage to load a job,
such that it invokes a SQL* Loader, as it gives in detail, which data
was nnot laoded because of null in it, or which data got loaded as there
was duplicate data in it.
Could any one help me with the use of the
$APT_ORACLE_LOAD_OPTIONS also.
such that it invokes a SQL* Loader, as it gives in detail, which data
was nnot laoded because of null in it, or which data got loaded as there
was duplicate data in it.
Could any one help me with the use of the
$APT_ORACLE_LOAD_OPTIONS also.