Search found 48 matches

by varshanswamy
Thu Aug 25, 2005 4:35 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Multiple Instance of a job
Replies: 6
Views: 3996

Multiple Instance of a job

Hi, I have a particular px job. I have set the multiple instance property for the job. I have 2 seperate shell scripts invoking the same job with different parameters . I want to run the jobs in parallel through these 2 shell scripts but i see that one of the jobs fails where as the other one runs f...
by varshanswamy
Wed Aug 24, 2005 7:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Equivalent of first and last functions in sql in datastage
Replies: 6
Views: 3745

Grouping and summing are the preserve of the Aggregator stage (though it can be done more clumsily in a Transformer stage). Many other aggregate functions are available but First and Last are not among them. You therefore have two options; to use a Transformer stage and perform your change detectio...
by varshanswamy
Tue Aug 23, 2005 4:19 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Equivalent of first and last functions in sql in datastage
Replies: 6
Views: 3745

Equivalent of first and last functions in sql in datastage

Hi, something equivalent of the below SQL select first(agent), last(nav_path), sum(page_cnt) sum(tot_file_size_num), web_site_id, event_session_id from sessn_event group by web_site_id, event_session_id is there any stage using which I can convert this sql into into a datastage PX job Because I have...
by varshanswamy
Mon Jun 13, 2005 3:15 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Make Vector Stage
Replies: 5
Views: 2851

Type: String The beginning part of the name of the series of consecutively numbered columns (named like xxxyyy0 to xxxyyyn) to be combined into a vector called xxxyyy. This is taken right from Designer, the information box describing the "Column's Common Partial Name". If your input field...
by varshanswamy
Sat Jun 11, 2005 3:37 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Make Vector Stage
Replies: 5
Views: 2851

Make Vector Stage

Hi,

I have tried using the make vector stage, but the job gets aborted
I have a sequential file ans input send it to a make vector stage and later
again send it another sequential file, I have tried out the exaple given in
Parallel Extender Guide, but it does'nt seem to work

regards,
varsha
by varshanswamy
Sat Jun 11, 2005 2:37 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: problem with handling nulls with timestamp field
Replies: 4
Views: 1763

In the transitional definition don't specify that the target column is nullable, and handle the incoming null so that it is replaced with a default value (or dropped). Eloborating on this I have read it as a timestamp field in datastage and handled it in a transformer, but the transformer slows the...
by varshanswamy
Fri Jun 10, 2005 2:57 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: problem with handling nulls with timestamp field
Replies: 4
Views: 1763

problem with handling nulls with timestamp field

Hi,

I have a table which has a date column which can have a null value.
How do I use the modify stage to handle this the timestamp field.
and

regards,
varsha
by varshanswamy
Wed Jun 08, 2005 1:28 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Pivot Stage
Replies: 7
Views: 2999

ray.wurlod wrote:What does your support provider say?
Have you provided them with a reproducible test case?
I dont understand the meaning of this, what is the meaning of reproducible test case
by varshanswamy
Tue Jun 07, 2005 11:59 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Pivot Stage
Replies: 7
Views: 2999

Pivot Stage

Hi,

I have seen something strange in pivot stage.
The pivot stage does'nt work if it has any of the columns, either the key or the subsequent columns as decimal, but if converted to bigint it works.
Why is it so.

regards,
varsha
by varshanswamy
Mon Jun 06, 2005 5:53 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Boosting the Performance of the job
Replies: 8
Views: 2612

When you select, ORDER BY the pivot keys. This will help a little. The only other suggestion I can make is to capture performance statistics for the Pivot and Transformer stages; this will highlight any "hot spots". For example, how complex are your Transformations? Statistics gathering i...
by varshanswamy
Mon Jun 06, 2005 10:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Boosting the Performance of the job
Replies: 8
Views: 2612

As suggessted by Ray, avoid using subquery and it will improve the performance. Why do you want to use this subquery? This can be achieved in a simple join itself. Regards Saravanan I have split the entire process the process which is selecting the data is and putting it into a dataset. Later anoth...
by varshanswamy
Fri Jun 03, 2005 4:34 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Boosting the Performance of the job
Replies: 8
Views: 2612

Boosting the Performance of the job

Hi, I have a job which has an input of 380000 records, consists of the input sql query as follows SELECT A.ACCESS_KEY, A.START_DT_TM, A.QRY_STRNG_TEXT FROM ACCES_EVENT A WHERE A.START_DT_TM >= TO_DATE(#LOGDTTM#,'YYYYMMDD') AND A.START_DT_TM < (TO_DATE(#LOGDTTM#,'YYYYMMDD')+1) AND EXISTS ( SELECT WEB...
by varshanswamy
Tue May 31, 2005 6:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: reading variable length data
Replies: 12
Views: 4159

ray.wurlod wrote:If you can figure out some way of loading everything after field 1 into a variable-length vector, the Split Vector stage will do exactly what you want.
I would like to know what is a variable length vector
by varshanswamy
Tue May 31, 2005 10:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: reading variable length data
Replies: 12
Views: 4159

reading variable length data

Hi, I have a sequential file, the file has varaible length data, with each line which does not have the number of columns fixed. for example 1|12345|abcd|abef|1a 2|3456| 3|123456|abcde|abef|1a|12457 I would like to use PX and convert this information as follows 1,12345 1,abcd 1,abef 1,1a 2,3456 3,12...
by varshanswamy
Fri May 20, 2005 12:46 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: $APT_ORACLE_LOAD_OPTIONS
Replies: 0
Views: 1054

$APT_ORACLE_LOAD_OPTIONS

I would like to use DataStage to load a job,
such that it invokes a SQL* Loader, as it gives in detail, which data
was nnot laoded because of null in it, or which data got loaded as there
was duplicate data in it.
Could any one help me with the use of the
$APT_ORACLE_LOAD_OPTIONS also.