Search found 120 matches

by highpoint
Sun Jan 30, 2011 2:02 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Best Delimiter to use
Replies: 4
Views: 3918

ray.wurlod wrote:The best delimiter is any character that does not occur in the data. As noted, this might be a non-printing character, such as tab or Ctrl-Y.
How to check for Ctrl-Y in datastage transformer logic.

Appreciate reply.
by highpoint
Sun Jan 30, 2011 1:14 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Best Delimiter to use
Replies: 4
Views: 3918

Best Delimiter to use

Hi, We are designing a job. Input is a file. Its our choice to choose which delimiter we like for the input file. We thought of using "|" as delimiter. But found that data can also have "|' in it. We dont know how the data will be. Is there any delimiter specific to datastage. If not ...
by highpoint
Sun Jan 16, 2011 2:10 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Help to use correct partitioning
Replies: 6
Views: 3066

My company doesn't like demoting messages and also does not accept any warnings.

Auto partitioning is working fine. But will the data be always correct using auto partitioning??


And also how do i check auto is giving me which partitioning.

Appreciate your reply.
by highpoint
Sun Jan 16, 2011 1:12 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Help to use correct partitioning
Replies: 6
Views: 3066

This is an unusual message. What is your Transformer stage doing? Can you please post the exact, and entire, message, so we can be certain before offering advice? (Auto) will probably achive optimum partitioning in this job design. I'm only curious about where it thinks that Entire might be appropr...
by highpoint
Sat Jan 15, 2011 10:44 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Help to use correct partitioning
Replies: 6
Views: 3066

Help to use correct partitioning

Hi, I have job with many stages. Here is where i need some help. Sort -> Transformer -> Aggregator --> Transformer --> Pivot Currently in the sort stage i am sorting on key field "Product_ID" All the stages are using the Auto partitioning. I would like to performance tune the job. I tried ...
by highpoint
Mon Oct 18, 2010 2:41 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: TimeStamp Null handling
Replies: 1
Views: 1972

TimeStamp Null handling

I have source column as "TimeStamp". I was getting warning as : APT_CombinedOperatorController(1),0: Field 'Col1' from input dataset '0' is NULL. Record dropped. by going through forumn tried using NullToEmpty and StringtoTimestamp function, Now getting following Warning: Conversion error ...
by highpoint
Mon Oct 11, 2010 2:03 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Count of records processed
Replies: 3
Views: 1759

Count of records processed

Hi, My source is Sequential file. Target is a dataset and ODBC(oracle table). All the records that meet conditions in source file are processed and loaded in dataset. The odbc stage(oracle table) should be loaded with the count of number of records that made to dataset. I am not getting idea to do t...
by highpoint
Wed Sep 15, 2010 3:09 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Handling invalid data in data column
Replies: 5
Views: 3259

Re: Handling invalid data in data column

sivanagu wrote:Hi,

How the wierd data is allowing to load in source table even the column defined as date.
That what we dont know. But we need to handle it in our code no matter what is the source sending.
by highpoint
Wed Sep 15, 2010 8:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Handling invalid data in data column
Replies: 5
Views: 3259

What's the default Oracle date picture? Could bad data actually have been stored in the table by any means? Yes, bad data is present in table. But the job is failing, we want the job to handle this by making it to a default value or anything like that. I tried using the ISvalid() then also that par...
by highpoint
Tue Sep 14, 2010 10:00 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Handling invalid data in data column
Replies: 5
Views: 3259

Handling invalid data in data column

Hi, We are reading from the source view with the datatype as "Date" whereas the column is defined as timestamp in datastage. The job has been working for a long time.But recently we started getting issue. The problem is this column is getting is some wierd data. We implemented the ISValid(...
by highpoint
Sun Sep 05, 2010 1:03 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Replacing .csv file with XML
Replies: 0
Views: 973

Replacing .csv file with XML

Hi, I am new to XML file stages in datastage. I am currently using a .csv file to do lookup and would like to use an xml as input due requirement changes. Would appreciate if any one can give me the following details: 1) Do i need a single file xml file with all columns or multiple file with one col...
by highpoint
Thu Sep 02, 2010 8:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: NullToEmtpy Issue
Replies: 3
Views: 2532

NullToEmtpy Issue

Hi, I always seems to have problem with NullToEmpty function. In the current scenario both all the source and target columns are varchar. The NulltoEmpty does not work and seems to act differently in different jobs. If col1=100 then Nulltoempty(col2) else'' The below always work. If col1=100 and isn...
by highpoint
Tue Aug 31, 2010 10:49 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: 2 ODBC Stages Open command not deleting each other's data.
Replies: 11
Views: 4210

Delete are being accomplished using the sql delete command some thing like this:

Delete from table where col=abc;

Appreciate reply.
by highpoint
Tue Aug 31, 2010 4:42 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: 2 ODBC Stages Open command not deleting each other's data.
Replies: 11
Views: 4210

Nothing's different in DataStage - it's just another client as far as the database is concerned. If you issue two DELETE statements on the same table, the first to start executing will take an exclusive table lock and the second will wait until that lock is released (or a timeout error occurs). So,...
by highpoint
Tue Aug 31, 2010 9:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: 2 ODBC Stages Open command not deleting each other's data.
Replies: 11
Views: 4210

chulett wrote:Too may variables with your current approach. Why not do the delete / truncate as a separate operation before this job runs?
Shall we do it in before job sub routine.
If so do we have to write a seperate shell for this?

Or is there any other way to achieve this.?