Search found 36 matches

by dsetlteam
Thu Jun 02, 2016 6:21 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: A generic ETL job requirement
Replies: 6
Views: 5593

Hi Guys Thanks so much for the pointers.We brainstormed in between the team here and thought about different ETL solutions, and finally we came to the conclusion to push all the incoming data directly into the target tables by defining all the target fields as varchar. During consumption of the data...
by dsetlteam
Wed Jun 01, 2016 1:54 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: A generic ETL job requirement
Replies: 6
Views: 5593

A generic ETL job requirement

Hi Experts I have a requirement wherein I have to create a generic job that will read from around 200 different delimited files and then populate data into their corresponding target tables (Netezza).Each file metadata is different and the delimiter can be either pipe,tab or comma. The other require...
by dsetlteam
Wed Sep 03, 2014 8:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Unknown error in Datastage
Replies: 7
Views: 10547

We faced the same error recently. Upon analysis, we couldn't find anything concrete so a PMR was raised with IBM. IBM confirmed that the issue is related to Operating System(windows). As of now we are still awaiting their further response and resolution. For reference, below is the error we were get...
by dsetlteam
Mon Jul 07, 2014 1:10 am
Forum: General
Topic: What's the Coolest Feature of DataStage?
Replies: 18
Views: 9696

RCP,Propogate Values property,Multi Instance property,looping in transformer,range lookup.

Version - 9.1
by dsetlteam
Tue Jul 01, 2014 2:46 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Null value on the accessor interfacing to field
Replies: 7
Views: 7649

If there are NULL values in the source column and if it is being TRIM'ed - it throws an error. Try removing the TRIM function and check once.
by dsetlteam
Wed Jun 25, 2014 5:23 am
Forum: General
Topic: Run Powershell from Execute Stage
Replies: 7
Views: 7681

What is the error that you are getting?

Note - In the Execute Command Activity, prefix powershell.exe before executing your script.

For example, if you want to execute script namely "abcd.ps" then in the command activity put up the following :-

powershell.exe abcd.ps
by dsetlteam
Tue Jun 24, 2014 1:18 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: date convertion with month increment by 1
Replies: 2
Views: 2075

DateOffsetByComponents(%basedate%,%yearoffset%,%monthoffset%,%dayoffset%) can do the trick for you
by dsetlteam
Tue May 27, 2014 6:12 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Update one column value and insert source row to a table
Replies: 1
Views: 1472

You can take count of records from the source file and use a filter stage to determine if the count is 1 or greater than 1, in such a case update the data in the table and in the after SQL , insert the file data into the table
by dsetlteam
Thu May 22, 2014 1:05 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to generate text file for each input record
Replies: 5
Views: 3717

1.First job will dump the EMP_ID data from the table to a sequential file 2.Take the count of records from the sequential file into a user variable 3.Start a loop, initialize it to run on the count variable value 4.Use sed command (in a command activity) to get the first record from the sequential f...
by dsetlteam
Tue May 20, 2014 9:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Converting String to Timestamp 24 hour format
Replies: 3
Views: 4482

First use convert/ereplace for "/" to "-" conversion,then use StringToTimestamp (In case you are reading from a varchar column) with following setting - %yyyy-%mm-%dd %H:%n:%s %aa
by dsetlteam
Tue May 20, 2014 8:06 am
Forum: General
Topic: dsadmin -listenv returning nothing
Replies: 8
Views: 3190

Is the code 141 or -141?

For -141, the reason could be "Failed to log to UV account"
by dsetlteam
Mon May 12, 2014 1:01 am
Forum: General
Topic: sequence job getting trriggered on its own
Replies: 5
Views: 2647

By any chance is the job being invoked from a sequence and in turn the sequence is the one that is scheduled?

You can try renaming the job and verifying if there is any process that is now failing since it is not able to find the real job to execute.
by dsetlteam
Fri May 02, 2014 2:07 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job aborting due to invalid characters errors - using netezz
Replies: 1
Views: 2410

There are unreadable/special characters in your input data.Analyse such data and use correct NLS setting to process it.
by dsetlteam
Tue Apr 29, 2014 8:45 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle Error in view data
Replies: 7
Views: 4028

You are replacing NULL with some value that is within quotes. Check if the LOC column is a varchar column , also check if the following works fine or not.

NVL(LOC,1) AS LOC
COALESCE(LOC,1) AS LOC
COALESCE(LOC,'-1111') AS LOC
by dsetlteam
Thu Apr 10, 2014 2:43 am
Forum: General
Topic: DataStage Process Control
Replies: 3
Views: 1851

Check how many jobs are running (It is possible that at a given time if many jobs are executed, then they might run out of resources)
Check if job is in aborted/crashed/not compiled state