Search found 166 matches

by ameyvaidya
Thu Oct 13, 2005 6:19 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Counting number of columns in a CSV file
Replies: 8
Views: 10029

If the file is well-formed, and the only issue is that of figuring out if the file has too many or too few columns, there is one trick which can be used (Server Jobs Only): In the columns tab of a sequential file in server jobs there is a column titled "Incomplete columns". Set this value ...
by ameyvaidya
Wed Oct 12, 2005 6:06 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: summary and detail record logic in the same target
Replies: 2
Views: 1654

In another transformer stage x-1S(Detail),
Please read as
In another transformer stage x-1S(Summary),
by ameyvaidya
Wed Oct 12, 2005 6:00 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: summary and detail record logic in the same target
Replies: 2
Views: 1654

one possible solution: Calculate/Pass the detail data and your calculated summary in 2 different streams. In a transformer stage x-1D(Detail), Consolidate every detail column but Col1 into the required output format and pass it a a single Column(RowData longvarchar(4096)). Add a generated integer Co...
by ameyvaidya
Wed Oct 12, 2005 2:02 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Julian date conversion to yyyy-mm-dd : hh-mm-ss
Replies: 19
Views: 11849

As from what I read from searches in the same forum (Try "SQL Server datetime" with the all words match option), If you get the format right, SQl server will parse the varchar and convert it to the right datetime format. No need of a Stored Procedure. This issue has been taken care of many...
by ameyvaidya
Wed Oct 12, 2005 11:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Julian date conversion to yyyy-mm-dd : hh-mm-ss
Replies: 19
Views: 11849

Hi Via, I think the issue now is the base database table. The data type TimeStamp is (Possibly??) incorrect for what I think You want to achieve. Refer link: http://msdn.microsoft.com/library/default.asp?url=/library/en-us/tsqlref/ts_da-db_7msw.asp timestamp A database-wide unique number that gets u...
by ameyvaidya
Tue Oct 11, 2005 12:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Julian date conversion to yyyy-mm-dd : hh-mm-ss
Replies: 19
Views: 11849

Carter, The reason I added 1899 and not 1900 is because: 105001 is 01 Jan 2005 Now to use the defined logic: 1899+105=2004. Create date 31- Dec- 2004 Add 1(001) day to 31 Dec 2004 Which is 1-Jan-2005 If we use 1900, we have to create the date as 1-Jan-(1900+cyy) subtract 1 day from our final additio...
by ameyvaidya
Mon Oct 10, 2005 5:56 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Julian date conversion to yyyy-mm-dd : hh-mm-ss
Replies: 19
Views: 11849

Hi Via, That is a Trademark (well almost) JD Edwards date format. Dont have DSEE so cant give actual code: Step 1 is to seperate the year from the source: * for String input take everything from pos 1 to len-3; convert to Integer * for Integer divide by 1000 and use AsInteger() Add 1899 to either re...
by ameyvaidya
Thu Oct 06, 2005 1:09 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Creating a Parallel Routine.
Replies: 8
Views: 5186

One possible issue may be this line in the transformer output:
0006: extern string stripinvalidchars(string string,string termstring,string replace);
Try to rename the argument name from "string to something else("inpstr" perhaps).

HTH
Amey Vaidya
by ameyvaidya
Wed Sep 28, 2005 2:37 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Notification - When job Unsuccessful
Replies: 2
Views: 920

Hi Titto, The simplest solution would be to wrap a Job Sequence around your existing Job. The sequence can do the following: 1. Job Activity Executes the Job. Output trigger is unconditional to second stage 2. Second stage is a nested condition stage with one output trigger with the following condit...
by ameyvaidya
Mon Sep 26, 2005 11:25 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Strange abort
Replies: 4
Views: 1177

When importing Objects into a new project, if the overwrite without Query check box is unchecked and an object with the same name already exists, you will be prompted if datastage is to overwrite the existing object with the new imported object. If the checkbox is checked, there will be no prompt an...
by ameyvaidya
Thu Aug 25, 2005 2:51 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: oracle output error
Replies: 7
Views: 7945

When I view data through oracle stage I am seeing bad data and when I run the job also it is giving fatal error. Just checking; Is the above- mentioned error the same as in your initial post: ##F TFDE 000030 10:06:29(002) <Org1,0> Fatal Error: APT_Decimal::assignFromString: invalid format for the s...
by ameyvaidya
Sun Aug 14, 2005 8:06 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issuuing abort after 50 logs
Replies: 18
Views: 8381

Hi Kumar, First of all, I apologize for the delay in responding. two points i've faced before with sequential files and transformers. 1. Setting null values in sequential files for fixed field length data types is very painful. Especially if those files are to be used as staging areas between jobs. ...
by ameyvaidya
Wed Aug 10, 2005 11:12 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reject thresholds for reject links
Replies: 6
Views: 4777

An interesting little undocumented abort operator.

There is another way to set up aborts that I'd discovered by accident in 7.5. I dont have access to DataStage at the moment but heres how: When previewing data either from a Sequential file or database source, there is an option to view the generated OSH. In that OSH, you will find an abort operatot...
by ameyvaidya
Wed Aug 10, 2005 10:02 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issuuing abort after 50 logs
Replies: 18
Views: 8381

Additional questions

1. What is the Data source? is it a sequential file? 2. What stage type throws the warnings? is is a transformer? (Recommend pasting a subset of the log.) 3. what is the difference between the dev env and the testig env WRT the source data. Is there a possibility that the dev env may not have had n...
by ameyvaidya
Wed Aug 10, 2005 3:06 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issuuing abort after 50 logs
Replies: 18
Views: 8381

Switch off RCP flag at the project level.

Hi kumar_s, Check if both projects have the same setting for Enable Runtime Column Propogation for Parallel Jobs. I suspect that this may have been switched off in the Dev Project and on in the testing project. If this is true, recompiling jobs in the testing project would have removed all modify op...