Search found 452 matches

by vivekgadwal
Tue May 13, 2008 3:49 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Merge 2 files into 1
Replies: 14
Views: 6495

HashedFile2 | | V HashedFile1 ---> Transfomer ---> Target ... what is it? :( I'm too new to Datastage, Hello, What Ray Wurlod is suggesting is, if you have two hashed files and you want to merge them together, design your job in such a way: I/P: Hash File 1 O/P: Target (whatever your target is) Loo...
by vivekgadwal
Tue May 13, 2008 3:23 pm
Forum: General
Topic: What is SCD.How we in Data Stage
Replies: 13
Views: 22637

Re: What is SCD.How we in Data Stage

:?: SCD means Slowly Changing Dimensions. There is a lot of learning material available online on this topic . To be terse, Slowly Changing Dimension problem is a very common problem in Data Warehouses when an attribute for a row changes over time albeit over a long period. That means, you have loa...
by vivekgadwal
Tue May 13, 2008 2:38 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: how to do left join in transformer
Replies: 9
Views: 5556

each of the 3 files has some rows that cannot be joined with, and I want all the row from all the 3 files. how to do it? thanks Jessie, According to my understanding of your problem, why don't you use the Merge stage to join the files. If you need to get the data from 3 files, Use merge stage to co...
by vivekgadwal
Mon Feb 18, 2008 11:30 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Importing Whole Project
Replies: 4
Views: 2412

Or...design a DS Job that sources the export file and using EReplace function, replace the required information. It would go something like this... Source would be the .dsx file Target again would be the .dsx file...file name different of course In the transformer use the Ereplace function to find a...
by vivekgadwal
Wed Feb 13, 2008 3:39 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Failure During Execution of Operator Logic
Replies: 29
Views: 20755

Are any of the DB2 connection fields (server,user,password) parameters? Yes they were all env parameters and when we replace them with the actual values in all the individual stages , then the job runs fine, but we need to declare all the connection details through env parameters as per requirement...
by vivekgadwal
Thu Jan 03, 2008 11:01 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to handle reading files with variable lengthed records?
Replies: 3
Views: 922

Re: How to handle reading files with variable lengthed recor

I have a file with 10 fields. When the fields exist the file record is 100 bytes. Sometimes the last field is missing, sometimes the last 7 fields are missing and everything in between. I don't care if these are missing but it's causing problems for the Sequential file stage. What can I do to read ...
by vivekgadwal
Mon Dec 17, 2007 1:50 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: job locked, clean up resources not working
Replies: 12
Views: 7071

Re: job locked, clean up resources not working

Hi, I have a problem accessing a folder in the DataStage Director. The job in that folder seems to have been locked and I am not able to log out the process using the clean up resources option. I've even tried DS.TOOLS from the administrator, even that doesn't help :( . I cannot access any of the j...
by vivekgadwal
Mon Dec 17, 2007 1:49 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: job locked, clean up resources not working
Replies: 12
Views: 7071

Re: job locked, clean up resources not working

Hi, I have a problem accessing a folder in the DataStage Director. The job in that folder seems to have been locked and I am not able to log out the process using the clean up resources option. I've even tried DS.TOOLS from the administrator, even that doesn't help :( . I cannot access any of the j...
by vivekgadwal
Fri Oct 26, 2007 3:33 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Writing generalized subroutine for sending emails
Replies: 6
Views: 3116

Hi, How about including the generic DSSendMail routine in the job control of each job? If the WaitforJob() returns an errorcode > 0 then the DSSendMail routine gets kicked off. I think it is also a viable option along with the above solution! Let me know if I am wrong! :) It can be coded, but I gue...
by vivekgadwal
Fri Oct 26, 2007 1:34 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Writing generalized subroutine for sending emails
Replies: 6
Views: 3116

Welcome Aboard! You can drop in an Exception Activity. If there is any exception, i.e. if any of your jobs fail, the control goes to the Exception Activity. Now connect a Notification activity and a terminator to the Exception Activity. This way you dont clutter up the sequence. HTH Hi, How about i...
by vivekgadwal
Fri Sep 28, 2007 4:29 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Dealing with Occurs in .cfd files using CFF stage
Replies: 14
Views: 6038

Before we go on, have you read the manual for the CFF stage (cff.pdf)? There are examples and discussions there that may quench some of your thirst for knowledge, and save me transcribing slabs of that document! :) I have gone through the doc and I have understood what you guys were trying to tell ...
by vivekgadwal
Fri Sep 28, 2007 8:41 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Dealing with Occurs in .cfd files using CFF stage
Replies: 14
Views: 6038

There is no repeating group (no OCCURS) in this data. By creating multiple outputs and running these into a Link Collector you are producing exactly the input file. Please create a written (that is, English) specification of the true structure of the input file, and the desired output file structur...
by vivekgadwal
Thu Sep 27, 2007 4:47 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Dealing with Occurs in .cfd files using CFF stage
Replies: 14
Views: 6038

Just have the CFF stage "normalize" the repeating group. The CFF stage itself can generate the multiple rows. Then run the single output through a Transformer stage to filter out those occurrences that have the "empty" value - did you say it was all zeroes? Yes, we have zeroes c...
by vivekgadwal
Thu Sep 27, 2007 8:08 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Dealing with Occurs in .cfd files using CFF stage
Replies: 14
Views: 6038

Ray, are you sure INDEXED BY is not allowed in CFF on Server? Also, I don't think "INDEXED BY" OCCURS are variable, like DEPENDING ON is. I believe INDEXED BY PART-INDEX allows you to access a particular occurance Poster, try removing the INDEXED BY phrase from the CFD. Then, pick up the ...
by vivekgadwal
Wed Sep 26, 2007 4:22 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Dealing with Occurs in .cfd files using CFF stage
Replies: 14
Views: 6038

While your approach would work, there is a limit to the number of links that a Transformer stage can support - from memory I think it's 127. Plus you still have the problem about what to do to determine whether the Nth occurrence exists. Presumably you will have a constraint based on the value of P...