Search found 32 matches

by bmsq
Wed Jun 13, 2007 5:43 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Complex Date Conversion Problem
Replies: 8
Views: 2990

Josh,

When using a dummy year, do I need to ensure that I choose a leap year to ensure that "29 Feb" is valid?

Thanks,
Barry
by bmsq
Wed Jun 13, 2007 1:32 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Complex Date Conversion Problem
Replies: 8
Views: 2990

Thanks Josh,

I thought that might be the way I'd need to do it. Is there any easy way to perform the conversion from %dd %mmm to %dd %mm without writing some huge if statement in a transformer to convert the month?

Cheers,
Barry
by bmsq
Tue Jun 12, 2007 10:38 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Complex Date Conversion Problem
Replies: 8
Views: 2990

Server? How did that get in the title, I selected parallel....

Anyway, sorry about the confusion. This is a Parallel problem, I'd just use DS Basic or OCONV/ICONV if this were server.

Cheers,
Barry
by bmsq
Tue Jun 12, 2007 8:39 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Complex Date Conversion Problem
Replies: 8
Views: 2990

Complex Date Conversion Problem

Hi guys, I've got a problem with converting dates in either a Column Import or Transformer that I hope someone will be able to help me out with. The input date string is %dd %mmm and I need to convert this to a Date type using a second date as the cut off period. My initial thought was to get the ye...
by bmsq
Thu May 10, 2007 11:28 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle Fatal Error not Fatal
Replies: 6
Views: 2118

Thanks again Ray,

Just on your last point, what is the "normal" way that you would detect this type of error? I can only think of using DSGetLogSummary() with DSJ.LOGFATAL within the DS basic API to dectect this situation.

Cheers,
Barry
by bmsq
Thu May 10, 2007 11:14 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle Fatal Error not Fatal
Replies: 6
Views: 2118

Ray, I can understand that it affects the individual players and the conductor process continues to allow cleanup. But the conductor process can't clean up broken constraints, instead we end up with a job reporting RUNOK but the database has one or more constraints left in a disabled state. Surely, ...
by bmsq
Thu May 10, 2007 6:57 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle Fatal Error not Fatal
Replies: 6
Views: 2118

Oracle Fatal Error not Fatal

Hi guys, I've just discovered some issues with several of our jobs which load into an Oracle Database. These issues seem to have been slowly introduced over a long period of time but they have gone unnoticed because some strange DataStage behavior. What is happening is during our load (Oracle bulk l...
by bmsq
Tue Feb 13, 2007 12:39 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Deployment and Version Control
Replies: 4
Views: 1300

Thanks Ray,
Highly Appreciated.
Closing the thread.
Regards,
Munish
by bmsq
Mon Jan 29, 2007 1:24 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Direct Load Problems in Oracle Enterprise stage
Replies: 3
Views: 1865

No other jobs fail prior to running this job. This job uses a dataset which is created by an earlier job and just loads it into the database. We can rebuild the indexes and re-run just this job and the db will be in an unusable state again. All bitmap indexes become unusable. There are a total of 15...
by bmsq
Mon Jan 29, 2007 12:35 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Direct Load Problems in Oracle Enterprise stage
Replies: 3
Views: 1865

Direct Load Problems in Oracle Enterprise stage

Hi all, We have been trying to solve a problem with using the direct loader in the oracle enterprise stage for awhile now. I've already done alot of searching on the forum to try and solve this myself but with no luck. The table we are trying to load is partitioned and has a number of bitmap indexes...
by bmsq
Sun Jan 28, 2007 11:18 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Migration & Version Control
Replies: 16
Views: 7809

Thanks for the response, This maybe our first piece of work in using DataStage but our project is already well established and we need to adhere to project standards. I would gladly choose to use the Version Control tools which come with DataStage but one of the project's standards is the use of CVS...
by bmsq
Sun Jan 28, 2007 11:02 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Migration & Version Control
Replies: 16
Views: 7809

Migration & Version Control

Hi guys, I've started to look into our Dev, Test & Prod migration processes for DataStage jobs. To make this possible, this also requires us to put our DS projects unders version control. What I would like to do is use the Managers export functionallity to package an entire project into a single...
by bmsq
Tue Jan 23, 2007 4:38 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Automated Regression Testing
Replies: 6
Views: 2142

For both generic jobs, I don't explicitly specify any Column data. Instead, the DS -> SF job seems to be able to use RCP with the meta data in the DS and the SF results in all the data from the DS appearing correctly. The SF -> DS stage however does not already contain any meta data, so I specify th...
by bmsq
Tue Jan 23, 2007 12:04 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Automated Regression Testing
Replies: 6
Views: 2142

Thanks for all your responses. What I was trying to create was some form of test data repository which may exist on a server other than where DataStage resides (which rules out the copy from the DataManager). I initially created a generic job which was DataSet -> Seq file, this job took the file nam...
by bmsq
Mon Jan 22, 2007 7:43 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Automated Regression Testing
Replies: 6
Views: 2142

Automated Regression Testing

Hi Everyone, My team is fast approaching the testing phase and I've been trying to come up with an approach which allows easy regression testing. At the moment we give each ETL job a small amount of test data and then manually verify the output. Once we are happy with this, the volume is increase an...