DSXchange

Thanks for the suggestions. I have created a Before/After routine that extracts the ORA error from the latest run of the job. It seems to be extracting the error correctly. But now I'm not sure how to call it to get to the information that I need. If I call this routine as an after-job subroutine (a...

I have the following (simplified) sequence design: ServerJob ---> ParallelJob(LogSuccess) ExceptionActivity ---> ParallelJob(LogError) ---> Terminator The Automatically Handle Activities that Fail option is set for this sequence. The server job calls the Stored Procedure using STP Stage. The SP has ...

Here are the details of my test load. Source file: 20110524,291,10999,1.89,1.89,0 Peek_197,0: DAY_DT:2011-05-24 00:00:00 LOC_IDNT:291 ITEM_IDNT:10999 BASE_QTY: 000000000001.8900 ACT_QTY: 000000000001.8900 IND:0 REC_LOAD_DT:2010-07-04 00:00:00 PROCESS_KEY: 0000012345 Control file: OPTIONS(READSIZE=20...

When I realised how it is supposed to work, I managed to generate the file ctl file that matches my source file, with the exception of some control characters being inserted into varchar fields. Not sure why it's doing this, but it is quite consistent and happend also when I changed the order of the...

I think I have misunderstood the functionality of the Manul mode. I thought that I can pass the control and data files and Oracle connector will load them, but it looks like it generates both control and data files base on the field definition and data passed in from the incoming stage. So my questi...

For loading dta into the database I'm using Oracle Connector in the Bulk Mode with Manual option. The stage generated the control file, but it creates the fixed width field definition of the file, for example LOC_IDNT POSITION(128:139) VARCHAR(10). Unfortunatley my source file is variable length and...

My "assumption" was based on my lack of knowledge how to interpret the score. I was suspecting that it runs in parallel, but needed some confirmation . Thanks.

I might test the parsing method as well, but probably not until Monday.

I'm testing the performance of our system processing very large file (400 millim records) using some very simple jobs. Here are two examples of my test jobs: Job 1 Fileset ---> Copy Job 2 Fileset ---> Column Import ---> Copy The processing time increased from 10 mins for Job 1 to 25 mins for job 2. ...

All I had to use this was a combination of Lookup and Transformer. I my previous projects I was using Change Capture and Transformer, but since Datastage offers SCD stage specifically for that purpose (i.e. handling of slowly changing dimensions) I wanted to use that. But it looks I might have to g...

Can't do reload as I need to keep the history of changes. That's why it's Type 2.

Yes, it does. It works for me fine. However the Effective Date in my dimensions need to behave a bit differently to the standard.
I could handle it post SCD stage, given I can sufficiently identify the records.

Yes, This is one and the same dimension. It is possible to have a dimesion that will have Type 1 updates when changes are detected in some columns and Type 2 updates when changes are detected when changes are in some other columns. SCD stage allows for that and DataStage Data Flow and Job Design.pdf...

I am implementing a load of a dimension that is a mixture of Type 1 and Type 2. The behaviour I need to implement is slightly different than the standard behaviour provided by the SCD stage. Therefore I would like to do some post processing based on the type of the update that is being made. I can f...

Got it!!!
I have changed the test to the following code: and now it works correctly for both new records and updates :D.

I have change the derivation to make it as lnk_Target.REC_LOAD_DT. It looks a bit funny on the screen as the incoming link starts on the left panel in the middle of nowhere :?. But it works really nice for updates now. However I cannot make it work properly for new records now. New records should ha...