DSXchange

Hi, I was trying to write a my own subroutine to be called in the job control. I was able to create the routine sucessfully. But when I tried to call the routine in the job control, it did not pass the compilation. It mistakes routine name as array name. Here is the defintion of my routine: Subrouti...

Hi,

I have twp dummy questions about job Log. How do you automatically clear the log every time you run a job? How do you increase the limits so you can see more entries in the log?

Thanks,

Carolo

[quote="kcbland"]If you have a job that reads a source table, does OCI/ODBC based references, and writes to a target table, then you have the simplest job design but also the slowest one possible. Hi Ken, We do have staging area in our DW, but we use database table instead of sequential fi...

Hi Everybody, I have a performance issue about my job. In our source system,we have a trasanctional table which has around half million records every day. Our daily ETL is requested to read this table, and do some transformation/aggregation, then generate results in another table. But this process s...

Hi Everybody, In our old hard coded ETL process (implemented using SQL stored procedure), whenever there is an action that modifies table, it generate a record in a log table, the record logs which table and how many rows have been affected by the action. Since SQL server offers a global variable @@...

I have a problem regarging to capture logic errors within ETL. To keep the siutation simple, I am giving a sample here. There are several jobs related a fact tables. We can separate the jobs into 2 groups, one group handles dimension mapping ( one job handles one dimension), it maps the source key w...

Hi, Our company started building Data Mart two years ago. It used hard coded stored procedure to implement ETL (the platform is SQL Server + NT), it works perfectly fine. Now, the company wants to convert the database to DB2 on Unix, and we are told to re-write all the ETL stored procedure using Dat...

Thanks, everybody. The problem has been resolved. I made a typo in the SQL statement.

Hi, I am doing a project converting stored procedure to datastage. I am wondering whether you can use datastage to delete rows, here is the original sql statement. DELETE FROM IN_PLAYER_MASTER WHERE Acct IN (Select Player_Acct_Num FROM EXD_PLAYER_MASTER ) I was trying to use user-defined SQL, but wh...

Hi All, I have a question regarding to lookup. In our table, there is a field called visit_date, if the visit_date falls into certain range which is defined in another talbe, that record is treated as valid one otherwise, that is invalid one. I don't know how to implement this as lookup? Thanks, Yim...

Hi, My company is just starting to use Datastage to build ETL. And we have a debate regarding to how many projects you need for constructin one ETL stream. Do you put all extrating, transformation, and loading jobs in one project ( but separated them into different categories), or you spearate them ...

ray.wurlod wrote:In what country are you operating, Yi Ming?

Hi Ray,
I'm in Toronto Canada. I don't know whether there is any datastage branch in Toronto. Bringing in a datastage consultant from the States seems a little pricy.

Yiming

Hi, I am new to DataStage, and I have a question regarding to DataStage scheduling. Currently, I am participating a project which tries to convert hard-coded ETL to Datastage, but I've had this big issue about the scheduling. In our old system, the scheduler has lots of flexibility. Every time, it s...