DSXchange

Ernie/Craig Thanks for your replies and clarifications. I am not sure why they don't have any documentation on the XML or DSX Generation. 500 jobs in a few minutes with a Basic template seems awesome to me 8) Never the less..i will be creating a lot of sample jobs and will study the XMLs that are be...

Chulett Thanks for the reply. Ernie Bang on the Money. we are actually trying to build some assets for creating some new business. it is a very intresting comment you made there about Job generation tooling. Is there some job generation tools you can point me to. Currently we are trying to create th...

Hi All I have a quick question. If we do changes on the exported XML or DSX manually and import them in a server. Will the Jobs from the modified XML be stable or will i run in to some system errors. The changes can be minor may be like the data type changes or major like making entries for new stag...

Hi All Is there any other stage i can use for concatenating a set of coloumns other than Transfomer??? Can a Modify stage be used. If Yes can anyone kindly direct me how i achieve it with the syntax. Irrespective of what i try in the Modify it fails in the run time.... Any help will be really Apprec...

Ray Thanks a lot for pointing that...I am really novice on c++ and didn't realise that. I have improvised my code as follows #include <stdlib.h> #include <stdio.h> #include "/opt/atlas/IBM/InformationServer/Server/DSEngine/include/dsapi.h" char * UpdateEnv(char *Projname, char *EnvVarName,...

Hi Chulett
The Updation of environment variables is for our surrogate key approach as outlined below

http://it.toolbox.com/blogs/dw-soa/surr ... -way-22482

Hope this clarifies...

Thanks
Pavan

Hi All I needed to write some functionality where i needed to update the environemt variables in my Job stream. I read through the Advanced Parallel Developer Guide..Job Development Kit and some posts in IT Toolbox. I finally figured out and wrote this c++ code #include <stdlib.h> #include <stdio.h>...

Hi All I have the following design in one of my jobs Copy Stage -------->Surrogate Key Stage | | Surrogate Key Stage The Job is Running Parallely and Both the Surrogate Key Stages are using the Same State File. Will there be a conflict in Keys Assigned when both the Stages try to access the Same Sta...

Hi All One of my Jobs is throwing the following Warning APT_ParallelSortMergeOperator,0: Unbalanced input from partition 1: 10000 records buffered It doesn't say which stage or where the problem is coming..There are many stages in the Job. Is there some way i can figure out which stage partition is ...

Hi All We are scheduling a Data Stage Job to be started every day at 7PM which is getting me the incremental load from a database. My select query is as follows select * from XX where datetime >= (sysdate-1) Records are being pumped in to this table every second. Is there a chance i will miss out so...

Hi All One of the sources we are working on is a Oracle Database. we don't have any date columns in the table we can relay on to get the incremental data. We are down with two options in a scenario like this 1) do a compare of the source to the target to get the Insert Update Delete. The volumes bei...

HI All I am using oracle enterprise stage in one of my jobs as a inout stage and the jobs were initially aborting with the following error message "Access to sys.dba_extents is required but not available; please >see your database administrator for select privileges" I talked to the Source...

Hi Ray Is there some reason for advocating the 2nd Approach? Isn't it a huge over head on the ETL To do all those referential integrity checking for a complex system on the ETL Side Birendra With the 1st Approach imagine we have 3 foreign key constraints on the table. If the client is looking for sp...

Hi All I am working on a ETL Project which is taking data from different sources and filling in a relational Database. We are looking at 2 Approaches in Handling the Foreign Key constraints on the Target realtional database 1st Approach -------------- Take the Data from the Source Table and do your ...

Arnd and Ray Thanks a lot for the replies...We actually figured out the problem...there is a small parallel routine in the job which is being called from a tranformer as a before stage routine...The moment we remove this routine the file pattern works like a charm and takes any number of files... We...