Search found 71 matches

by tkbharani
Sat Jan 19, 2008 12:43 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DsRoutines
Replies: 3
Views: 1288

DsRoutines

I am writing a routine as follows. It selects data from Hash File. ----------------------------------------------------------- $IFNDEF JOBCONTROL.H $INCLUDE DSINCLUDE JOBCONTROL.H $ENDIF LenJobName='30L' Command = "SELECT CIRCLE FROM GEO " Command := " WHERE CODE= ": Code :"...
by tkbharani
Thu Dec 13, 2007 3:19 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: "Transformer Stage Constraint" to be parameterised
Replies: 5
Views: 3004

Do I have to use Data Element or Month.tag.
Give a some suggestion so that I can search or proceed through the method.
by tkbharani
Thu Dec 13, 2007 1:58 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: "Transformer Stage Constraint" to be parameterised
Replies: 5
Views: 3004

"Transformer Stage Constraint" to be parameterised

DearAll In transformer stage constraint I am using the following condition by passing a value ,through which the data is segregated and populated in a file. This value must be parameterised. I am using this in transformer stage constraint .How to Do this. Example : Month=12 This "12" value...
by tkbharani
Tue Nov 27, 2007 11:27 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hash look up Very Slow...
Replies: 14
Views: 6348

Thanks Mr.Ray and all I found the bottleneck. The hash file which I am using for lookup,was also used by some other applications to read parallel. when I ran only lookup job, job totally took only 60Min to get completed. I think this may be the reason. Any way my job gets completed within time. Than...
by tkbharani
Mon Nov 26, 2007 5:26 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Job Parameters override
Replies: 11
Views: 2819

Re: Job Parameters override

Hi, I have a query. The server jobs have job properties. Also, sequences (schedulers) have job properties. Can you tell me who has greater prominence? As in, can server job parameters override scheduler job properties? or is it the other way around? Thanks! What ever parameters given through Sequen...
by tkbharani
Mon Nov 26, 2007 4:17 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hash look up Very Slow...
Replies: 14
Views: 6348

Consider using a static hashed file for very large sizes. Try initially with type 18. Keep the separation small, perhaps 2 or 4. ... Currently we have created HashFile using Type30 Dynamic and then Resize hash file from 32Bit to 64 Bit. Its not having good performence(300rows/per sec) 1. If we Crea...
by tkbharani
Mon Nov 26, 2007 1:59 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hash look up Very Slow...
Replies: 14
Views: 6348

I tried hash file with 1,00000 records,the performance is good.it is extracting at a speed of 6000 per sec. This confirms the hash file is of high size and some tuning must be done on this. Is there any way doing it in datastge, rather than going towards DataBase. Databse merge statement will take m...
by tkbharani
Mon Nov 26, 2007 1:33 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hash look up Very Slow...
Replies: 14
Views: 6348

hash file can't be reduced.

the size oft he hash file can't be reduced as we need it,it can;t be divided into also.
Will data stage 7.1 server job supports this much hash file,do i have to tune hash file from server side.
by tkbharani
Mon Nov 26, 2007 1:24 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hash look up Very Slow...
Replies: 14
Views: 6348

Hash look up Very Slow...

Dear All I have server job Which has primary link as Sequential file of 7GB and having a Lookup file(hash file) of 5 crores records of 10GB. That is hash file as lookup file. Finally after lookup job will create a sequentila file as output. Hash file properties ------------------- Type 30 Dynamic. 6...
by tkbharani
Mon Nov 26, 2007 12:45 am
Forum: General
Topic: How to load huge volumes of data in an Oracle DB? Bulk Load?
Replies: 7
Views: 3416

Re-building Index for large table will take time..

1. We are always loading the data into table for using/extraction,else there is no purpose in loading. if Index is there then while extraction from the table the query will execute faster.Without index query's are always slow in large table. Re-building Index for such a large tables will take more t...
by tkbharani
Sat Nov 24, 2007 8:45 am
Forum: General
Topic: How to load huge volumes of data in an Oracle DB? Bulk Load?
Replies: 7
Views: 3416

Re: How to load huge volumes of data in an Oracle DB? Bulk L

The best and fastest way to load is oracle sqlldr function(direct=true). In this you have many options like readsize,buffersize..through which you can load atleast a minimum of 3 crores in 40 minutes with Index. This also depends on rollback segements, unrecoverable options in ORACLE. This is my con...