Search found 63 matches

by ayan
Mon Jan 18, 2010 3:27 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: loading Chinese data
Replies: 5
Views: 2482

What are the environment Oracle variables you are referring here?
by ayan
Mon Jan 18, 2010 3:11 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: loading Chinese data
Replies: 5
Views: 2482

What are the environment Oracle variables you are referring here?
by ayan
Sun Jan 17, 2010 4:24 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: loading Chinese data
Replies: 5
Views: 2482

loading Chinese data

I will have to create a simple job which reads from a delimited file and load in oracle (using OCI stage).Only thing is that data is in Chinese language.Oracle DB character set is UTF8.What configuration do I have to do at datastage level?One I can think of is to set up NLS as UTF8 at job level.Requ...
by ayan
Wed Dec 23, 2009 1:43 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hash File Query
Replies: 3
Views: 1650

Ok.But in which case we should go for hash file deletion and recreation approach ? Is it like when the daily volume from the source table varies a lot? But then is not type 30 hash file dynamic?Will it not adjust when the volume is more ?So what's the point in deleting the old copy rarther than simp...
by ayan
Tue Dec 22, 2009 12:58 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hash File Query
Replies: 3
Views: 1650

Hash File Query

We have a number of lookup tables which we need to refer in various jobs.So before starting main processing we run a job to unload the lookup tables and create hash files(type 30) which will be looked up in subsequent jobs.Now my question is whether we should configure the hash file so that the old ...
by ayan
Sun Dec 13, 2009 2:31 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: parameterizing the source sql query
Replies: 22
Views: 7608

ok....from which version is it available?...is it there in server(7.5x)?
by ayan
Fri Dec 11, 2009 2:17 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: parameterizing the source sql query
Replies: 22
Views: 7608

Yes,databases may differ but in most of the cases it is Oracle.ODBC stage should be ok.I have started a POC.Let's see how it goes.I don't see much of a problem regarding parameterization (DB login,source query) but my main concern/doubt is whether to go ahead with multiple instance job.As for DRS st...
by ayan
Fri Dec 11, 2009 2:09 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: parameterizing the source sql query
Replies: 22
Views: 7608

Thanks for your inputs,guys...and yes Ray, only if they would have been a little less "intelligent' !
by ayan
Thu Dec 10, 2009 9:47 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: parameterizing the source sql query
Replies: 22
Views: 7608

I know..I have that option in mind too. Currently there are 2 source systems for this target and a new one is being integrated.Now the management wants to build a new "generic" interface for integrating the new source(3rd one,first 2 will be kept untouched) and hereafter any source being i...
by ayan
Thu Dec 10, 2009 7:35 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: parameterizing the source sql query
Replies: 22
Views: 7608

Initially my idea was also of using project level parameters.But now I need to build a generic etl job where target table structure is fixed (a particular oracle table) but source structure varies(different oracle db,MS Sql Server etc..structure is also different). My idea now is to create only one ...
by ayan
Thu Dec 10, 2009 1:53 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: number of jobs in parallel
Replies: 3
Views: 1576

number of jobs in parallel

I need to run 14 jobs in parallel . Now I would like to know what are the factors I need to consider before deciding how many Job Activity I can run in parallel so that there is no major performance impact or execution problem?
by ayan
Thu Dec 10, 2009 1:48 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: parameterizing the source sql query
Replies: 22
Views: 7608

Thanks for the tips....another question which is related to this...I am also parameterizing source db credentials(job parameters) and storing the value in a table.This is since different jobs may fetch same data from different schema.Now the question is how to encrypt the pwd?Had it been at the admi...
by ayan
Wed Dec 09, 2009 10:46 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: parameterizing the source sql query
Replies: 22
Views: 7608

I am thinking of keeping a control table to store various ds param name/value pairs.Can store the source query there only.But could you please explain a little about the "issue with quotes being stripped of ..." that you mentioned ?
by ayan
Wed Dec 09, 2009 12:28 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: parameterizing the source sql query
Replies: 22
Views: 7608

parameterizing the source sql query

Is it possible to parameterize the whole sql query used in a source oci stage?I would like to have a table to store the queries,use a parameter like "source_query" in oci stage and pass the value dynamically in job activity stage. Need some suggestion on what's the best way to do it.
by ayan
Sat Nov 21, 2009 12:25 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: reading foreign language data
Replies: 1
Views: 841

reading foreign language data

If I need to read various non english language data in a job,what are the settings do I have to worry about?As per my understanding I need to set proper NLS at the job level (compliant with source and target db character set).Is there anything else that I need to check out? Do I need to check the NL...