Search found 138 matches

by Maximus_Jack
Thu Mar 07, 2013 10:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup - How big a reference data is big?
Replies: 11
Views: 4114

two questions 1) So in a 32 bit machine with a heap memory of 2GB, Is it safe to say we can go for a lookup stage if the reference data is 1.00 GB? 2) So in a 64 Bit machine, where heap memory has no limit ( if i understand correctly) , what is the safe bet for the limit of reference data if i want ...
by Maximus_Jack
Wed Mar 06, 2013 8:20 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup - How big a reference data is big?
Replies: 11
Views: 4114

Lookup - How big a reference data is big?

Hi
One basic question,

I know it is better to use lookup stage when the amount of reference data is
is not huge, but how big is big, based on what the reference data is
considered as big or small, is it based on RAM memory availability or
something else

your response is appreciated

cheers
MJ
by Maximus_Jack
Wed Feb 27, 2013 9:46 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Multiple SQL in "Load SQL from file at run time"
Replies: 7
Views: 2881

Hi thanks for responding.. the queries are dynamically generated... and i want to use those data in the job. I think by somehow i have to generate the columns of the sql queris as a single concatenated columns and separate them with commas andand as craig said i should then union them all, before pa...
by Maximus_Jack
Tue Feb 26, 2013 12:22 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Multiple SQL in "Load SQL from file at run time"
Replies: 7
Views: 2881

hi craig, thanks for responding, tried that too.. its not working..
by Maximus_Jack
Tue Feb 26, 2013 10:58 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Multiple SQL in "Load SQL from file at run time"
Replies: 7
Views: 2881

Multiple SQL in "Load SQL from file at run time"

Hi I did some googling and searched this forum as well, but couldn't find it. I'm trying to execute multiple sql's in oracle stage using the "Load SQL from file at run time" option, seperating each sql with a ";" , but datastage is taking all the sql as a single SQL and trying to...
by Maximus_Jack
Tue Sep 25, 2012 9:26 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Capturing rejects in Oracle OCI stage
Replies: 2
Views: 1395

Capturing rejects in Oracle OCI stage

I'm inserting records into oracle oci stage, whenever the insert fails for whatever reason
i need to capture that in a sequential fail of the rejected records, i tried adding a sequential
file at the end of the oracle oci stage but i couldnt find any reject options, can anyone help me?

thanks
by Maximus_Jack
Mon Sep 24, 2012 12:00 am
Forum: General
Topic: using sequential file column value in SQL query
Replies: 2
Views: 972

using sequential file column value in SQL query

Hi
Is there any way i can use a sequential file column value in a SQL query?
like.......

Oracle SQL Query
===========

insert into tablename1 ( col1)
select col1
from tablename2
where col2 in ( dslink.col1)
by Maximus_Jack
Sat Aug 04, 2012 4:40 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: whether sorting strings as numbers affects aggregator result
Replies: 4
Views: 1835

craig, thanks for responding, I dont have much exposure in server stages, its seems like the server aggregator needs the data to be sorted, i have now tried simulating the same scenario, i'm getting "row out of sequence" error, is it because the aggregator is getting non sorted data?? corr...
by Maximus_Jack
Sat Aug 04, 2012 11:23 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: whether sorting strings as numbers affects aggregator result
Replies: 4
Views: 1835

whether sorting strings as numbers affects aggregator result

Hi I don't have access to Datastage now, can anyone please help in giving some clarity on this, i have a job as input_seq_file --> aggregator --> output_seq_file some string columns in the input file are sorted as numeric using the unix command before it gets processed in the aggregator, my question...
by Maximus_Jack
Mon Jun 04, 2012 7:39 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading XML file in windows through external source
Replies: 23
Views: 9357

ya i understand that, but i dont know why datastage is prefixing the pwd on top of the path i specify???any idea???
by Maximus_Jack
Mon Jun 04, 2012 3:27 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading XML file in windows through external source
Replies: 23
Views: 9357

Hi all I tried placing the file where datastage is getting pointed to C:\IBM\InformationServer\Server\Projects\Training\Datastage\Testinputfiles\ its working as expected and i can see the data in the peek stage and in the seq file as well when replaced, so the only question here is how to change the...
by Maximus_Jack
Mon Jun 04, 2012 2:59 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading XML file in windows through external source
Replies: 23
Views: 9357

hi erine.. whatever i have pasted below is the only thing in the XML document. and FYI, when i see the director log, the variable PWD is assigned as below PWD=C:\IBM\InformationServer\Server\Projects\Training i couldnt find this in the environment variable section, may be datastage is picking this p...
by Maximus_Jack
Mon Jun 04, 2012 2:44 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading XML file in windows through external source
Replies: 23
Views: 9357

hi.. This is the XML file i'm using in my job http://msdn.microsoft.com/en-us/library/windows/desktop/ms762271(v=vs.85).aspx i tried to find what is schemalocation attribute and it seems like there is nothing in the XML file as such, correct me if i'm wrong... and FYI, i have disabled "validate...
by Maximus_Jack
Mon Jun 04, 2012 2:07 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading XML file in windows through external source
Replies: 23
Views: 9357

Hi I tried as External source ( without wild card) > XML input > peek stage and i have enabled tracing in the job External source config: =============== Source Program: ls /Datastage/Testinputfiles/XML_in_Books.xml Output in the tracing for external source ========================== XML_Input_26.DS...