Search found 194 matches

by dsscholar
Mon Aug 22, 2011 1:59 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading a fixed width file without Header and Trailer record
Replies: 1
Views: 1711

Reading a fixed width file without Header and Trailer record

Hi I am reading a fixed width file by removing a Header and Trailer record by placing a filter condition as grep -v HDR| grep -v TRL in the Sequential file stage,so it will be removing the header and trailer and i can able to process the detail records successfully But in the case of without detail ...
by dsscholar
Fri Aug 19, 2011 7:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Join stage
Replies: 4
Views: 2274

Thanks Ray!

Does the join stage use the sratch disk space for doing the join operation or it uses the database temp space or it dont use temp space and just do the join and display the results "on-fly" with the database

Thanks in advance.
by dsscholar
Thu Aug 18, 2011 6:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Join stage
Replies: 4
Views: 2274

Join stage

Hi Guys, In join stage, i am aware that the parallel engine will insert a tsort operator to do the sort operation, which in turn requires temp space in scratch disk to store the temporary files. If i dont do the sort operation by giving "dont sort environmental variable", temp space wont b...
by dsscholar
Wed Aug 17, 2011 7:46 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: surrogate key generator stage
Replies: 4
Views: 2012

Arvind,

Could u please tell what u mean in this statement " create the flat file sequence within the scope of datastage ". U mean to say i have a create a file using only surrogatekey generator in a job, with some values in that?

Thanks in advance.
by dsscholar
Wed Aug 17, 2011 7:12 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: surrogate key generator stage
Replies: 4
Views: 2012

surrogate key generator stage

Hi Guys, Sequential file ---> SurrogatekeyGenerator(SKG) --- > Dataset Inside SKG, i gave the file initial value as 1 and output column as surrogatekey. From the source i get 2 column registerno,names which comes from sds.txt.. In SKG, for source file name i gave an empty file name sdf.txt. I ran th...
by dsscholar
Tue Aug 16, 2011 2:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: runnig ds job using functional id
Replies: 2
Views: 1463

runnig ds job using functional id

Hi there! I have created my project with my user id and ran the job with dsjob command through script successfully . Now same job when i tried to run with functional id i am getting the following error, Failed to open project. with some status code..(sorry forgot the status code) Could you please he...
by dsscholar
Fri Aug 12, 2011 6:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: dataset ; no such file or directory
Replies: 7
Views: 4767

Chulett, Please find the error message below.. ##E IIS-DSEE-TFOR-00001 05:00:28(000) <Data_Set_0,0> Failure during execution of operator logic. ##F IIS-DSEE-TFIO-00161 05:00:28(003) <APT_CombinedOperatorController,0> Fatal Error: I/O subsystem: Open of /D=/IBM/InformationServer/Server/Datasets/RELTT...
by dsscholar
Fri Aug 12, 2011 4:45 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: dataset ; no such file or directory
Replies: 7
Views: 4767

dataset ; no such file or directory

Hi all, In my job, am loading a dataset with 4 million records. In between a lookup is there where partitioning is hash and after that its "same" till the end. Now when i tried to read the data from the dataset, i get a weird error like "No such file or directory".. But it happen...
by dsscholar
Tue Aug 09, 2011 1:24 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: setting a unix ENV variable at job level through paramset
Replies: 1
Views: 1327

setting a unix ENV variable at job level through paramset

Hi There, We exported a unix variable for eg f_iname=a in unix i have added the userdefined environmental variable in Admin client as f_iname without default value in my job paramter set i have added the above $f_iname user defined env variable ,setting default value as $ENV when i am running a job ...
by dsscholar
Wed Aug 03, 2011 6:15 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: clob to long varchar
Replies: 4
Views: 2374

Re: clob to long varchar

Ray,Chulett,jwiles

Can you people atleast reply for my issue.


Thanks in advance
by dsscholar
Tue Aug 02, 2011 11:53 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: clob to long varchar
Replies: 4
Views: 2374

Re: clob to long varchar

My datastage version is 8.0.1. Expecting some reply in this issue. Please advise.


Thanks in advance
by dsscholar
Tue Aug 02, 2011 3:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: clob to long varchar
Replies: 4
Views: 2374

clob to long varchar

My ddl : create table test1 ( id number, ship_xml clob ); Ds design : Oracle source ----> Oracle Target Source query : select id,dbms_lob.substr( ship_xml, 4000, 1 ) as ship_xml from akrishb.test1 I used the above query as the job failed when i tried with ship_xml alone giving the following error. O...
by dsscholar
Thu Jul 28, 2011 4:59 am
Forum: General
Topic: Guide for sequencer stages
Replies: 2
Views: 1450

Guide for sequencer stages

My query : In email notification stage, is it possible to give status mess dynamically.. Another query: I understand this is not the right place to ask about where i can find the guide for sequencer stages. But i am unable to find one. I am able to find only for job processing,database,file and debu...
by dsscholar
Thu Jul 28, 2011 1:52 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Auto Partitioning
Replies: 1
Views: 1183

Auto Partitioning

Hi, " Typically InfoSphere DataStage would use round robin when initially partitioning data, and same for the intermediate stages of a job " from parallel jobs developers guide. So i went for partitioning logic myself. Job design: Source ---> lookup1 (2 reference tables) ----> lookup2 ( 2 ...
by dsscholar
Wed Jul 27, 2011 2:31 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: SQL server load performance issue
Replies: 7
Views: 2220

i have tried loading with dataset but performance is still same (1900 rows/sec). We have discussed for BCP but there is storage memory issue so we can't choose that option. Is there any other way to boost the loading?