Search found 73 matches

by kaushal.kumar@igate.com
Sun Mar 21, 2010 9:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: can i delete files from load directory using datastage??
Replies: 9
Views: 6749

Can you use a Server job for this, that would be fairly simple to build. Or are you one of those shops where only PX jobs are allowed because Server jobs are some kind of evil? :? lol.....for me server jobs are not evil :D ..i can go for server job routine also..i don't thik for delete process it w...
by kaushal.kumar@igate.com
Sat Mar 20, 2010 10:43 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: can i delete files from load directory using datastage??
Replies: 9
Views: 6749

Sure but it really depends on when you need to do this. A custom routine in BASIC using DSExecute() would be fairly simple to build and could be called 'after job' but you'd have to let us know how that would work for you, timing and/or process flow wise. How were you planning on implementing your ...
by kaushal.kumar@igate.com
Sat Mar 20, 2010 10:03 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: node and partision problem????
Replies: 6
Views: 3115

ray.wurlod wrote:Not for me.

Define "performance" in an ETL context.

What's more important - speed or correct results?
correct result is more important,but i have to read more then 20 huge files so speed will also come in count?
by kaushal.kumar@igate.com
Sat Mar 20, 2010 10:01 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: can i delete files from load directory using datastage??
Replies: 9
Views: 6749

Yes, and you have all kinds of options to accomplish that. Bottom line, you just need to run "DEL <filename>" from the O/S. This can be done in a custom routine, before/after job directly or with a script, in a Sequence job with the Execute Command stage... etc etc... can i write a custom...
by kaushal.kumar@igate.com
Sat Mar 20, 2010 9:59 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job control process (pid 2100) has failed ?????
Replies: 7
Views: 6990

Not just from that message... how exactly are you 'calling one job inside another job'? Are there any other messages logged, parent or child? ... i am passing parameter value ,parameter name ,job name to a routine and i am using this routine inside a transformer of parents job. in parents job i got...
by kaushal.kumar@igate.com
Sat Mar 20, 2010 4:53 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job control process (pid 2100) has failed ?????
Replies: 7
Views: 6990

Job control process (pid 2100) has failed ?????

Hi,
I am calling one job inside other job.
My child job is giving warning Job control process (pid 2100) has failed and gets aborted.
Please advice how to resolve this :(
by kaushal.kumar@igate.com
Sat Mar 20, 2010 3:26 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: can i delete files from load directory using datastage??
Replies: 9
Views: 6749

can i delete files from load directory using datastage??

Hi, Below is my requirement. read files from load dir --> put it into staging area table-----> business validation---> put it into o/p files in target dir. Once i will have data in target dir,i am goin to set flag in one of the control table with staus"S" or "W" for that particul...
by kaushal.kumar@igate.com
Sat Mar 20, 2010 2:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: node and partision problem????
Replies: 6
Views: 3115

ray.wurlod wrote:Force the Transformer stage to execute in Sequential mode. ...
will it give performance problem :?:
by kaushal.kumar@igate.com
Sat Mar 20, 2010 1:26 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: node and partision problem????
Replies: 6
Views: 3115

node and partision problem????

Hi , I have to read files from load directory.I am passing file location and file name as parameter.My job is able to pick files from partcular location,But details of record is not coming in same sequence what we have in input . For example in my input i have record as.. HDR JD685675 05\03\2010 DTL...
by kaushal.kumar@igate.com
Fri Mar 19, 2010 6:42 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Getting warning message in sequential file stage
Replies: 4
Views: 3013

ray.wurlod wrote:It may be that your last line in the file lacks a record delimiter character.

That's why EOF was unexpectedly encountered. ...
thanks a lot :)
by kaushal.kumar@igate.com
Fri Mar 19, 2010 4:59 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Getting warning message in sequential file stage
Replies: 4
Views: 3013

Getting warning message in sequential file stage

Hi,

I am getting Sequential_File_11,0: Missing record delimiter " ", saw EOF instead " warning message in sequential file stage.I am reading fixed width length file.
Please advice :(
by kaushal.kumar@igate.com
Mon Mar 15, 2010 3:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Stored procedure stage error???
Replies: 1
Views: 1324

Stored procedure stage error???

I am getting error at run time for stored procedure stage as below.
SrcDepdSp,0: Warning: RBTTBIS_DEPD_CHCK.SrcDepdSp: SQLSTATE = 42000, fNativeError = 8146
Please advice how to solve it? :(
by kaushal.kumar@igate.com
Thu Mar 11, 2010 11:06 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: read all files from load directory
Replies: 11
Views: 3199

In the sequential file properties tab, click on 'options' and you'll see that you have a property call 'File Name Column', activate that and choose the column name that you would like to use. ... hi ArndW , i have used 'File Name Column'=xyz. but in output i am not getting my file name which i have...
by kaushal.kumar@igate.com
Thu Mar 11, 2010 10:50 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: read all files from load directory
Replies: 11
Views: 3199

Can you not try using a file pattern in the sequential file stage, which will also give you the file name as an additional column if you so desire. ... in sequential file i have defined file patern=#$LoadDir#\*.* in option properties i have defined file name column-xyz now i have doubt..in column t...
by kaushal.kumar@igate.com
Thu Mar 11, 2010 10:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: read all files from load directory
Replies: 11
Views: 3199

Sreenivasulu wrote:Run as follows

ls(comand activity. ls with appropriate option) ->startloop->Uservariable(read the output of ls) ->Job->endloop

Regards
Sreeni
hi Sreenivasulu,

will this job read all file record and file name one by one :?:
please advice