Search found 73 matches

by pkll
Wed Apr 10, 2013 9:52 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ERROR Reading source file
Replies: 5
Views: 6211

ERROR Reading source file

Hi, When i am reading file from source i am getting bellow error.. My souce file has 13KB(32,000 records) only,delimiter is '|'. For testing purpose i have taken 10 rows it is working fine,when i have given total file the bellow error is coming. Let me know why i am getting this error? ##E IIS-DSEE-...
by pkll
Wed Apr 03, 2013 12:15 pm
Forum: General
Topic: How to rename and run daily basis jobs?
Replies: 7
Views: 3257

Hi Chulett, Filename is a standalone parameter(in my example file is SDP101.00011)daily the filename will be change(means date or month and records also). Ex:today file is=201304040048.SDP101.00011.7190054 tomorrow file is like=201304050048.SDP101.00011.8040073 In the above example date has been cha...
by pkll
Wed Apr 03, 2013 7:38 am
Forum: General
Topic: How to rename and run daily basis jobs?
Replies: 7
Views: 3257

I have not yet work on script and routines.Can any one help me how to write script or routines about this senario?
by pkll
Wed Apr 03, 2013 6:35 am
Forum: General
Topic: How to rename and run daily basis jobs?
Replies: 7
Views: 3257

How to rename and run daily basis jobs?

Hi, I have one file:201304040048.SDP101.00011.7190054(Today file) tomorrow may be i will get same file like 201304050048.SDP101.00011.8040073 and dayafter tomorrow i will get like 201304060048.SDP101.00011.8140813.... In the above example 2013(Year),04(month),04(day),0048( time),SDP101.00011(Filenam...
by pkll
Mon Mar 25, 2013 8:18 pm
Forum: General
Topic: How to Unzip files using datastage?
Replies: 11
Views: 9500

Re: How to Unzip files using datastage?

Hi priyadarshikunal,Ray, Yes, Ray is correct I am trying to expand data and extract that data from source. I am using 32 bit windows operating system and datastage 8.5. I am getting file from Client in zip format like (test.gz). After unzip The file the size is 4.5GB. But, as per my requirment i don...
by pkll
Mon Mar 25, 2013 9:34 am
Forum: General
Topic: How to Unzip files using datastage?
Replies: 11
Views: 9500

How to Unzip files using datastage?

Hi, I have a requirement where in need of unzip the files using Unix/through datastage execute command or before or after subroutines . For example my file name is test.gz I have 271,339 KB of zipped data.I have tried to unzip that data manually,after unzip the file size is 4.5GB(I have done manuall...
by pkll
Mon Mar 25, 2013 1:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to split Array in datastage?
Replies: 8
Views: 11107

Hi Prasson, Thanks for ur reply.It is working fine. But,From Transformer to Transformer Stage i am getting 31000 records per second. From Sequential File to Transformer I am getting 1500 records per second only .Atleast i need to reach 10000 records per second. I have used 4 Node configuration , i u...
by pkll
Wed Mar 20, 2013 5:20 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to Split the Huge Data?
Replies: 9
Views: 4974

Hi crystal, i am getting below error.. Sequential_File_0,0: Error reading on import. Sequential_File_0,0: Consumed more than 100,000 bytes looking for record delimiter; aborting Sequential_File_0,0: Import error at record 0. Sequential_File_0,0: The runLocally() of the operator failed. But,Tail comm...
by pkll
Wed Mar 20, 2013 4:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to Split the Huge Data?
Replies: 9
Views: 4974

How to Split the Huge Data?

Hi, I have 4GB Source data,i splitted 2GB,2GB By using like this my filename is CALL_HISTORY_DETAILS.txt c:/NRD> du -sh CALL_HIST_DETAILS.txt---->(It contains the file size(4GB)) c:/NRD>wc -l CALL_HIST_DETAILS.txt------->total count is 9868002 C:/NRD>head -4934001 CALL_HIST_DETAILS.txt > test.txt C:...
by pkll
Sun Mar 17, 2013 11:28 pm
Forum: General
Topic: How to Read zip file ?
Replies: 9
Views: 4445

Hi Chulett,

My source is sequential file.I have to read 4GB zip data from source.i am able to read 2GB of zip data.but, i am unable to read morethan 4GB zip data.
Could you please help me how to read morethan 4GB zip data from source?
by pkll
Sun Mar 17, 2013 8:51 pm
Forum: General
Topic: How to Read zip file ?
Replies: 9
Views: 4445

Thanks for your Reply... But, I have tried before job subroutine, Filter command in sequential file and command activity. These are supporting only below 2GB of data. It is not supporting 4GB.When I tried to 4GB of data job is aborted. Error is : Sequential_File_0,0: Consumed more than 100,000 bytes...
by pkll
Fri Mar 15, 2013 2:52 am
Forum: General
Topic: How to Read zip file ?
Replies: 9
Views: 4445

How to Read zip file ?

Hi,
I have one requirment, I need to read zip file from source sequential file.My data size is more than 4GB.

Could you please help me how to read zip file?
by pkll
Fri Mar 08, 2013 5:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to split Array in datastage?
Replies: 8
Views: 11107

How to split Array in datastage?

Hi, I Have Source file Like, I/P ----- custname,custno KIRAN,[323~96.949900~7.210000][384~120.000000~0.000000][443~0.000000~0.000000][463~0.000000~0.000000][763~0.000000~0.000000][783~0.000000~0.000000][704~0.000000~0.000000] i have morethan more than 100 arrays. I want output like o/p ---- custname...