Search found 614 matches

by kollurianu
Wed Oct 06, 2010 2:58 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: double quotes in the field values.
Replies: 1
Views: 1613

double quotes in the field values.

Hi All , I have file csv with double quotes and the data is as below , Though the format in datastage job is given as Delimiter=, quotes=double For two of the fields Misc Description and Security description ,when the data is viewed thru datastage browser the values still contain double quotes. Beca...
by kollurianu
Thu Sep 30, 2010 11:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sequential stage file view error.
Replies: 2
Views: 1597

Sequential stage file view error.

Hi All , When I am trying to view empty file I am getting following error messages , I would expect the message to be file is emptyor just see the header column names. Any inputs on why I am getting below messages. It runs 1 process on 1 node. ##I TOIX 000163 12:11:25(000) <Copy_of_src_Corporate_Act...
by kollurianu
Tue Sep 28, 2010 1:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sequential stage quote=double, how does that work?
Replies: 5
Views: 2077

anbu wrote:CSV file without quotes and CSV with quotes will be read properly by using your format setting
Thanks for your response anbu !
by kollurianu
Tue Sep 28, 2010 1:19 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: offset warning in the sequential stage
Replies: 4
Views: 4151

ray.wurlod wrote:Remember that the first record is number 0. So record 27 is the twenty-eighth record in the file. Offset 0 is the beginning of the file, and the first character of your file in that line is {0d} - that is, a line feed character.
Thanks Ray! for your response and explanation.
by kollurianu
Tue Sep 28, 2010 1:15 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sequential stage quote=double, how does that work?
Replies: 5
Views: 2077

Sequential stage quote=double, how does that work?

Hi All , In Sequential stage , in the format tab if the values are set as delimiter=comma and quote= double , ie; if I have files coming as csv without quotes and a csv with quotes , can I have the properties set as above.. I tried reading for csv without quotes and csv with quotes and it read the f...
by kollurianu
Tue Sep 28, 2010 11:03 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: In the Sort output I need get record with minimum time diff
Replies: 2
Views: 989

In the Sort output I need get record with minimum time diff

Hi All, I 've the data in following way field 5 is time difference in seconds. I've sorted and hash partioned the output with fields 2,3,4,5 and would be as below x1, a,b,c, 10 x2, a,b,c,10 x3, a,b,c,30 x4, a,b,c,40 x5, a1,b1,c1,5 x6,a1,b1,c1,10 x6,a1,b1,c1,15 From the above output I need get the fo...
by kollurianu
Fri Sep 24, 2010 1:20 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sort stage warnings
Replies: 3
Views: 2253

I did that still remove duplicates is giving a warning as below

rmv_dup: When checking operator: User inserted sort "rmv_dup.lnk_to_rem_dup_Sort" does not fulfill the sort requirements of the downstream operator "rmv_dup"
by kollurianu
Fri Sep 24, 2010 11:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Warning in Sort and Rem Duplicates stages.
Replies: 1
Views: 1873

Warning in Sort and Rem Duplicates stages.

Hi All, I am getting following warnings in Sort and Remove duplicates stages. For sort stage below warning sort_time_diff: Data claims to already be sorted on the specified keys the 'sorted' option can be used to confirm this. Data will be resorted as necessary. Performance may improve if this sort ...
by kollurianu
Fri Sep 24, 2010 11:00 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sort stage warnings
Replies: 3
Views: 2253

Sort stage warnings

Hi All, I am getting following warnings in sort stage, sort_time_diff: Data claims to already be sorted on the specified keys the 'sorted' option can be used to confirm this. Data will be resorted as necessary. Performance may improve if this sort is removed from the flow Any thoughts why I am getti...
by kollurianu
Tue Sep 21, 2010 2:02 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: difference in timestamps..
Replies: 4
Views: 2438

Thank you all for your responses. But my input times are from file (ie; is varchar) and as below Time 1 is 8/4/2010 12:40 Time 2 is 8/4/2010 12:41 I see many functions are available but could someone please suggest me with some data/time functions with exact format as help is not very clear for me. ...
by kollurianu
Mon Sep 20, 2010 10:35 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to lookup for the closest value?
Replies: 6
Views: 1833

Re: How to lookup for the closest value?

Hi All, How to lookup for the closest value for time as below , Settle Dates are same AND Share Quantity are same AND Mainframe Time Stamp are same or the closest AND The first 3 digits of the SS Asset ID for both the records are same. Mainframe Time Stamp format is 8/20/2010 16:04 source and targe...
by kollurianu
Fri Sep 17, 2010 12:59 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to lookup for the closest value?
Replies: 6
Views: 1833

is there any way simpler to acheive this?

Thanks for your response PhilHibbs , do you have a simpler way to acheive this ?

Thank you all in advance.
by kollurianu
Fri Sep 17, 2010 9:03 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to lookup for the closest value?
Replies: 6
Views: 1833

How to lookup for the closest value?

Hi All, How to lookup for the closest value for time as below , Settle Dates are same AND Share Quantity are same AND Mainframe Time Stamp are same or the closest AND The first 3 digits of the SS Asset ID for both the records are same. Mainframe Time Stamp format is 8/20/2010 16:04 source and target...
by kollurianu
Wed Sep 15, 2010 11:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: log in the director
Replies: 2
Views: 1225

log in the director

Hi All , For a job in the director after I run , I am not able to see all the log from the beginning ie; setting up of environment variables ...all those, even if i scroll up it does not show from the start point , and this job has lot stages in it and it is bit big one .. is this the reason that I ...
by kollurianu
Wed Sep 15, 2010 8:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: offset warning in the sequential stage
Replies: 4
Views: 4151

offset warning in the sequential stage

Hi All ,

I am getting the following warning for a csv file

seq_src_PORTFOLIO_LKP,0: Delimiter for field "IP_PORTFOLIO" not found; input: {0d}, at offset: 0

seq_src_PORTFOLIO_LKP,0: Import warning at record 27.

any inputs greatly appreciated , thanks in advance.