Search found 101 matches

by knowledge
Tue Jan 22, 2008 2:05 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: address cleansing
Replies: 7
Views: 2381

address cleansing

Hi , I have to clease and match address records, one source has ST and ST. and other has STREET , many more like this(like AVE. CIRC.). i have to write routine or or unix script to cleanse this data and spell out so that I can match 2 records coming from different sources , i have simple routine : L...
by knowledge
Wed Jan 09, 2008 4:31 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: xml reject
Replies: 0
Views: 601

xml reject

Hi All, I am working on xml , and processed many xml file from same site(vendor) , but now I am having problem loading new file (different xsd) though I am following same procedure which I did for previous files ... here I have few questions , 1: how to create xsd ( column definition ) for xml input...
by knowledge
Sun Nov 18, 2007 8:22 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: white spaces in xml
Replies: 9
Views: 2284

[quote="eostic"]Good solution.. This is a tough one. White space is generally supposed to be ignored as meaningless by XML.... seems various tools are treating it differently.

Ernie[/quote]
yes,
U r right,
Thanks .
by knowledge
Fri Nov 16, 2007 9:18 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: white spaces in xml
Replies: 9
Views: 2284

[quote="ray.wurlod"]You could filter it through a [b]sed [/b]or [b]awk [/b]command (or maybe even [b]tr [/b]depending on your exact requirements). ...[/quote] Hi All, I thought the same but when I contacted vendor , he said he will resend all files replacing ' 8' by '8.0' So for time being...
by knowledge
Fri Nov 16, 2007 8:30 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: white spaces in xml
Replies: 9
Views: 2284

Hi Ray, How can I preprocess file ? I am getting file from vendor ? Is there any way I can pre process it , please suggest.(I checked through validator , it validates ok but fails in datastage) Hi Ernie, I have downloaded validator from vendor site , all error files validated ok , I checked the file...
by knowledge
Thu Nov 15, 2007 8:29 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: white spaces in xml
Replies: 9
Views: 2284

white spaces in xml

Hi , I am getting following error in xml input stage: The job design is folder stage....> xml input stage...> seq file stage. [b]XML input document parsing failed. Reason: Xalan error (publicId: , systemId: , line: 826, column: 22): Datatype error: Type:InvalidDatatypeValueException, Message:Value '...
by knowledge
Wed Oct 24, 2007 2:19 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: errors in xml
Replies: 6
Views: 2432

Hi Ernie , thanks a lot for ur reply , First of all i am working time on xml for the first , so do not know , is it poorly documented xml or good one not . This is just one file which represents one patient record , so all different elemments like <E07_30> etc represents different columns(info of sa...
by knowledge
Tue Oct 23, 2007 5:48 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: hash file (100 % hard disk usage)
Replies: 8
Views: 2854

Thanks for the replay ,

I talked to him , he said I have to tune hash file ..........
by knowledge
Tue Oct 23, 2007 5:46 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: hash file (100 % hard disk usage)
Replies: 8
Views: 2854

Thanks for the replay ,

I talked to him , he said I have to tune hash file ..........
by knowledge
Tue Oct 23, 2007 4:47 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: hash file (100 % hard disk usage)
Replies: 8
Views: 2854

[quote="ray.wurlod"]What do you expect? A hashed file is on disk - you are writing 4.5 million rows to disk. Not much else is happening, so it shows the disk subsystem to be 100% busy. That ought to be no surprise. ...[/quote] Sorry I donot have premium membership.can u please tell me what...
by knowledge
Tue Oct 23, 2007 3:36 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: hash file (100 % hard disk usage)
Replies: 8
Views: 2854

hash file (100 % hard disk usage)

Hi , I am having problem using hash file , I am processing about 4.5 millions records , passing through hash file to remove duplicates , but it is using all i/o and its using 100 % harddisk ,its slows down the server , wait queue becomes more than 3 ............ Is it because it is exceding hash fil...
by knowledge
Tue Oct 23, 2007 8:17 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: errors in xml
Replies: 6
Views: 2432

Hi , here is the sample of xml file : Please let me know if I am doing something wrong , i am just processing tags <D01_01>,<E01_01>,<E02_12>, all <E14> tags in one of my job , I have marked <E14_01> as repeting element , I have checked all the option under transformation setting in input xml stage ...
by knowledge
Tue Oct 23, 2007 7:40 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: errors in xml
Replies: 6
Views: 2432

[quote="balajisr"]Are you validating xml with the xsd? Looks like xml does not conform with the xsd.[/quote]
I am very new to xml , can you please tell me what to do .
by knowledge
Mon Oct 22, 2007 9:20 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: errors in xml
Replies: 6
Views: 2432

errors in xml

Hi, My job design is , folder....> xml input...> seq file . 1: I am processing xml files . in the xml files I do not have following tags , eg 'D01_05' or 'D01_19' etc but then too its giving me following error , ********************88 Xalan error (publicId: , systemId: , line: 8, column: 13): Unknow...
by knowledge
Mon Oct 22, 2007 8:57 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: XML all records in same file
Replies: 6
Views: 3077

XML all records in same file(resolved)

[quote="knowledge"]Hi sachin, How can I check repeating element , as there are many repeating elements in the same file ,At a time I can only select one repeating element in xml input stage, can u Please elaborate ....... In my file I will have all repeating tags for different patients Tha...