Problem viewing the sequential file

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
sshettar
Premium Member
Premium Member
Posts: 264
Joined: Thu Nov 30, 2006 10:37 am

Problem viewing the sequential file

Post by sshettar »

Hi All,

Well i have this job where i get the sequential file which is created in the server job . this file has delimiter as , and quotes as " on the server side
but when i try to view this file in the parallel job with the delimiter as comma and quotes as double i see that few of the fields as displayed with the double quotes .
how do i get rid of these double quotes here in the pararrel job?

Could somebody plz help me with this issue

Thanks in advance
I_Server_Whale
Premium Member
Premium Member
Posts: 1255
Joined: Wed Feb 02, 2005 11:54 am
Location: United States of America

Re: Problem viewing the sequential file

Post by I_Server_Whale »

sshettar wrote: but when i try to view this file in the parallel job with the delimiter as comma and quotes as double i see that few of the fields as displayed with the double quotes .
What are the datatypes of those few fields?
Anything that won't sell, I don't want to invent. Its sale is proof of utility, and utility is success.
Author: Thomas A. Edison 1847-1931, American Inventor, Entrepreneur, Founder of GE
roy
Participant
Posts: 2598
Joined: Wed Jul 30, 2003 2:05 am
Location: Israel

Post by roy »

Hi,
How do you see this info with a regular text editor outside DS?
Roy R.
Time is money but when you don't have money time is all you can afford.

Search before posting:)

Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
Image
sshettar
Premium Member
Premium Member
Posts: 264
Joined: Thu Nov 30, 2006 10:37 am

Post by sshettar »

All the fields are of data type are Varchar
narasimha
Charter Member
Charter Member
Posts: 1236
Joined: Fri Oct 22, 2004 8:59 am
Location: Staten Island, NY

Post by narasimha »

Try reading it using a hex editor like UltraEdit or xvi32 and check if you see something different.
Narasimha Kade

Finding answers is simple, all you need to do is come up with the correct questions.
jdmiceli
Premium Member
Premium Member
Posts: 309
Joined: Wed Feb 22, 2006 10:03 am
Location: Urbandale, IA

We had a similar problem...

Post by jdmiceli »

Hi all,

We had a problem similar to this. The main issue was that our data could legitimately hold quotes as part of the field. What we did was to take Ken Bland's advice and make our delimiter the pipe symbol ( | ) and then change the text delimiter on the file to be three zeroes ( 000 ). He also suggested checking the box that makes the first row the field names. When we did this, all our problems of this annoying ilk went away.

Give it a shot!

Bestest,
Bestest!

John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services


"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
jdmiceli
Premium Member
Premium Member
Posts: 309
Joined: Wed Feb 22, 2006 10:03 am
Location: Urbandale, IA

clarification

Post by jdmiceli »

Just to allay confusion before it starts:

I meant to say that the delimiter is the pipe symbol ( | ) and the quote character would be three zeroes ( 000 ). Just in case you need to know where these settings are, they are found in the Sequential file stage --> Inputs --> Format. The check box for 'First line is column names' is on the left, and the other two fields are on the right.

Hope this helps!
Bestest!

John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services


"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
kcbland
Participant
Posts: 5208
Joined: Wed Jan 15, 2003 8:56 am
Location: Lutz, FL
Contact:

Post by kcbland »

Do the data fields contain double double-quotation marks? Physically view the file outside of datastage and confirm.
Kenneth Bland

Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Re: clarification

Post by chulett »

jdmiceli wrote:Just to allay confusion before it starts:

I meant to say that the delimiter is the pipe symbol ( | ) and the quote character would be three zeroes ( 000 ).
And just to further allay confusion for anyone who's never played with those settings before - setting the quote character to three zeroes doesn't mean it will use three zeros. It is the secret signal to DataStage to not use (or expect) any quote characters in the file. :wink:

Any quotes, if present, would then be treated as part of the data.
-craig

"You can never have too many knives" -- Logan Nine Fingers
kcbland
Participant
Posts: 5208
Joined: Wed Jan 15, 2003 8:56 am
Location: Lutz, FL
Contact:

Post by kcbland »

And to clarify chuletts allaying of confusion, 000 is the ASCII decimal value for NULL. In the good old days of serial communications, you would use a keyboard to type values over the serial line. When you needed to send a high or low ASCII character, you would hold down your ALT key and type in the 3-digit ASCII value of the character you want. We could sent bell characters (ding) that way, hangups, whatever.

To get a capital A, hold down your ALT key and type 065 on your keyboard and then release the ALT key. Viola, a letter A pops up. You can do this today to get any low/high-ASCII character typed anywhere.
Kenneth Bland

Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

I left that part for you, Ken. :lol:

(ding)
-craig

"You can never have too many knives" -- Logan Nine Fingers
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

000 is the ASCII decimal value for NUL. This is not the same thing as NULL, which is represented differently by different vendors. For example, within DataStage an out-of-band NULL is represnted by -128.

0000 is the Unicode decimal value for NUL.

You can also specify non-printing delimiter or quote characters using a three digit decimal ASCII code or a four digit hexadecimal Unicode code.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply