Weird result:- sequencial file reading improper data

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
meet_deb85
Premium Member
Premium Member
Posts: 132
Joined: Tue Sep 04, 2007 11:38 am
Location: NOIDA

Weird result:- sequencial file reading improper data

Post by meet_deb85 »

Hi All,

I have very simple dimension job whose source is sequencial file.Sequencial file has data like:-

"CUST_TYPE","E","Existing","N/A"
"CUST_TYPE","P","Prospect","N/A"
"CUST_TYPE","O","Others","N/A"
"CUST_TYPE","X","NOT AVAILABLE","N/A"

But in datastage env. it is skiping first line.

My setting in sequencial file is:-

First line as column name- False
Format:-

Delimiter:- comma
Final Del:- end
Quote:- double


Please help me to resove this issue


thanks
kumar_s
Charter Member
Charter Member
Posts: 5245
Joined: Thu Jun 16, 2005 11:00 pm

Post by kumar_s »

Is target a Table?
If its a sequential file, check for the same "First like" setting in target file stage also.
Else check if you get any warning in Director log, saying for the record reject.
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'
meet_deb85
Premium Member
Premium Member
Posts: 132
Joined: Tue Sep 04, 2007 11:38 am
Location: NOIDA

Post by meet_deb85 »

Hi

I want to add more on this:-

I m reading source file as a parameter like

PQE*MNI*.#PARAM1#.*.2010-06-10

In this case its reading only three records of type "CUST_TYPE"

But when i m hardcording the filename its reading all the records from the file.

Please suggest me what could be a reason??
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Assuming you aren't getting runtime warnings, if you do a "View Data" in the designer, does the first line get show? If yes, then most likely you are dropping that line somewhere in your job.

Addition (I just saw your 2nd post after writing my response)
The likely reason is that you are reading a different file or files from that which you think you are reading. Are you actually using wildcard "*"s as the file name?
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Are you absolutely sure that "first line is column names" is false? For example, might you have changed it from "true" and not re-compiled?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
meet_deb85
Premium Member
Premium Member
Posts: 132
Joined: Tue Sep 04, 2007 11:38 am
Location: NOIDA

Post by meet_deb85 »

When i copied that file to some other path,and i read this file using same file pattern,it is able to read all four records......
kumar_s
Charter Member
Charter Member
Posts: 5245
Joined: Thu Jun 16, 2005 11:00 pm

Post by kumar_s »

So, did you check if there is any another file with similar file mask as specified in previous directory.
But being similar, should be added up to the existing file though.
If you put your file back to the earliar directory gives you only 3 record?
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'
meet_deb85
Premium Member
Premium Member
Posts: 132
Joined: Tue Sep 04, 2007 11:38 am
Location: NOIDA

Post by meet_deb85 »

kumar_s wrote:So, did you check if there is any another file with similar file mask as specified in previous directory.
But being similar, should be added up to the existing file though.
If you put your file back to the earliar directory gives you only 3 record?
Yes...when i am putting file back to earlier directory...its giving 3 records only
Post Reply