Datastage sequential file

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
Sandeepch19
Participant
Posts: 36
Joined: Fri May 21, 2010 12:40 am
Location: Bangalore

Datastage sequential file

Post by Sandeepch19 »

There is a file with n rows but sequential source stage is only considering
n-3 rows--we are reading it as DOS file
Sandeep Chandrashekar
dsusersaj
Premium Member
Premium Member
Posts: 160
Joined: Mon Dec 17, 2007 10:44 am

Re: Datastage sequential file

Post by dsusersaj »

Do you see any warnings?.
Is the option 'First Line column Name' set to True?
Do you exactly see the last 3 records being omitted when you view data or is it getting diplayed adjacent to the last record when you view data?.If so what is the record delimiter that you have specified?.
SURA
Premium Member
Premium Member
Posts: 1229
Joined: Sat Jul 14, 2007 5:16 am
Location: Sydney

Re: Datastage sequential file

Post by SURA »

Try to open it in vi editor (if it is small). Understand the file.

Use reject link while read the data and try to find what the issue is.

DS User
Sandeepch19
Participant
Posts: 36
Joined: Fri May 21, 2010 12:40 am
Location: Bangalore

Re: Datastage sequential file

Post by Sandeepch19 »

In the source itself these three records are being ignored. and this is in between the records. its a dos file and contains ^M\n towords the end of each record.all three records are coming in newline.
Sandeep Chandrashekar
kandyshandy
Participant
Posts: 597
Joined: Fri Apr 29, 2005 6:19 am
Location: Singapore

Post by kandyshandy »

Sandeep, did you run the job at the first place or just viewing data in sequential file?

Even if a record does not meet the expected format, it will be rejected. So run the job and see what happens.

As suggested by another friend, use reject link & try!!
Kandy
_________________
Try and Try again…You will succeed atlast!!
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Server jobs don't have reject links on Sequential File stage.

Are there any warnings in the job log?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Sandeepch19
Participant
Posts: 36
Joined: Fri May 21, 2010 12:40 am
Location: Bangalore

Post by Sandeepch19 »

there are no warnings in the job log.
Sandeep Chandrashekar
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

As a test, can you try reading from the file with the metadata describing only one field, say VarChar(2000) data type?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
kandyshandy
Participant
Posts: 597
Joined: Fri Apr 29, 2005 6:19 am
Location: Singapore

Post by kandyshandy »

My bad Ray. I did not notice that it is a server job.

Sandeep, did you find out what was wrong?
Kandy
_________________
Try and Try again…You will succeed atlast!!
Post Reply