Sequential file load problem

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
ady
Premium Member
Premium Member
Posts: 189
Joined: Thu Oct 12, 2006 12:08 am

Sequential file load problem

Post by ady »

I'm trying to load a sequential file created as output in a server job in a parallel job. I am unable to view load or view the data, the error that pops up is :



##I TFCN 000001 16:52:17(000) <main_program>
DataStage XE Parallel Extender V7.0.0
Copyright (C) 2003, 1997 - 2002 Ascential Software, Inc.
All Rights Reserved


##I TOSH 000002 16:52:17(001) <main_program> orchgeneral: loaded
##I TOSH 000002 16:52:17(002) <main_program> orchsort: loaded
##I TOSH 000002 16:52:17(003) <main_program> orchstats: loaded
##I TFSC 000001 16:52:17(004) <main_program> APT configuration file: /ascential/datastage/70/UND/Ascential/DataStage/Configurations/default.apt
##W TCOS 000049 16:52:18(000) <main_program> Parameter specified but not used in flow: _APT_CONFIG_FILE
##W TCOS 000049 16:52:18(001) <main_program> Parameter specified but not used in flow: _SeqFilePath
##W TCOS 000049 16:52:18(002) <main_program> Parameter specified but not used in flow: DSProjectMapName

##W TOIX 000000 16:52:19(000) <Sequential_File_0,0> Field "UPDATE_DATE" has import error and no default value; data: {0 3 / 2 1 / 1 9 9 9}, at offset: 265
##W TOIX 000154 16:52:19(001) <Sequential_File_0,0> Import warning at record 0:
##W TOIX 000018 16:52:19(002) <Sequential_File_0,0> Import unsuccessful at record 0:
##W TOIX 000000 16:52:19(003) <Sequential_File_0,0> Field "UPDATE_DATE" has import error and no default value; data: {0 5 / 1 7 / 1 9 9 6}, at offset: 267
##W TOIX 000154 16:52:19(004) <Sequential_File_0,0> Import warning at record 1:
##W TOIX 000018 16:52:19(005) <Sequential_File_0,0> Import unsuccessful at record 1:
##W TOIX 000000 16:52:19(006) <Sequential_File_0,0> Field "UPDATE_DATE" has import error and no default value; data: {1 1 / 1 2 / 1 9 9 1}, at offset: 266
##W TOIX 000154 16:52:19(007) <Sequential_File_0,0> Import warning at record 2:
##W TOIX 000018 16:52:19(008) <Sequential_File_0,0> Import unsuccessful at record 2:
##W TOIX 000000 16:52:19(009) <Sequential_File_0,0> Field "UPDATE_DATE" has import error and no default value; data: {0 5 / 1 0 / 1 9 9 3}, at offset: 265
##W TOIX 000154 16:52:19(010) <Sequential_File_0,0> Import warning at record 3:
##W TOIX 000018 16:52:19(011) <Sequential_File_0,0> Import unsuccessful at record 3:
##W TOIX 000000 16:52:19(012) <Sequential_File_0,0> Field "UPDATE_DATE" has import error and no default value; data: {1 0 / 3 1 / 1 9 9 0}, at offset: 267
##W TOIX 000154 16:52:19(013) <Sequential_File_0,0> Import warning at record 4:
##W TOIX 000018 16:52:19(014) <Sequential_File_0,0> Import unsuccessful at record 4:
##I TOIX 000157 16:52:19(015) <Sequential_File_0,0> (no further reports will be generated from this partition until successful import)
##I TOIX 000156 16:52:19(016) <Sequential_File_0,0> Progress: 10 percent
##I TOIX 000156 16:52:19(017) <Sequential_File_0,0> Progress: 20 percent
##I TOIX 000156 16:52:19(018) <Sequential_File_0,0> Progress: 30 percent
##I TOIX 000156 16:52:19(019) <Sequential_File_0,0> Progress: 40 percent
##I TOIX 000156 16:52:19(020) <Sequential_File_0,0> Progress: 50 percent
##I TOIX 000156 16:52:19(021) <Sequential_File_0,0> Progress: 60 percent
##I TOIX 000156 16:52:19(022) <Sequential_File_0,0> Progress: 70 percent
##I TOIX 000156 16:52:19(023) <Sequential_File_0,0> Progress: 80 percent
##I TOIX 000156 16:52:19(024) <Sequential_File_0,0> Progress: 90 percent
##I TOIX 000163 16:52:19(025) <Sequential_File_0,0> Import complete. 0 records imported successfully, 27768 rejected.
**VIEWDATA ROW LIMITER HIT**



What seems to be the problem ?, What am I doin wrong with the parameter ??
us1aslam1us
Charter Member
Charter Member
Posts: 822
Joined: Sat Sep 17, 2005 5:25 pm
Location: USA

Post by us1aslam1us »

Hi Aditya,

There might be two reasons for this:

1. There might be line terminators or delimiters which are creating this. try to get rid of them.

2. Check the Datatype for the particular field and check the default value and Null properties.

Sam
ady
Premium Member
Premium Member
Posts: 189
Joined: Thu Oct 12, 2006 12:08 am

Post by ady »

Tried specifying the delimiters, record length in the seq stage. But it does not work.

By default DS takes Final delimiter = end, Delimiter = comma, Quote= Double. The datatype of the source file is CHAR for all columns.
kumar_s
Charter Member
Charter Member
Posts: 5245
Joined: Thu Jun 16, 2005 11:00 pm

Post by kumar_s »

Metadata specified does not match to the given file layout. Check for UPDATE_DATE, for which it is complaining about. It has the values in the pattern of mm/dd/yyyy. What is the data type that been specified?
If you cannot nail down, change it to varchar and view the data.
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'
ady
Premium Member
Premium Member
Posts: 189
Joined: Thu Oct 12, 2006 12:08 am

Post by ady »

VARCHAR worked ! ... Thanks guys! :D
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Is this a server job or a parallel job?

Please mark the post as resolved.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply