Reading/Importing issues in sequential stage

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
kollurianu
Premium Member
Premium Member
Posts: 614
Joined: Fri Feb 06, 2004 3:59 pm

Reading/Importing issues in sequential stage

Post by kollurianu »

Hello All,


I am reading a comma separated file in a sequential file stage
which is giving following warnings and these records are not being processed by the job , I guess becos of import warnings.



ipfile,0: Field "PC" has import error and no default value; data: <empty>, at offset: 12

ipfile,0: Import warning at record 5.

can somebody explain me the error that it is complaining about.

Thanks in advance.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Can we please see the first six lines of your file?

If not, please verify that PC has a value in the sixth line (remember that they are numbered from zero).
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
kollurianu
Premium Member
Premium Member
Posts: 614
Joined: Fri Feb 06, 2004 3:59 pm

Post by kollurianu »

Hi Ray,

Here the top 10 lines (little more than 10 lines)

"duns","PC","LAPTOPS","PRINTERS","WIRELESS_SUBS","EXTENSIONS","INTERNET_USERS","
NETLINES","SERVERS","ITSTAFF","TOTSTORAGE","ITBUDGET","REPLACERATIO","STORAGE_BU
DGET","COMM_BUDGET","HARDWARE_BUDGET","SOFTWARE_BUDGET","SERVICES_BUDGET","OTHER
_BUDGET"
"",18,3,8,5,27,19,3,3,2,976,80883,23,7643,8307,28123,11146,8630,17034
"00100036",18,3,8,5,27,19,3,3,2,976,80883,23,7643,8307,28123,11146,8630,17034
"0010005523",18,4,8,6,25,18,3,5,3,1818,119695,24,11826,13992,37895,16434,11958,2
7590
"001001478",47,10,15,13,72,53,4,8,4,2862,247109,26,25776,27012,77575,36823,25257
,54666
"001001478",16,3,7,5,21,16,3,4,3,1383,98687,23,9574,11488,31760,13265,10008,2259
2
"001002138",,,,,,,,,,,,,,,,,,
"001003474",12345,23456,34567,45678,123456,54321,43210,32109,21098,1234567,12345
6789,234567890,345678901,456789012,567890123,678901234,789012345,890123456
"001003524",112345,123456,134567,145678,1123456,154321,143210,132109,121098,1123
4567,1123456789,1234567890,1345678901,1456789012,1567890123,1678901234,178901234
5,1890123456
"001003672",a,b,c,d,e,f,g,h,i,j,k,l,m,n,o,p,q,r
"001003680",,,,,,,,,,,,,,,,,,
"001003748",36.1,8.1,13.1,12.1,56.1,36.1,4.1,9.1,4.1,3438.1,247514.1,26.1,25521.
1,30596.1,76539.1,36908.1,23615.1,5433.15
"001003763", , , , , , , , , , , , , , , , , ,



can you please tell me little more clearly what it is complaining about ?

Thanks in advance.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

It's complaining (initially) about this line:
"001002138",,,,,,,,,,,,,,,,,,

PC is the second column, but has nothing (or "") in its field. PC is Integer data type, and "" is not a valid integer. You have to specify a valid default value to use if "" is encountered. If you want PC to be nullable, then you have to specify that "" is the Null Field Value, or that Null Field Length is 0.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
kollurianu
Premium Member
Premium Member
Posts: 614
Joined: Fri Feb 06, 2004 3:59 pm

Post by kollurianu »

Hi Ray ,

PC field is now defined as Numeric and made the property null field length to zero , and now it complains in the following way

ipfile: At field "PC": "null_length" may only be used in conjunction with prefix length or link length

could some decipher what it means?

ipfile: At field "PC": "null_length" may only be used in conjunction with prefix length or link length

Thanks in advance.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

My bad. You can only use Null Field Value for numeric data types.

"Prefix length" refers to the length prefix on a VarChar data type. "Link length" I am not 100% certain about, but suspect it would relate to a VarChar field being used as a link field for a tagged subrecord.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
kollurianu
Premium Member
Premium Member
Posts: 614
Joined: Fri Feb 06, 2004 3:59 pm

Post by kollurianu »

Hi Ray ,

Only the first field (DUNS) is defined as varchar , all other fields are
defined as Numeric , when all other fields were defined as Integer atleast 107 records out of 110 records were getting inserted ,But now after setting all the fields(except) the first field are defined as numeric instead of Integer with null length zero settings , the job got aborted now.


filter1: Error when checking operator: The view adapter has a binding for the non-existent source field "duns".

filter1: Error when checking operator: When binding input schema variable "APT_TRinput0Rec0": A transfer adapter is dropping the non-existent field "duns".

ilter1: Error when checking operator: When binding input schema variable "APT_TRinput0Rec0": A transfer adapter is dropping the non-existent field "PC".

could someone explain why it is so?

Thanks in advance.
shalini11
Participant
Posts: 74
Joined: Thu Jan 22, 2009 3:00 am

Post by shalini11 »

Give Null Field Value as "" instead of Null Field Length.
Post Reply