DSXchange

sorry about that

here are the size of the files

DATA.30 691,870 KB
OVER.30 223,234 KB

hashed file size is 2KB. ( loaded only 3 columns of lengths Char(10) , Nchar(3) and date 8 ( as per requirement).

I tried to schedule a job to run using the option Add to schedule in Director .Entered the time ,clicked Ok then it showed another window to click schedule and it gave this error. Error adding to schedule: at: garbage after time specification (Command was: AT 16:35 vmdsr_sched.exe e:\Ascential\DataS...

Narasimha ,

i am loading the file into a Hashed file and i do not have access to Hashed file directory (No Admin rights )

you are absolutely right not all the values of Char(10) are populated .

Thank you Ray for the information .
i never thought of pipe delimiters and line terminators bytes



Every day is a learning day
Thanks
paddu

oh oh

The 684,078KB file is my source (pipe delimited )which has 5 columns ,15446662 rows and lengths i mentioned earlier .


Coming to loading into text file (pipe delimited ) with 1000 rows ,the size is 34kb.
34 times 15446.662 is 525186.508

I hope now you see the difference
paddu

Narasimha-No it did not work that way .

I file description i gave before is about size 684,078KB for exactly 15446662 records.

I thought there should be general formula to calculate .

Thanks
paddu

I

Ray,

I wanted to know by and large how we estimate the size of the file but anyways i have pipe delimited file with 5 columns ( field size expected are Numeric 6,char 10 , date 8 , char 10 and Nchar 3)

Number of lines or rows expected are 15Million.

I know its not Datastage question but this information would be very useful to datastage users.

I do not know how we calculate the size of a text file .
i know it depends on number of columns , total length of the columns .

Please throw some light

Thanks
paddu

Sorry All.

Data was not exactly the same in the Flat file and Hashed file .
I had to add leading zeros to the Lookups Field.

Paddu

I am using a Hashed file as lookup in my job .The hashed file is popluated with col1 and col2 as keys. My source is a flat file . i join col1 & col2 of Hashed file lookup to the first two columns of the Flat file . I do not get any matches. The job was fine before with totally 10 lookups . Today...

Can you please tell what is your design and please post complete log message .

jjrbikes

are you carrying these three source fields to target or are you carrying only the reference lookup (field ) to the target ? or not carrying any of these fields to the target only using them for selection of the data??

paddu

jjrbikes- truly did not understand your second post.

Hello Parvathi, I do not know what is your source system but I had similar problem . In my case we were pulling data from Oracle database and we ran into this problem(Production) I tried all options of checking the temspace(fine) , recycling the Datastage server and recompiling the job and running ,...