Problem with FTP PLUGin stage when used for FIXED Width file

sadhvi · Post by **sadhvi** » Fri Dec 01, 2006 4:12 am

Hi

I am facing a problem in using the FTP Plugin stage (in Parallel jobs).

The requirement is we have to tranfer the file from /datahub/dev/ams/ready to /datahub/dev/wc/target. Bothe are on the same BOX.

The login credentials for the /datahub/dev/ams is abc and for /datahub/dev/wc is xyz.

The source data is in the format
[cs2dhbi01:amsdev:/datahub/dev/ams/ready/Customer]cat abc.dat
2 FSWM1D06120100.dat91 0 0

I should get the target file also in the same format. When i am setting the properties in the FTP Plug in
Fixed-Width Columns to YES the job is ABORTING with the following error

FTP_Plug_in_0,0: Fatal Error: Fatal: Internal error: function 'row_to_external()' failed
At row 1, link "DSLink6", while processing column "Batch_ID"
Unable to retrieve column data
Source type (Long) does not promote to destination type (Raw)

The file does not have any Long or Raw datatypes. It is a FIXED Width file with 4 integer columns and 1 varchar column.

When i set the properties Fixed-Wdth Columns to NO and Column Delimiter to PIPE, the job is running fine and the output is
[cs2dhbi01:wcdev:/datahub/dev/wc/target]cat ABC.dat
2|FSWM1D06120100.dat|91|0|0

I want the target file also to be a FIXED WIDTH one, same as the source file.

Pls help me in this regard

Thanks Ahead,
Sadhvi

ArndW · Post by **ArndW** » Fri Dec 01, 2006 4:59 am

What type of column is "Batch_ID" in your source?

sadhvi · Post by **sadhvi** » Fri Dec 01, 2006 5:33 am

Hi

Batch_Id is an INTEGER column.

Regards,
Sadhvi

ArndW · Post by **ArndW** » Fri Dec 01, 2006 6:11 am

I just tried to reproduce the problem here but ftp is disabled and sftp has different issues. Can you reproduce your problem with a simple fixed width file with just one integer column?

Aparna_A · Post by **Aparna_A** » Fri Dec 01, 2006 8:13 am

I have tried doing the same..but converted all target fields to CHAR..and now the new problem is the job hangs at the message "FTP_Plug_in_0,0: Logging delayed metadata".

What does this mean...

sadhvi · Post by **sadhvi** » Fri Dec 01, 2006 8:29 am

Hi

i have tried with single integer column in the file. Same problem is coming up and the job is Aborting

Regards,
Sadhvi

bsreenu · Post by **bsreenu** » Fri Dec 01, 2006 11:52 am

I heard that there are some issues with FTP stage in PX. I'm not sure if this is one of the issues.

Why don't you use regular FTP. I mean unix FTP. Write a shell script and transfer the file.

Sreeni.

sadhvi · Post by **sadhvi** » Mon Dec 04, 2006 6:49 am

Hi

Now i am trying read the records in the file as a single attribute....no problem ... but donno why it is behaving strangely,..when i am trying to set the FIXED WIDTH COLUMNS=YES and reading the file attribute by attribute...

am not marking it resolved....can any one tell me why the job is aborting when am setting the attribute FIXED WIDTH COLUMNS to YES??

Reagrds,
Sadhvi

mdraghic · Post by **mdraghic** » Thu Feb 01, 2007 1:32 pm

In the Outputs -> Properties of the Plug-In stage remove the Column Delimiter and Quote Character when you have Fixed-width Column = Yes

ray.wurlod · Post by **ray.wurlod** » Thu Feb 01, 2007 5:08 pm

bsreenu wrote:I heard ...

Where?

Please cite sources, or acknowledge that they are unsubstantiated rumours.