Write a delimted file to S3
Posted: Wed Nov 23, 2016 1:07 pm
Hi
I need to write about ~100 files to S3. I have different schema for each file and instead of having few 100 jobs, planning to use RCP.
The job design is something like this:
sequential file --> copy --> s3
No columns are defined and the sequential file uses a schema file.
The schema file the columns are defined as ustring. It is a supported data type, but s3 fails saying it is unsupported.
When I have the same file written to a SQL Server table to a nvarchar field, I am able to read properly from the table and load to S3. Should we have ustring mapped to nvarchar for loading to s3?
Can't we have a job writing file to s3 using ustring data type?
I need to write about ~100 files to S3. I have different schema for each file and instead of having few 100 jobs, planning to use RCP.
The job design is something like this:
sequential file --> copy --> s3
No columns are defined and the sequential file uses a schema file.
The schema file the columns are defined as ustring. It is a supported data type, but s3 fails saying it is unsupported.
When I have the same file written to a SQL Server table to a nvarchar field, I am able to read properly from the table and load to S3. Should we have ustring mapped to nvarchar for loading to s3?
Can't we have a job writing file to s3 using ustring data type?