Issues Loading csv file into a Oracle Database

[sashah]

I have a datastage job that loads a csv file into an Oracle Database. The csv file has some disclosure text at the bottom which prevents the file from being loaded. Is there a way I can filter out this unwanted text while loading the data.

Thank you

[DSguru2B]

Define unwanted data? What is the error message that you are getting?

[sashah]

The error message is required column is missing. The reason I am getting this is because I have mapped the sequential file columns with the columns in the oracle table.

In the CSV file I have **DISCLOSURE** text in one of the columns at the end of file and nothing in the other columns. I want to filter these rows.

Thank you

Define unwanted data? What is the error message that you are getting?

[DSguru2B]

In the sequential file stage, activate filter command and put the following in the filter command box

Code: Select all

sed '$d'

This will delete the last line before the stage even starts reading it.

[sashah]

Thank you. Another question I have is how would I delete all the lines below the Disclosure text.

In the sequential file stage, activate filter command and put the following in the filter command box

Code: Select all

sed '$d'

This will delete the last line before the stage even starts reading it.

[ray.wurlod]

With a more appropriate sed or awk script, of course. Might be time to invest some effort in learning these tools.

[DSguru2B]

I believe the following should work. Test it out before you stick to it.

Code: Select all

sed '/**DISCLOSURE**/;/^*$/d'

[sashah]

Thank you. I will try it.

I believe the following should work. Test it out before you stick to it.

Code: Select all

sed '/**DISCLOSURE**/;/^*$/d'