We have been trying to finalize the source extract delimiter but the source system seems to have most characters like | ~ and so on.
We were thinking of using Double Quotes around every field in all the extracts to take care of this issue there is a likely hood of even " (Double Quotes) being present in the data itself.
I know this is not an issue with Datastage per se but any ideas on how to handle this handle this scenario..
Is using 2 character combo as a delimiter an option, like Pipe and Tilde --> |~
We anticipate the biggest first full file to be 40-50 GB for the biggest one and then incremental extracts