DSXchange

I have a job which reads the files based on the file pattern and creates dataset. It was running fine before but started aborting after reading the files from a share drive. Here is the error message. Unable to generate a node map from fileset /D=/tmpdir/import_tmp_51692fe518d.fs. Also I ran the job...

Hi All,

I want to convert the CSV file to Pipe delimited file

Ex:"aaa","bbb",""Wow!!!" this is good","ddd" to
aaa|bbb|"Wow!!!" this is good|ddd

Experts ideas will really help.
Thanks in advance.

Hi All, I am using file pattern in sequential file to capture the data.I have a file name column to which populate the name of the file it is extracting.My problem is the reject link data is not showing the file name. How do I know which file is rejecting the data if file name is not populated in r...

Hi All, I am using file pattern in sequential file to capture the data.I have a file name column to which populate the name of the file it is extracting.My problem is the reject link data is not showing the file name. How do I know which file is rejecting the data if file name is not populated in re...

Hi All, I am extracting files for a directory using a file pattern using sequential file. I need to perform audit check as well for all the files. Each file has record count as a part of its name. Ex. test1.R3000. This test1 file has 3000 records. I need to abort the job if the record count fail. As...

Use sort stage and set Create Key Change column to true which creates a field KeyChange. Current Indicator : If KeyChange = 1 then 'N' Else 'Y' I used the sort stage with the logic you mentioned. i used the RecId as sort key and set the create key change column option. The output is not what iam ex...

Hi All, I have records which look like below RecId Date 1 20100614 2 20100614 3 20100614 3 20100615 3 20100616 The output should look like RecId Date Current Indicator 1 20100614 Y 2 20100614 Y 3 20100614 N 3 20100615 N 3 20100616 Y Can any one please suggest a logic for this. Thanks...

I still cant understand how we can track the error file if we have the environment variable $APT_IMPORT_PATTERN_USES_FILESET set to true and File Name column is provides in sequential file?

Hi All,
We have a requirement to capture all the files in a folder which have same metadata. I am using the file pattern to read all the files using sequential file stage. How can we track the file that is causing problem or the file that cant be extracted from the set of files.

Thanks in advanse.

Check the update statement. Also, see whether you are getting any nulls in the key fields..

I don't think you can assign user defined values in look up stage.

Assuming you are reading data in one field
field1 -> 'mm-dd-yyyy.hh.mm.ss'
StringTodate(field1[1,10],'%mm-%dd-%yyyy') should work.

I don't think you can complete the write if one of the two fails.
Consider using Funnel Stage (Sequence type), though you can not write concurrently.

Hi All,
Can any one please give a broad picture on the advantages using Datastage over SSIS.I have to defend using Datastage over SSIS with my client. SSIS is cheaper and obviously client is pushing us to use SSIS for ETL instead of DS. Appreciate your thoughts.

Thanks.

Thank You very much for your reply.It worked for me when defined as varchar.