DSXchange

Hi All, Thanks for your invaluable response. Based on the inputs provided and the information available as per the links shared, i have checked the uvconfig file in our PROD box. The value defined for T30FILE & RLTABSZ are 4096 & 480 respectively. This value will let 900 jobs to be executed ...

Hi, DS V9.1 AIX V7.0 We have designed a common generic RCP driven DS parallel jobs to read multiple types of source files like EBCDIC & ASCII formats having multiple file layouts using a set of filter, SF, Generic stage to load the data into table in teradata database. I wanted to know is there ...

The stage variable logi is implemented and the jobs were split into 3 to make the jobs compiled. After doing this change, the jobs got compiled.
Thank you very much to all for helping.

Thanks for showering light on this issue. I will try out the options provided by all of you and let you know the results.

Hi Ray,

The system is configured properly. Thisis the first time that we ar egetting this issue as we have jobs where the data validations are being done for more than 100 fields.

Thanks

Hi, I am getting the compilation error. The job reads the data from the sequential flat file, does data validation like - data type (Date, Decimal,Integer) and Null/Empty check for the incoming fields in the source file. There are approximately 150+ fields where the data validation is being done. On...

Hi All, I want to convert the sequential file from ANSI to UTF-8 format. I have tried setting the NLS MAP to UTF-8 at the project level and the NLS MAP at the stage level is also set to UTF-8 just to make sure. The record delimiter is set to UNIX Newline. Still the file is not geting created in the ...

Hi Divya, You will get the check box "Do Not Check Point Run" only if you check the check box "Add Checkpoints so sequence is restartable on failure" in the sequence properties. By doing this you can control the notification activity whether you have to trigger it everytime or no...

HI, In the sequence properties, you need to check the check box which says "Add Checkpoints so sequence is restartable on failure". Then in the notification activity, you need to check the check box "Do Not Check Point Run". I think, by doing this your issue will get resolved. Th...

Hi Murali,

Perform a lookup or use a join stage between the Dataset and the database table.

Hi Vidyut, I knew that the first option will result in Deadlock, that's why i had asked you to handle it :wink: The another option is, Load all the unique records using the FASTLOAD method and write all the duplicate records into a file. Write a BTEQ script to load the duplicate records into the sam...

It is not necessary to execute the transformer in the sequential mode. You have to maintain the same partition as the sort stage. It will work.
If the volume of data is high then executing the transformer in the sequential mode can be costly affair.

Thanks

As you said the duplicate records are very minimal (in hundereds), identify these duplicate records and seperate it with the main stream. Using the link ordering execute the link which has only duplicate records and then the other one. Something like below. Source ------> Identify Unique/Duplicates ...

You can also use Tail stage in the sequential mode by setting the Number Of Rows (Per Partition) = 1. By this the last row is retained for down stream process.

SKey ---> Tail --> ...

Thanks

If you are sure that you will get the values seperated by comma in the file Company Name, then read the entire record as a single column and then split based on the field length. Remember while splitting, the starting position of the second column will be n+1 as there is a comma seperating the first...