DSXchange

You need to ensure that you are doing balanced partitioning while using this. Meaning, if you have 100 record and 2 partitions ensure you are partitioning them in equal halves i.e. 50 in one and 50 in other.

Some weird suggestion - copy all the stage in a new job and save it. Set the properties again for check pointing. Compile it again and run it now. See if same thing happens. The suggestion here has come from solution we have had for few problems. Just creating new job or replacing stage with another...

For the job activities j4 to j6, check if the property Do not checkpoint job run is not enabled.

If the records are not moving outside XML then that is the problem of XPaths defined in the XML stage. Providing XML you are reading and XPaths used for columns would be useful to understand the problem and suggest solution. See if there is any diff in the XPaths and XML tags. This problem is normal...

If your data is not huge get the cartesian product that will return you m*n where m is number of rows in file and n is number of rows in other table. Then you can add filter and put conditions for matching as per your need. So after cartesian product, you will get col1Fromfile, Col1FromTable and so ...

If your total number of levels are fixed then try this: First job create a lookup with ChildDept as key. Second job read the source file and do lookup of ParDept from source with ChildDept of lookup and get the ParDept col from lookup. Write two columns to output file, first is ChildDept from source...

Are you sure if the error is due to the oracle stage?

Looking at the error it seems that the error is in C file. Whats the job design? Try replacing the oracle stage with something else and see if it runs.

Write the script to get the file using sftp. Call this script as before job and then you can use the file in the job.

whether you use the surrogate key stage or generate the keys manually using (IN/OUT)ROWNUM, make sure that when create keys, the partitioning is balanced, meaning in each partition, the total number of rows are same. If the partitions are unbalanced i.e. one having 10 rows and other having other 15 ...

post you config file and job design details.
Also any additional error messages in dir would be useful to understand the problem.

As your DS is on unix box, tester should have a bit of knowledge or exp in Unix commands - file handling usually. Then other things related files like FTP and if he can use any editor in unix like VI, it will be added advantage. If in your project you deal with database as in most cases, he/she shou...

Welcome aboard :D You can get that value directly in the stage var. Write a before job routine or script to extract max SL_NO and assign it one job parameter. Then use this parameter while generating the SL_NOs. But as the job will be parallel, you will have to take care of parallelism while generat...

your problem statement is not clear and its difficult what to comprehend what you want to achieve.

Can you please post it clearly?

If for all 40 files, you need to run a single job then this would be useful. first create an empty file containing following columns - Filename and Date. Key columns will be Filename and Date. Design the job that needs to be executed for all 40 files as multiple instance. So it should be enabled for...

In server, while doing the lookups, each query can behave like a sparse lookup if you dont use the buffers. So each time input values are mapped to question marks of SQL in lookup DB stage and will be run at that time.