DSXchange

I did read the file with a sequential stage, the data looks god when I view it.

Now the records can be filtered where I see SSN but how can I combine the records which are dropped earlier?


Thanks again!

Thank you!

So the complete file will be a single field? and also the target should look the same as source with only changes SSN values.

Please correct me if I am wrong

Hello, Below is the sample data from a log file sampleXXXXXXXXXXXXXX SSN: 123456789 XXXX XXXXXXXXXX XXXXXXXXXXX Sample2XXXXXXXXXXXX SSN:987654321 XXXX XXXXXXXXXX XXXXXXXXXXXXX There are around 100M such records in this log file and position of SSN is also different in each single paragraph Please su...

Thanks very much to everyone:)

I will reach out to the support!

Thank you Jisan. We are not placing businees logic in our data masking routines.Its just the business requirements we are taking care to implement them using datastage. Most likely all the requirments have been handled, its only the performance issue where it is taking more time in 8.5 when used dat...

Small correction, we are using data masking in 8.5 its not 8.7!

Sorry for the mistake

Also is there any difference between data masking pack in 8.5 and 8.7?

Hi Jisan,

We had an overview on DMSuite and some other tools in the market but due to the unique requirements we can only handle them in Datastage as it is an ETL tool and includes many functions.

For some fields where we can use the data masking pack we are using it.

Hi Ray, We were not using Optim for doing the masking,earlier before this pack we were doing most of the masking with in the DS stages. But now as we have data masking pack we are using it and see this kind of performance. Also we are using repeatable replace function in data masking pack for only 3...

Hello, We are using data masking pack in 8.7 version of datastage. The job with masking stage is taking too much of time like 20 min for 100K records , with out the masking stage it takes only 2 minutes. What is the usual runtime for 100K records with only 5 or 6 stages? Do we need to do anything to...

Thanks very much!

I think that will help to do a sequence job and using the job activities to trigger other parallel jobs.

Thank you!

Actually I need not run the query, only thing I need to check for the field names in the query and depending on the field names the jobs should be triggered.

Also I assume all these job activities and triggers will be in sequence job.

In transformer pass the flow in parallel and select Hash partition for that field and dont select the sort and then next step do sort for others

That should do it

There are some 10 queries which come as an alert, based on the alert/query which we see we need to do a search and pull the trigger for the correct job.

They are fixed queries 10 different kinds but fixed fields for each of them


Thank you

Yes, exactly

Need to trigger the correct job based on the query result search for fields


Thank you

Hello, I have a requirement where I need to search for fields from a given query and then based on the search if I find the searched fields then I need to run the DS job to update those fields. So basically there are 10 jobs and based on the search I need to find specified fields and then select whi...