DSXchange

Simply because using transformer is a costly process eating up a lot of resources and should only be selected for mutlipurpose utility i.e. if you need to do some transformations, merge columns, add some extra columns in the output, reject based on validation failure; all this at the same time then ...

I'm supposed to run all the 25 jobs in parallel. Thats the business requirement. Cant change that
Do we really have a solution for this on a developer's level or architectural level?

I have a sequence job that is running 25 jobs in parallel. Individual jobs run fine but while running the sequencer, many of the jobs abort with the following two errors for some of the transformer, column import and funnel stages; The errors are: 1. Missing resource bundle : /opt/node1/......nls/me...

I have a sequence job that runs 25 jobs in parallel. Each of the 25 jobs uses separate MQ stage that destructivley reads records from separate MQ and loads into Teradata through TPUMP stage. In case a job aborts, how to handle those records that were destructively read from MQ and that failed to com...

I have sequence job that runs 25 jobs in parallel. Each of the 25 jobs uses MQ stage to destructively read from the queue and load into Teradata through TPUMP stage. In case any of the job aborts, how to manage the records that were destructively read from the queue and not committed to the database?

Records are getting loaded through TPUMP stage into Teradata. If a job finishes and none of the records are rejected then the erro table would be dropped automatically. How to retain the error table? Is is something related to admin parameter setting or with some changes in TPUMP stage?

Use of column export stage is very much possible in Px edition since I'm using one. Sharath, if your aim is only to concatenate two or more fields into one field then column export is preffered over transformer.

I'm trying to insert records into the Teradata database using TPUMP stage.
I'm getting the following error:

Could not write row to data file in stage
Error writing to pipe: Broken pipe

How to rectify it?

I tried to insert records into Teradata using TPUMP stage. I got the following error

TDBMS failure code 3704 : ('10,X') Not a valid Teradata sql token

What is the significance of this error and how to rectify it.

I'm trying to read 1GB of data from SQL server using ODBC enterprise stage and then write it into dataset. The whole process takes 45 mins. Is there a way to minimize the time for this data transfer?

Ray, since I'm not a premium member I'm not able to view your comments. I'm using an MQ as source, that does a destructive read for all records. I'm copying all the incoming records in a dataset as a backup. Later the job is routed to different links based on a particular column value. After going t...

Thanks Ray

Each input record is considered to be a separate logical transaction. There is no requirement to group records together into a logical transaction. However, to optimize the performance of the Data stage jobs, there might not be a physical database commit after each record. Multiple records may be gr...

TPUMP is not allowing to have multiple input links in Paraller edition, though it allows in case of server edition. Is there a way we can customize the TPUMP stage to allow multiple intputs (each input has different metadata) and coressponding outputs? If yes, then please explain the procedure. I'm ...