DSXchange

Hi, We have a clarification on the way the Aggregator works. We have to aggregate incoming records on 5 columns. Out of these 5 columns, the incoming records are already sorted on 2 of the columns. So, can we assert on the Input tab of the aggregator that the incoming data is sorted on 2 of the colu...

So, how could I bring the Column name into as, Column value. That is, as per your example below, how can I take the column names "col1", "col2", "col3", etc into the column "coltype" as values... Let me know if my question is not clear. 1. pivot the table id,c...

Minhajuddin, Yeah, this was the same idea that we too had. But what we were thinking was to avoid explicitly checking the lookup value and passing that source column to the output. We were thinking of trying to pass the input column dynamically using some kind of expressions and/or any available BAS...

Wannabexpert, You ask to pass the lookup.ele_nm to the target.code. Lets say, the value returned in lookup.ele_nm column is "Brok_Cd", then we do not want to pass the value "Brok_Cd" into the output column; but we need to pass the value in the column Brok_Cd itself into the outpu...

Hi, We have a tricky requirement to handle as the one mentioned below. The incoming source link has columns like, - Id, Name, Stat_Cd, Brok_Cd, Fin_Cd, Ln_Cd. The lookup table has columns (Id, Ele_Nm) with these kinds of data, - Id -----> Ele_Nm --------------------- 10 -----> Stat_Cd 20 -----> Brok...

Thank you Ray.

I was thinking that stages like FTP, CFF, etc. are plug-in stages which would not be installed by default during installation. By what you, I think these stages would be installed by default without any manual selection.

Hi, We are currently on the Server Edition and would be moving to the Enterprise Edition shortly. We would like to decide about the Plug-in stages that we might need, before the Server installation phase. For this, where can we look for all the list of plug-in stages. In our current server edition i...

Thanks Craig. So, you say that the function needs to be called from an SQL. In our case, we would have to call a Oracle function somewhere in the middle of a Job and route the output based on the return value of the function. What could be the best possible solution for this? Is it that we would nee...

Hi, We have a requirement to call a user-defined Oracle function to do some logic. Hope we can call such user-defined function through an OCI stage. Based on the return value of the user-defined function, we would need to route the record for further downstream processing. For example, if the functi...

Hi, We have a very tricky and a challenging logic to be implemented. We need to build some filter conditions dynamically. I would explain this with an example here. We have to apply some contraints on the records coming from the input. We have to build those contraints based on the data fetched from...

Ray, We would have 10 million records at the source. We would be applying some filter conditions immediately after reading from the source, which may bring down the record count to around 1 or 2 million. This would be number of records that would be processed in all the others jobs that are downstre...

Ok, I would give you the details based on information / idea that we have currently. - We would like the processing for 10 million records to be under 1 hour (1 hour could be maximum) - The Source is going to be a file on the Mainframe system. We have a plan of making use of the FTP stage to fetch t...

Hi, We have planned to move our platform from Server Edition to the Enterprise Edition and we are planning on the requirements needed for setting up the infrastructure for the PX 7.5 version on UNIX. We would like to hear some suggestions on what could be the needed parameter requirements for establ...

Thanks for all your comments. I would try to make use of parallel stages as much as possible to exploit the capabilities of EE.

Would get back here if I need something more.

Thanks.

Why we didn't want to have this done in the database level is, we want this logic to be done for each incoming records. So, we didn't want to establish a connection with database for each incoming record. That was the reason we thought of loading the records into Hashed File once and then making use...