DSXchange

Hi, I have been trying to run a datastage parallel job in 9.1 that loads data from dataset and loads into DB2 bulk stage. This particular job has been recently migrated from 7.5 version to 9.1 however the DB2 stage is not yet upgraded to connector stage. Earlier table structure was including 24 colu...

Craig,

Can you please let me know IMHO?

I referred to the IBM technotes. Dont see the below, This error has 3 different known causes: 1.A column name defined in stage contains a period or other special or invalid characters. 2.The job design contains an orphan stage with no input or output links. 3.The new Unstructured Data stage in Infor...

Hi, I am trying to run a parallel job with Oracle connector stage as source and direct load of data to a dataset in 9.1 DS. However I see the below error message. main_program: Internal Error: (minIndex < m_outputLinkObjArraySize): pxbridge.C: 4263 Traceback: Could not obtain stack trace; check that...

Okays, will try that

Thanks

Thanks Ray,
Yes, I did that. but doing an inner join would fetch all the data in the table and then output the data to output link. This approach would take time.

But then what is the use of the sparse lookup, if this takes so much time?

Thanks again for the response

Hi,
We are performing a sparse lookup on a table, with input data around 1 Million records. The performance of the lookup is very very slow.

The reference table has got around 500Million records. and the table is indexed.

Can any one please suggest a solution to resolve this problem?

Thanks !!!

Hi,
We are performing a sparse lookup on a table, with input data around 1 Million records. The performance of the lookup is very very slow.

The reference table has got around 500Million records. and the table is indexed.

Can any one suggest a solution to resolve this problem?

Thanks !!!

Please mark it as resolved and what did you change in the query?

You can use sort stage to filter out the duplicates in to two different files based on the change keys.
but the above ones seems to be good.

You cant directly pass the string value for date comparision. please use date type conversion and then compare it with the batch_dt.

Just a clarification needed,

can we set street=orchestrate.street while placing a same constraint in a where clause?

Please change the partition to hash at transformer stage and auto at oracle stage.

I think this is not a node configuration issue. it is more of a database issue.

Can you please check the sort option and hash partition on the primary keys and try ?

thanks
Sri

Thanks ray,

Tried that, it is saying that error opening the log.

Is there any issue if we manually delete all the data files in <project dir>/RT_LOG1917
like
1)DATA.30
2)OVER.30