DSXchange

Hi, I have requirement to search the sub string in the reference data.I have to check the existence of substring in the lookup master table.If it is present then process the record otherwise reject. For this i have created the "Sparse Lookup" job in which i have source and reference has OD...

Since your sort stage is running in sequential mode,so in case you apply same partition in transformer,it will run sequenctially.In transfromer all data will contains in node0 probably.


Thanks
Prasoon

You can use Merge stage and make sure that no duplicate is there in main main link.

Hi Ray,

Yest i checked the job score,and Tsort operator is autometically inserted.

Thanks for your reply.

Hi All, I have 18 lakhs duplicate records on GRP column and in that 9 distinct records are there.I am using remove duplicate stage and i have explicityl specifited hash on key col and not sort.Its working fine. My confusion is according to document,Remove duplicate stage need sorted data and hashed ...

Hi Ray,

Sorry for the typo,yes it is buildop....

Do you want me to add input and output port names with the code.
like

You can remove that new line using below unix command:-

Hi All,

Thanks a lot for your replies. I feel instead of adding one more stage,we can handle it in Message Handler.

Hi Ray,

I have already specified CL_ID in SKEY as "UNSIGNED".It seems sarrogate key is creating CL_ID as "Unsigned" and on target table CL_ID is bigint which is signed.

If it is correct,is there any way i can create CL_ID in skey as Signed...??


Thanks

Hi All, I constructed one job where my target table is my sql. I am creating sarrogate key using skey stage col. name CL_ID and loading into the target table. But i am getting below warning :- ODBC_CvNew_Ins: When checking operator: When binding input interface field "CL_ID" to field "...

kandyshandy wrote:

prasson_ibm wrote:

Code: Select all

if (isnull(EEFF_DT) or trim(WEFFDT)='') then '1999-12-31 00:00:00.0000000' else WEFFDT

Did not this expression throw any error at the first place? At one spot EEFF_DT and WEFFDT at the other...

Sorry there was a typo in the code.

Hi, I have source date as ID(Integer) nullable=No I am doing lookup with reference column ID(Integer) and passing WEFF_DT(Timestamp,Microsecond) Nullable=No with lookup condition =Continue For unmatched ID i am getting null in WEFF_DT which i need to handle. I am applying below null handing in trans...

After Filter also apply remove duplicate with condition "Duplicate to Retain=Last"


Thanks
Prasoon

Hi, You can achieve this output by below design:- Seq Input---->Sort----->Transformer---->Filter------>Seq Output Step1:- Read data from seq. file. Step2:- Sort input data based on Acct_no(desc) and Rec_No(asc) Step3:- Create these stage veriables CURR=Input.RECNO DIFF=if (PREV-CURR)<> 1 then 0 else...

Hi all, I have job design where data is written to seq file with "UNKNOWN" whwerever null is coming from the source. While reading the file given null field value='UNKNOWN' in format tab so this will convert all 'UNKNOWN' data to null in seq file. My source data coming as 'UNKNOWN' ,so my ...