DSXchange

You are reading multiple files from file pattern. Consider, if fields f1, f2, f3 and so on are there in files. Now go to filter stage and there set the condition as: f1<>'f1'. This way only file records will be passed, not the column names. E.g. file1: f1, f2, f3 1, 1, 1 2, 2, 2 file2: f1, f2, f3 3,...

If you want it to achieve without transformer ... First perform hash partitioning on deptno and sal and then you can use a row generator and generate rows for a new dummy column with initial value as 1 and increment by 1.. This way each row is assigned a unique value.. Now use filter stage and filte...

1. Use sort stage, apply hash partitioning on the key value and perform sort on main key and start date. 2. Use transformer stage and create two stage variables svPrevkey and svCurrkey as: svPrevkey(with its initial value set to -1)=svCurrkey svCurrkey=key Again create two new stage variables svPrev...

thanks for your detailed sincere explanation and patience, it is really useful :D