DSXchange

Thank you Craig, this is helpful. Cheers

Hi Ray, my apologies - it aborted around 150K (I should've left out the bit about the record count in the image). L_CSTID_TF_O is outputting to hash file named ac_ar_lookup L_CST_MKT_SEGMENT_TF_O is outputting to a hash file called cst_mkt_segment_id_lookup It is the former that is having the issue....

Hi all, I am facing a strange issue that I've never come across before, around hash file creation. I have a process that does two SQL extracts from a database, performs some basic transformation and outputs to a hash file. Here is a screenshot of the job: http://iforce.co.nz/i/h4mjjr1k.arl.png The p...

Hi Ray, thanks for your response. I'm aware I can extend the script to clean up these files, but my question is more around at what point can they be deleted? i.e. older than X days? I wouldn't want to be cleaning up .ctl files or the like while/if they are being used by the application. Cheers

Hi all, I am a Data Warehouse Analyst using IBM Datastage v8.0 Build 1.2. This past month we have noticed a degradation in job run performance, and some of our more critical processes are taking a very long time to run (in comparison to run-times observed throughout last year). I have been reading I...

I tried this &h0D, but gave me fatal error if i put backslash \ prior to that, it will actually print out the string itself main_program: Syntax error: Error in "export" operator: Error in operator arg: Error parsing schema: In top-level property list: Expected value for property "...

Thanks! It does not work using hex notation (\x0D).

But tq for prompting the rare case using that CR only, I rechecked again, and found out that they actually need the Carriage Return & Line Feed.

Hi, I need to include the carriage return ascii char 13 or ^M at the end of the record. I have tried these using the sequential file properties, format 1. Record delimiter string = DOS format 2. Final delimiter string = \13 ---> this give me the output ^K, but if i tried other numbers, ^M still does...

Thanks a lot for your guide and patient ya. It works now! I am so happy. Both command works. This is the first time i use this execute command, trigger with custom condition.

This does not work, i tried LEFT as well, it still return filename. I got a solution to return the number only which is wc -l filename | awk '{print $1}' But my trigger to run the job still does not work when i put $commandoutput=0 to run the job (my job does not run). The log shows the ouput like t...

Thanks! I got &CommandOutput work out. When i set the &CommandOutput=1

but when i execute the command wc-1 filename. The status in the log

" Output from command ====>
0 filename "

output comes out with filename, not 0 or 1 or 2. So the trigger does not work.

Thanks ya. The command works, but the trigger part, still confusing to me. what i need to do is to check whether is there any rows return in the file, if there is no rows return (row count=0) then i need to run another job. The trigger 'expression type', which one i should use? If i use 'custom and ...

Hi,

I need to check the row count for a file. If it is having more than 1 row, then i run job 1, else i run job 2. How do i do this in a job or sequencer. Thank you

My XML file has got multiple levels which is sourced from number of database tables. For example; <A> <B\> <C\> <D> <E> <E> <\D> <D> <E> <E> <\D> <\A> There are many elements and there could be up to 20 children for an element. Depending on the requirement, the number of children can change. I have ...

Hi, We are looking at generating data lineage at the data element level. When a report is generated for the data element lineage, the report doesn't show the database table associated with the data element. Eg. CLNT is the source data element from table Source. In a datastage job, the data element g...