DSXchange

Hi Arnd, The easiest way to fix this is to make sure that the program creating the sequential file does it correctly - either through use of another quote character or doubling up the quotes as per csv specs. Can you please explain what doubling up the quotes as per csv specs mean, I didnt get the p...

Hi, I have a job that reads data from a sequential file. The input data has around 40-50 fields. The data is comma delimited, with the Varchar and Char fields in double quotes.So, in the sequentail file stage, I have set the Delimiter property to "comma" and Quotes to "Double". O...

Hi, I have a sequential file as the reject file. rejects are from filter, merge... But i am getting the following warings REJECT_01: When checking operator: A sequential operator cannot preserve the partitioning of the parallel data set on input port 0. I understand this is due that, i am using seq...

Hi, I had the same problem with the Change Capture stage. This usually and probably happens when you pass all the fields to the stage and set the the Change Mode to Explicit Keys&Values. Because of this we decide to change the design of the job and passed only the key and change values to the Ch...

Hi, We have done this in some of our jobs. We have a parameter RejectThreshold and if the number of rejects cross this limit, then the job aborts. What we do is pass the reject link to a transformer running in sequential mode, and then pass two links to a Compare Stage. One of these links is set to ...

I think Roy is suggesting creating an empty file with yesterday's filename. That way, your process will see both files, it just won't find any data in the 'old' file. Brad. Hi, I was trying to run with just a single file for the initial load. If I have an empty file for yesterday, then the job runs...

Hi, With proper logic I assume having an empty file as your initial load should be ok (for the yesterday's data). IHTH, Roy, As I mentioned I have my source in Header-Detail-Trailer format. In the source sequential file for yesterday's file, I use grep -e '^["5"|]' in the filter option, a...

Hi, I have a job that compares yesterday's and today's files and captures the changes. My input files are in Header-Detail-Trailer format and I am using the grep function in the filter option of the sequential file stage to read the Detail records. I want to use this job for the inital load, i.e, wi...

Hi, I am trying to load an Oracle table. The job is a simple load job, with the Oracle enterprise stage write method set to Load and write mode set to Append. I have set the index mode option to Rebuild, Add NoLogging clause to True and Add ComputeStatistics to True. The job throws out a few fatal e...

Chanthou,

There is an option in the sort stage- sort mode, where you can sprecify : "Don't Sort (Previously Sorted)".

Hopefully this will take care of your issue.

Regards,
The Bird.

But hope it had an option to read the last row. :( We had a situation to read the trailer....I had to split the header, detail and trailer from Unix and then read it in DataStage. 1. I believe you can use the Tail Stage for this purpose very efficiently. 2. Another apprach would be to use an Extern...

Got it Craig,Arnd.

Thanks once again.

Regards,

The Bird.

Can't you just do WHERE CNSM_END_DT = TO_DATE(\'2999-12-31\',\'YYYY-MM-DD\') ? Hi, Thanks Craig, Arnd for your quick responses... Arnd's solution worked. Thanks a lot. But can you tell me how the quotes get recognised by giving a "" before it? I dont know about this. Regards, The Bird.

Hi, I want to pass an SQL query as a parameter in a job, but I am getting a fatal error when I do so. I believe that DS is not accepting the quotes that I give to define WHERE clause. My where clause is : WHERE CNSM_END_DT = TO_DATE('2999-12-31','YYYY-MM-DD') The fatal error that I get is : Consumer...

Hi Ash,

I believe you can get rid of this issue by setting the Preserve Partitioning property to "Clear", in the Advanced tab of the stage. By default this is set to Propagate (or Sequential depending on the stage).


Regards,

The Bird.