DSXchange

I have SQL server table as the target, but even then, the same order is not preserved. Should I enable any maintain order option?

Hi all, I have a doubt in the way the records are processed in DataStage. I have about 100 records coming from the source and there is no filter or other such operations, so I want to have all the 100 records, which I am getting now, but I want to have the same order, how it is present in the source...

Thanks for your reply, DSguru2B. yes, exactly.Thats what i want. Suppose if the maximum from the table is 35 and I want this value to be populated as a column in the file, for all the records, ie., i want the same value, 35. additional information - For a single run, only once i will query that tabl...

Hi all, I have the following requirement: I have to query a SQL SERVER DB table and get a maximum value a particular column, say count and add this count column to an exsisting file columns. the general flow is like this: table ----> file ----> newfile (get the maximum (add the column value of count...

yes, it took just a minute! so, i have about 8 minutes difference, for the same number of records.

For 146900 records, it takes 9 minutes and theres no logic involded in the transformerstage, it just converts the decimal column values to string. Transformer stage was here because, in the generated XML file the decimal column values are not appearing, if the datatype is decimal.

I am also using the same.

Hi all, I have a job which is like this: source dataset ---> transformer stage ---> target XML file The dataset has about 100,000 records and writing in to XML file is very slow. If i replace the XML file / sequential file, it would be faster. I would want to know is there any thing I miss when I am...

Hi all, I got the below fatal error and I understood that the Dataset when crosses 2GB space, writing data into it is not possible and the job gets failed. Is my understanding correct? APT_CombinedOperatorController,1: Write to dataset on [fd 19] failed: Error 0 The error occurred on Orchestrate nod...

Create Round Robin partition and use the logic that you are using (as specified in your other post). Again it will minimize the so called hole, but not all. If you are more concern about sequence number, run the job in Sequential mode, atleast the Transformer and use simply @INROWNUM. thanks Kumar,...

Hi all, How to generate a unique sequence number in DataStage using transformer stage? I donot want the sequence number to be duplicated and the last record should give the count of number of records, for eg., if i pass 100 records, i should get all the values from 1 till 100 without any holes. Than...

Hi all, I generate a sequence in the transformer, using @numpartition and @PARTITIONNUM.The problem i faced is - there are no duplicate sequence numbers, but the count value is missing.I mean the following is the job flow: source dataset-> transformer stage->xml file I am sending 100 records to the ...

Hi all, I have 2 jobs, both uses the same sequential file (has about 100 Million records) as input. As I have two different jobs using the same sequential file, i thought if i use a dataset which gets loaded from the sequential file and then use this dataset in those two jobs as the input the perfor...

Hi all, I have a job which process about 80 Million to 100 Million of records. In a joiner stage, I have selected the hash partioning and used the key column, col1 (2000 different possible values for this column) and doing a sort and partition based on that key column value. I have 2 doubts: 1. I ha...

thanks but I donot find the build stage even when customizing the palette.can you please tell me where can I find it?