DSXchange

For example incase the source is 5A@~24

output should be : 5A24

Hi All, I have a problem. I have a string column from source file which can consist of any type of character. Any character beyond [A-Z], [a-z] and [0-9] will be considered special character. In case there are any special character we need to replace them with blank. There is no specified set of spe...

ArndW wrote:That makes multiple readers a nonoption. How many columns does the file have and how long does it take to read the file when the only other stage in your job is a copy stage (or a peek stage)?

The maximum number of columns is 30,but i do have lookup,transform stages in the job.

Thanks,
Rajee

Depending on your datastage version you can improve performance (with varied results) based on how your file is structured using sequential file stage by setting the following properties in it. Read From Multiple Nodes = Yes or Number of Readers Per Node = N Furthermore, your performance is also de...

ArndW wrote:CFF is the Complex-flat-file stage. The Sequential stage is one of the fastest possible means of reading a file. Is the file fixed length or variable length?

The file is variable length.

ArndW wrote:Sequential file stage for one. CFF as well. ...

Sequential file stage takes near about 35 minutes to read 2GB file itself.
What does CFF mean?

ArndW wrote:Why can't you read a file of over 5Gb in DataStage? ...

Thanks for your respnse.
Even i do know that we can do that through Datastage but my question is which stage can be used for it.

Use fileset stage instead of sequential file stage in your job as source reader. Can anyone let me know,how can we process a text file that is pipe delimited and is of more than 5GB in size. Other than splitting the files into multiple is there any other way/stage through which the file can be read...

Use fileset stage instead of sequential file stage in your job as source reader. Can anyone let me know,how can we process a text file that is pipe delimited and is of more than 5GB in size. Other than splitting the files into multiple is there any other way/stage through which the file can be read...

Hi,

Can anyone let me know,how can we process a text file that is pipe delimited and is of more than 5GB in size.
Other than splitting the files into multiple is there any other way/stage through which the file can be read at one stretch.

Thanks,
Rajee

ray.wurlod wrote:I'm sure this has been answered in the past. Search.

I posted the query in this forum because iam working on IBM datastage enterprise edition.My understanding is the forums are categorised based on the Edition.

Hi, Iam using a sybase OC stage to extract data from the sybase database(version 12.5) and the below given query is used for data extraction. select (select count(memo_holder_qty) FROM hldr_memo m where m.currency_cd=n.currency_cd and m.issue_when_ind=n.issue_when_ind and m.seq_nbr=n.seq_nbr and m.t...

Nivas- I did as you said and as i found in some of the helpful posts but now my output looks like key col A and B col having values X,Y,Z,W ....but my requirement is to get X,Y,Z,W in 4 different columns... I have also implemented vertical pivoting much similar to how Nivas has explained.But instea...

ray.wurlod wrote:More data than the field width allows for. ...

I checked the source file,it does not have excess data than the length defined in the metadata.

ray.wurlod wrote:Anyone who knows how to use the Search facility in DSXchange could answer that question, as it's been asked before.

But why not search for yourself? ...

The search gave me the implementation logic through parallel job but iam using server job.