DSXchange

Depends on how you want your output. You can simply read in as one Record in your sequential file by taking out the Delimiter, can use transformer or may be some one suggest even simpler way.
As Chuck said, you may have to rephrase your question.

I find improved times when I put the logic in stage variables..may be someone can explain better

You will find In Field Defaults: Defines default properties for columns written to the file or files. These are applied to all columns written, but can be overridden for individual columns from the Columns tab using the Edit Column Metadata dialog box. Null field value . Specifies the value written ...

Please check this link.. Search is great tool

http://dsxchange.com/viewtopic.php?t=96 ... ab90e101c5

I wanted to see if you can you write the rejected rows to a file. See if thats happening. Set the Array Size in DRS to 1.

Whats your Array Size in DRS Input Stage

Infact its not a bad idea to ask to fix this problem at the source. You can ask whoever sends you the data to change the delimiter to a pipe.. life will be easy...

What did you mention in you Quote Character under Format Tab in sequential file.

I am not sure if this what you want, but you can wrtie that particular 1000th record to your lookup file and the use it in your lookup with other table. This way you dont have to looup all the records.

HTH

Just copied it from dsx pdf... Although the data is distributed across partitions, the hash partitioner ensures that records with identical keys are in the same partition, allowing duplicates to be found. Hash partitioning does not necessarily result in an even distribution of data between partition...

It wont accept the link infact You can mention the input filenames in the Merge Stage itself. There will tow input files which you can merge the way the you want using the join conditions.

HTH

Typically this happens to us when there is mismatch in the datatype , specially Fixed width fields carrying Null Values. You can also check the below link

viewtopic.php?t=97873&highlight=When+va ... ort+schema

I know DSXchange team is working on this

I think I am not clear here, Whats the Source Field and target field datatype and lengths

Use a Before Job Routine with Head or Tail to get the number of rows you want.

You are getting a Data Truncation warning from DataStage or SQL Server? Can you post the actual warning? TestConsumer..stgxConsumer.lnkInsertConsumer: DSD.BCIPut call to SQLExecute returned informational message. SQLSTATE=01004, DBMS.CODE=0 [DataStage][SQL Client]Data has been truncated Chulet-- pl...