DSXchange

So just to confirm this apparently is by design in the ODBC stage. More information can be found here:
http://www-01.ibm.com/support/docview.w ... wg21445833

Just as a note regarding truncate with the ODBC stage, I have noticed in previous versions that the Truncate table action on the ODBC stage when calling Oracle DB actually performs a delete from statement not a truncate, and as a result has an overhead due to the UNDO space requriements. In these in...

Welcome. If the data is as simple as below - you could use a stage variable to geneate a surrogate key value each time a new Type1 is received and then apply that to each other type until such time as the next Type1 is received. That surrogate key could be a number, or the "project" name i...

I assume that the difficulty is that not all the values for all the target columns will be present for each record? Ie you might only get 10 columns of the 1000 in your source data? This post might help http://www.dsxchange.com/viewtopic.php?t=154172 You would need to tweak it a little. Get your lis...

chulett wrote:Are we really talking about a Server job here? The join stage there isn't anything like the Parallel version.

Whoops failed to notice the Server job bit!

Then yes if a server job, please disregard anything I have said.

If I understand you correctly then you have an input link of say 5 records but you are referencing 50000 records? If that is the case and depending on the reference input (is it a DB?) I would use a sparse lookup. A sparse lookup performs an individual lookup for each input row to the reference. So ...

Once the query has executed - how long is it taking for data transfer? If all you are after is not having the table empty for so long, is it silly to ask if your query is optimised? Something also that I have wanted to try is, if you have an output reject link from a DB stage which feeds as a refere...

Generally speaking I would say no... but nothing is impossible.

To do so though I would expect you would need some sort of routine to be run on your Email Server to extract all attachments to a given directory that you could then read with DataStage.

Not sure its actually the pivot stage but more likely the sorting that is being done. Before a remove duplicates and a pivot stage I am pretty sure that there is an sort inserted (as the data needs to be sorted prior to performing these activities). Is the duplicate key the same as the pivot key? (o...

Hello Shane, After implementing the logic you suggested I was able to get the desired result, but recently I ran into a situation where number of columns are not the same for every row hence I am losing the delimiters. This wasn't an issue earlier. ROW 3: |789||123 Sorry not to answer earlier - bee...

That's because all the columns from reject link are showing in RED colour in transformer stage before getting written to Sequential file stage So if I understand you have a reject link from ODBC stage, going to a transformer? And the output columns on the transformer are "red". Generally ...

generate the whole Path and Filename for each record and put it in front of the "custom seperator character"

Yes sorry - I was a bit vague on that. Good work on deducing the solution though :D

UPDATE: So further investigations seem to show that is to do with the ODBC driver. We performed an extra test where we tried to replicate the error in Oracle. When using the ODBC stage to write to a duplicate oracle table, we had the exact same problem where the process hung. However when we switche...

Are you reading from a file at this point? The stage is probably not reading the new line correctly. At a guess its probably because of the output derivation I provided when creating the file. Currently it is probably something like If @OUTROWNUM = 1 then svHeaders : Char(10) : svBuildData else svBu...

From what I understand you want to create several output files from the one input link. If so you could accomplish what you are after but using an external target stage. Prior to outputting the data, you would have to sort by your burst key column, and based on that key you would generate the requir...