DSXchange

On Unix, does this error message relate to the data or the file limits? I have an Aggregator stage which has up to 40 million records to deal with and get the same error. Following warning messages in the log show: My current heap size= 1,856,298,288 bytes in 35,701,573 blocks. Followed by "Fai...

Test and Production are two different servers. On each of these there are multiple projects. We have previously run the jobs in Production from a command line script (to limit access to DataStage Designer, etc). An overall sequence job runs our parallel ETL jobs and then the server Stats jobs to. Al...

Hi, We are running some jobs in DataStage Enterprise Edition 7.5.1 on an AIX platform to collect runtime statistics and load a Data Quality database. The jobs that perform this are Server jobs. They exist in both our Development and Testing environments but have started generating errors in Testing:...

Came across this old topic whilst investigating my issue and think it would be a good place to start a discussion. I am running PS across four different tables, each of which contains Employee data. The table schema is exactly the same for three of the tables; data types, column names, etc. I KNOW t...

Talking with IBM/Ascential Australia and they indicate the problem may be due to our use of SQL Server 2005. ProfileStage has only been certified with 2k. We were a little naive when starting our profiling exercise and didn't realise we would need a database server to host the PSDB. The (incorrect) ...

Using ProfileStage as a local install on Windows XP Pro SP2. Our PSDB is on SQL Server 2005. My data sources are fixed width text files. During Column Analysis, I can access Analysis Report, Column Distribution and View Sample with no problems. However, when I try to examine specific records from wi...

Came across this topic whilst investigating a similar problem and thought others may find my solution useful. We have multiple fixed width text files that we were trying to bring into PS as seperate data sources. Our ODBC connection used the Ascential Text driver and created an .ini file at the same...

No good. The Matches command is valid in DataStage Server Edition only - we are using Enterprise Edition 7.5.1.a.

Source A has 3 distinct records. Source B has two distinct records. Each is a match to data in Source A. I have a lookup between the two sources. All records continue to the next transformer stage. In the transformer, I want to evaluate the fourth character of one of the columns for each record. Thi...

We are already using the DB2 Enterprise stage. There were previous problems on this project with DB2 Bulk Load.

I think Ray may be on the right track, and this is likely a DB2 restriction instead of DS. Relevant DBA is being hunted as we speak...

G'day, I am trying to load a DB2 database with a volume of rows in the order of 7.5 million. When using DB2 'load' (as opposed to 'write') not all my rows are being inserted into the database. From what I can tell, only the first 70000 rows (exactly) are loaded. DataStage statistics, and the Directo...

Actually, I no longer get the problem - we can chalk this one up to human error. My data was corrupt. Unbeknownst to me, the source data column was NULL. It was coming from a database that does not allow nullable values in that column, but during unit testing, the value in the staging dataset had be...

G'day A really weird one, this. I have a number of existing DataStage jobs that update a timestamp field in a DB2 database using a simple update statement, e.g. UPDATE #DB2#.TABLE SET END_TSP = ORCHESTRATE.END_TSP WHERE KEY = ORCHESTRATE.KEY The metadata of the updates is set in a preceeding Transfo...

Thanks for that. I will give it a go.

But, I have heard that the Transformer stage is slower and more resource intensive than other options. Is this because it can accomplish in one stage what would otherwise require multiple individual specific stages?

Whats the best (most popular) way to avoid warning messages about implicit conversions and truncation? I have a char(34) column that only contains values meaningful to me in the first nine positions. I want to bring the length of the field down to nine so I can join it with other fields and carry ou...