Search found 26 matches

by Palermo
Wed Dec 09, 2015 11:24 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Deadlock in DB2 z/OS
Replies: 4
Views: 3200

Do you mean improper partitioning in the Change capture stage? I used "Hash partitioning" for before and after links. If I rerun the job can finish successfully or fail with deadlock message. That happens once a week and it is difficult to catch. I have no time and I should promote the job...
by Palermo
Wed Dec 09, 2015 4:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Deadlock in DB2 z/OS
Replies: 4
Views: 3200

Deadlock in DB2 z/OS

Hi Everyone, I have a problem with deadlock in DB2 database (z/OS). ETL job consists of 4 DB2 connectors and change capture stage. The table contains about 1,5 million records. Updated, inserted and deleted records are about 150 thousand. The job performs commit after 100 records. The table is not u...
by Palermo
Tue Jul 28, 2015 5:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to import table definitions from SQL query?
Replies: 6
Views: 4205

Maybe try wrapping the SQL query into a database view and import that view via the import > table definitions > odbc table definitions option in the DS Client? I thought about it but I have no access to create and delete views directly and it's slow. ... and Information Server metadata importers ha...
by Palermo
Tue Jul 28, 2015 12:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to import table definitions from SQL query?
Replies: 6
Views: 4205

You need to import table definitions from the tables accessed by the query. There is no mechanism for importing from the query itself; it contains no other useful metadata than the column names (and e ... Thanks. Maybe you know Netezza and DB2 tools help to describe data type from a SQL query? For ...
by Palermo
Mon Jul 27, 2015 2:07 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to import table definitions from SQL query?
Replies: 6
Views: 4205

How to import table definitions from SQL query?

Hi,

I have a SQL query. The SQL query consists of several types of join operations and tables. I need to import table definitions from the SQL query, for example, for Netezza connector and DB2 connector. Is it possible?
by Palermo
Sat May 09, 2015 2:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to prevent truncating before data extraction?
Replies: 14
Views: 4851

You are right, %CPU increases from 1% to 28% but the loading time is not long.
running
Image
finished
Image

truncate
Image
by Palermo
Sat May 09, 2015 1:42 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to prevent truncating before data extraction?
Replies: 14
Views: 4851

truncate
Image

change capture stage (read, insert and delete)
Image
by Palermo
Fri May 08, 2015 12:54 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to prevent truncating before data extraction?
Replies: 14
Views: 4851

chulett wrote:But if that is working for you without 'impacts on performance' then yay.
The SQL query returns about 60 000 rows and the change capture stage don't impact on performance in this case.
by Palermo
Fri May 08, 2015 12:21 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to prevent truncating before data extraction?
Replies: 14
Views: 4851

Once the query has executed - how long is it taking for data transfer? If all you are after is not having the table empty for so long, is it silly to ask if your query is optimised? The original SQL executed for minimum 20 minutes and I optimized it and now it executes for minimum 10 minutes. But i...
by Palermo
Fri May 08, 2015 9:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to prevent truncating before data extraction?
Replies: 14
Views: 4851

I think that it is impossible too. But I know one way but it impacts on performance. That is to use Change Capture stage and create 4 additional DB2 connector stage(READ, INSERT, UPDATE, DELETE) and Transformer stage. I will be forced to use them. Maybe you know another way?
by Palermo
Thu May 07, 2015 3:25 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to prevent truncating before data extraction?
Replies: 14
Views: 4851

How to prevent truncating before data extraction?

Hi, I have a issue. SQL query performs for a long time from DB2 Connector stage and the target table is truncated before data extraction. During this time the target table is empty. How to prevent truncating the target table before data extraction from source table by using only one parallel job? Th...