Search found 137 matches
- Mon May 25, 2020 1:19 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How do you ingest your data into datalake, ...?
- Replies: 3
- Views: 17224
- Mon May 18, 2020 11:49 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How do you ingest your data into datalake, ...?
- Replies: 3
- Views: 17224
- Mon May 18, 2020 8:53 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How do you ingest your data into datalake, ...?
- Replies: 3
- Views: 17224
How do you ingest your data into datalake, ...?
Hi there, How do you ingest your data into datalake: Datastage, Dataset, Informatica or sqoop, ...? I were trying this for a while with Datastage, creating cases with both IBM and Cloudera. With JDBC driver, we can ingest small amount of records (fewer than 1000) successfully, but ran hours for just...
- Thu Jun 20, 2019 2:20 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Datastage JDBC Connector Ingest Data to Apache Kudu
- Replies: 2
- Views: 4216
- Sun Jun 16, 2019 10:23 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Datastage JDBC Connector Ingest Data to Apache Kudu
- Replies: 2
- Views: 4216
Datastage JDBC Connector Ingest Data to Apache Kudu
Hello every one, does any one ingest data to Hadoop platform (Hive, Impala) or Apache Kudu? How do you resolve the performance issue? We use Datastage JDBC connector with Cloudera Impala JDBC driver, it works well for extraction, but not loading - the insert performance is terrible: 20,000 records t...
- Fri Jun 01, 2018 1:11 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Removing Control and Non-ASCII characters
- Replies: 9
- Views: 17321
- Fri Jun 01, 2018 12:27 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Removing Control and Non-ASCII characters
- Replies: 9
- Views: 17321
- Fri Mar 10, 2017 10:41 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: DB2 Connector Reject setting
- Replies: 3
- Views: 3780
Thanks for responses. In my experience with a peek stage as reject link target, it's nothing with what's logged. It logs on the same number of info items as your parallel config. One job succeeds with 0 Abort after (rows), another job fails with the same setting. So the setting is unsure of its beha...
- Thu Mar 09, 2017 12:45 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: DB2 Connector Reject setting
- Replies: 3
- Views: 3780
DB2 Connector Reject setting
A DB2 connector reject link is provided to accommodating without aborting no matter how many rejects are produced. How do we accommodate this: below is from IBM knowledge centre: https://www.ibm.com/support/knowledgecenter/SSZJPZ_8.1.0/com.ibm.swg.im.iis.conn.db2db.usage.doc/topics/iisdb2_mngrejectd...
- Tue Mar 07, 2017 3:38 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Datastage JDBC Connector
- Replies: 1
- Views: 3101
Datastage JDBC Connector
Hi There, I see there is JDBC connector for v9.1.2. Is there one for v8.7? Does this JDBC connector support connecting to Apache Kudu? Apache Kudu has JDBC driver for Unix platform. Can we use this driver for Datastage v8.7 running on AIX? https://www.ibm.com/support/knowledgecenter/SSZJPZ_9.1.0/com...
- Mon Nov 30, 2015 9:51 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: What Do Change Capture stage Actions Mean?
- Replies: 4
- Views: 6252
- Mon Nov 30, 2015 3:11 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Inermediate link in join stage
- Replies: 6
- Views: 8138
Re: Inermediate link in join stage
Can any one tell what the intermediate links are different with left and right links? For the types of join: inner, left / right outer and full, are they not applied to these intermediate links?
thanks,
thanks,
- Mon Nov 30, 2015 3:06 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Inermediate link in join stage
- Replies: 6
- Views: 8138
Re: Inermediate link in join stage
I Guess you can use merge stage also, don't you?
- Mon Nov 30, 2015 2:48 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Inermediate link in join stage
- Replies: 6
- Views: 8138
Re: Inermediate link in join stage
How these 14 files are brought to the join stage: after two links are added as left and right links, more links are added to the stage and will be treated as Intermediate links without any issue?
Thanks,
Thanks,
- Mon Nov 30, 2015 2:17 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: What Do Change Capture stage Actions Mean?
- Replies: 4
- Views: 6252
What Do Change Capture stage Actions Mean?
I'm surprised that even on its page of Change Capture stage below, It doesn't explain what the actions mean of insert, delete, copy and edit, and doesn't list what the change codes are for these. https://www-01.ibm.com/support/knowledgecenter/SSZJPZ_11.5.0/com.ibm.swg.im.iis.ds.parjob.dev.doc/topics...