Search found 2886 matches

by qt_ky
Thu May 24, 2018 6:42 am
Forum: General
Topic: non-database sparse lookup alternative options
Replies: 18
Views: 8434

Thanks all for the ideas and the links so far. I do recall the double hashed file or cascading hashed file / lookup concept. Is a distributed file yet a different type of file? I haven't ruled out going outside of DataStage to code a solution, but would also prefer to stay within the tool if possibl...
by qt_ky
Thu May 24, 2018 5:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parameterized password in Stored Procedure stage
Replies: 12
Views: 7375

I've experienced that as well. The software restricts a lot of special characters. There are documented here:

Naming restrictions for user IDs and passwords
by qt_ky
Tue May 22, 2018 8:33 am
Forum: General
Topic: non-database sparse lookup alternative options
Replies: 18
Views: 8434

Non-database means not using a RDMBS style Connector stage and instead using something that is well outside of the DBA area of control (as that is where the security shenanigans are taking place), such as a file-based structure that exists and functions on Information Server alone... Something like ...
by qt_ky
Tue May 22, 2018 7:34 am
Forum: General
Topic: non-database sparse lookup alternative options
Replies: 18
Views: 8434

non-database sparse lookup alternative options

We have some real-time always-on DataStage jobs with sparse lookups, with indexed key columns, running under ISD. Our servers are on AIX. Unfortunately, our organization has embraced database security to the point of uselessness. What are the alternative options for enabling high volume, high perfor...
by qt_ky
Mon May 21, 2018 4:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Netezza DB2 character discrepancy
Replies: 0
Views: 2272

I don't know, but could this be a factor? Because of known issues, it says not to use DB2 code page 1208 unless IBM Support tells you to. Is this the issue you are having?

http://www-01.ibm.com/support/docview.w ... wg21601028
by qt_ky
Mon May 21, 2018 4:49 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: error while loading db2
Replies: 7
Views: 5225

If you open the job with the error in Director and go to the log and double click a log entry and look at the value in the User field, is it the same user account you were expecting to find there? In some setups the users are mapped to other accounts.
by qt_ky
Fri May 18, 2018 11:12 am
Forum: General
Topic: ETL Modeling suggestions
Replies: 11
Views: 7099

I once worked in a shop with an ETL Architect who relied on a combination of Word and Excel documents. I have not worked an any place that has embraced FastTrack. Personally, I prefer logical source to target (reading from left to right) and always felt that documenting the other way was backwards, ...
by qt_ky
Thu May 17, 2018 5:05 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: set default value on look up failure
Replies: 4
Views: 2885

Not directly, but you can set the output column to nullable then check for null in a subsequent Transformer stage then set the value to whatever you want to.
by qt_ky
Tue May 15, 2018 5:07 am
Forum: General
Topic: Inhibiting sequence/job execution
Replies: 3
Views: 2964

The Wait For File Activity stage supports either way--waiting for a file to appear or disappear. So you could have it check for a 'maintenance file' and wait for it to disappear. Just be sure the team understands having the file present won't stop any jobs that are already running. Sounds like they ...
by qt_ky
Wed May 09, 2018 7:19 am
Forum: General
Topic: WSVR0652W: size of thread pool "WebContainer" reac
Replies: 0
Views: 3534

WSVR0652W: size of thread pool "WebContainer" reac

Has anyone run across this before? I've come up empty searching, so we will likely open a Support case. SystemOut.log warnings we are seeing about 1-2 times a week: [5/7/18 16:21:13:894 EDT] 00006561 ThreadPool I WSVR0652W: The size of thread pool "WebContainer" has reached 100 percent of ...
by qt_ky
Fri May 04, 2018 10:04 am
Forum: General
Topic: Reading encrypted password into user variable
Replies: 10
Views: 10238

by qt_ky
Thu May 03, 2018 4:49 am
Forum: General
Topic: Job schedules failing to run on schedule
Replies: 5
Views: 3647

This may or may not be related, but for what it's worth, we had to install a client tier patch for Director in order to resolve some unusual rescheduling problems. We had obtained the patch by opening a case (PMR) with IBM Support.

JR53246 Fixed problem with rescheduling and encrypted job parameters
by qt_ky
Wed May 02, 2018 5:10 am
Forum:
Topic: Data Lineage v Business Lineage v Blueprints
Replies: 6
Views: 8108

Thank you for the update on Blueprint Director. May it rest in peace. Perhaps its more useful features will resurface in a web-based tool someday.
by qt_ky
Wed May 02, 2018 5:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: CDC stage in Datastage 11.7
Replies: 10
Views: 13781

Thank you for shedding some light on that mystery.