Search found 1015 matches

by Mike
Wed Jun 29, 2016 5:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: EBCIDIC to ASCII Conversion
Replies: 5
Views: 5250

There are different EBCDIC code pages. Your mainframe folks have clued you in by telling you they are using CCSID 037. The ! character is an example that would translate differently if using, e.g., CCSID 500. You need to experiment with the EBCDIC NLS code pages and use whatever matches up to CCSID ...
by Mike
Tue Jun 28, 2016 5:12 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Disk IO issue - Longer Job run time
Replies: 19
Views: 11375

From your last description, I would guess that it is related to the load on your server during those morning runs. One possible cause of a long Startup time is an overloaded server. Also keep in mind that "Startup time" is a misleading label. Think of it as more of a bucket of time that wa...
by Mike
Tue Jun 28, 2016 8:53 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Disk IO issue - Longer Job run time
Replies: 19
Views: 11375

I'm still mostly old school when it comes to analyzing resource usage. I like watching an interactive nmon window along with having a Director monitor window open.

It sounds like your admins have already captured the relevant data for you.

Mike
by Mike
Tue Jun 28, 2016 8:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Disk IO issue - Longer Job run time
Replies: 19
Views: 11375

I guess we were typing at the same time... Your data volumes seem insignificant. The fork lookup is a potential problem with buffering and deadlocks. All of the reference data for a normal lookup needs to be preloaded to memory. Replace the lookup stage with a join stage for the more typical fork jo...
by Mike
Tue Jun 28, 2016 8:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Disk IO issue - Longer Job run time
Replies: 19
Views: 11375

You didn't answer any of my questions... With your design using the lookup stage, I would check if you have enough physical memory to support the reference data being preloaded to memory (assuming you are doing a normal lookup). If you exhaust physical memory, using swap space will generate a lot of...
by Mike
Wed Jun 22, 2016 7:20 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Disk IO issue - Longer Job run time
Replies: 19
Views: 11375

What is the size of the file being read? What is the size of the file being written? What other stages are in your job design? What other processes are running on the server at the same time? Are you doing anything in a Before-job subroutine?

Mike
by Mike
Thu Jun 02, 2016 6:30 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to insert into date
Replies: 10
Views: 5665

You seem to have a weak interface contract with your data provider.

If you want to be nice and handle all possible variations, you'll have to do a lot of extra work.

So what will you do with "16122"? January 22 or December 2?

Mike
by Mike
Tue May 31, 2016 3:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sequential file stage with schemafile crops text
Replies: 4
Views: 3185

The transformer stage is frequently the way to avoid implicit type conversion warnings, transforming larger strings into smaller strings, and other such things as might require an explicit transformation. You could try replacing the transformer with a copy or a modify to see if the warnings you want...
by Mike
Tue May 24, 2016 4:07 pm
Forum: General
Topic: Status code = -14 DSJE_TIMEOUT
Replies: 15
Views: 11840

Enter the dsjob command without any options and review the syntax requirements. There are multiple options for authentication. In your working example, you have authenticated directly with the engine tier. In your timeout example, it does not appear that you have provided any of the acceptable authe...
by Mike
Fri May 20, 2016 4:54 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Join stage not working in CDC parallel job
Replies: 6
Views: 5184

By "continuous mirroring mode", I'm going to assume you're saying this is an ISD job. If so, you'll need to find the documentation on the data source restrictions for designing ISD jobs. I think this was in an IBM Redbook that's been out there for years.

Mike
by Mike
Sun May 15, 2016 9:00 am
Forum: General
Topic: Status code = -14 DSJE_TIMEOUT
Replies: 15
Views: 11840

This seems likely to come down to a permissions issue. You will need to work with your Information Server and DataStage Admins since resolving it will very likely depend on how user and group security is set up and administered for your installation. Some thought starters: Using internal registry or...
by Mike
Thu May 12, 2016 7:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ODBC Connector Stage for DB2 Performance issue
Replies: 4
Views: 3486

The DB2 Connector can do partitioned reads even when the underlying source table is not partitioned. I always prefer the DB2 Connector over the ODBC Connector, so I don't know about the ODBC Connector's parallel read capabilities. The fact that you're seeing all rows broadcasted to every processing ...
by Mike
Wed May 11, 2016 7:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: shared container output link problem
Replies: 5
Views: 5007

Yes. The transformer inside the shared container. For whatever reason, RCP seems to fail, which causes those "Could not find input field" errors that you are experiencing. And it's not all transformers inside a shared container since I have others where RCP worked fine... I never could pin...
by Mike
Tue May 10, 2016 4:30 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: shared container output link problem
Replies: 5
Views: 5007

I think this is a likely bug. I've run into a similar issue on version 11.3. I ended up implementing a workaround for expediency. My unverified thinking was that it was somehow related to having a transformer stage as first stage after the input with RCP enabled. I ran into this bug on two different...
by Mike
Fri May 06, 2016 4:51 pm
Forum: General
Topic: Get DS Log
Replies: 4
Views: 3306

Enable DSODB. Configure it to capture the level of detail that you desire. The information you need will be sitting in a database table for you. You can also use some of the reporting environment variables such as $APT_PM_PLAYER_TIMING to capture that detail into the job log...there is another repor...