Search found 733 matches

by FranklinE
Mon Sep 13, 2010 8:57 am
Forum: General
Topic: Another Milestone
Replies: 5
Views: 2379

ray.wurlod wrote:Not at all. One flight to LA, one flight to PA.
:wink: ...
Have you ever done a layover in an airport while drunk or with a hangover? That's not an experience I'd choose to repeat. :wink:
by FranklinE
Fri Sep 10, 2010 10:19 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Implicit conversion
Replies: 5
Views: 5091

If you add $OSH_PRINT_SCHEMAS = true to your job parameters you can see the actual schema used between your stages. You are converting HOSP_NUM to a datatype with less possible value and thus you are getting the warning message. The best solution is to explicitly convert the data to the same types ...
by FranklinE
Fri Sep 10, 2010 10:12 am
Forum: General
Topic: Another Milestone
Replies: 5
Views: 2379

Party! ... but getting home from Australia afterwards would be a little difficult. :D
by FranklinE
Thu Sep 09, 2010 2:35 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Input record sequence number
Replies: 21
Views: 10419

Does your input file have a header record or column headers in the first sequential record? That might be why your maximum row number is greater than the number of data records. That's a guess, because when the documentation says "column header records are ignored during processing" it doe...
by FranklinE
Thu Sep 09, 2010 9:10 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: "file does not exist" error yet it does exist..
Replies: 7
Views: 2419

Possibilities: The file being looked for has a permissions problem for the user id of the job looking for it. Check your permissions mask for the folder. At the runtime point the job is looking for the file, it has not yet been created. I've noticed that DS's parallel processing doesn't always keep ...
by FranklinE
Thu Sep 09, 2010 7:59 am
Forum: General
Topic: Check job name,project name existence
Replies: 5
Views: 2591

Without going into details (meaning: please don't offer advice on improving this, I fought that fight and lost), here is a sample Unix line to retrieve log messages. if [[ ${JobStat} == ${DSJS_RUNFAILED} ]]; then ErrorDisplay=$(${G_DS_HOME}/bin/dsjob -logsum -type FATAL -max {MaxDsplyErrors} ${G_DS_...
by FranklinE
Tue Sep 07, 2010 8:52 am
Forum: General
Topic: Executing SFTP using FTP Plug-In
Replies: 4
Views: 3498

Rumor has it that the 8x version of FTP Enterprise is supposed to be SSHv2 compliant. I'm stuck with 7x and had to get a waiver to not use SFTP. The only workaround I know of is to run SFTP in a non-DS job and land the files on your local server, then read them with your preferred file stage. That d...
by FranklinE
Thu Aug 26, 2010 6:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Promote Subrecord stage
Replies: 9
Views: 3510

...I cannot think of too many reasons to avoid a transform - they are pretty speedy. The restructure stages obfuscate metadata and "can" make maintenance and understanding a bit more difficult. Also, these stages do not imply greater efficiency or performance, just a different tool in the...
by FranklinE
Wed Aug 25, 2010 3:20 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Promote Subrecord stage
Replies: 9
Views: 3510

Would you be able to post the schema of the dataset used as input? Thanks for asking. I should also add that I can use a Transformer stage and substring derivations without any problem. I do have a medium performance concern, or I wouldn't be trying to avoid using the Transformer. -schema record {r...
by FranklinE
Wed Aug 25, 2010 2:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Promote Subrecord stage
Replies: 9
Views: 3510

Promote Subrecord stage

I searched all the forums for anything on this error message, and got two hits that offered nothing about it beyond the mere mentioning of it. It compiles cleanly. At runtime it dies on main_program: Fatal Error: Not an aggregate field. [api/schema/schema.C:2173] , not one detail offered or found wi...
by FranklinE
Wed Aug 25, 2010 10:19 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: VSAM file to UNIX base
Replies: 3
Views: 2648

Partial answer

I explored this from a different angle recently, and found that CFF must have DS/mainframe installed for direct access between the Unix processes and the mainframe datasets (of any format, including VSAM). I am using FTP Enterprise to get sequential dataset data. I would very much like to see how th...
by FranklinE
Tue Aug 24, 2010 11:45 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle to Oracle performance
Replies: 7
Views: 5307

...I think the main overall issue must have something to do with landing the data to a text file vs. not landing it. I wonder where DS stores the data when it's not landed using a seq file stage. Thanks, Eric I was wondering along that same line: Is it possible that the CPU/memory being used is max...
by FranklinE
Fri Aug 20, 2010 10:15 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Unable to read all records from cobol file using CFF stage
Replies: 2
Views: 2049

Romil, I may be missing something, but it looks like you are working against the DataStage weakness in handling Cobol formats that use redefines at the record level. Your reference to a "master record" leads me to that assumption. My suggestion is based on the assumption that the record-ty...
by FranklinE
Thu Aug 19, 2010 12:49 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Schema files and RCP via Hamlet: To use or not to use?
Replies: 2
Views: 3674

Your points are well taken. I'll just clarify that our host production environment is mostly several million lines of COBOL/JCL under thousands of jobs that run cyclically. When we established centralized production support (I was there for the "bad" old days when the development team prov...
by FranklinE
Wed Aug 18, 2010 1:53 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Load 60 Million records from SAP to DB2
Replies: 4
Views: 2200

Re: Load 60 Million records from SAP to DB2

can u please let me know a bit more on how to do the bulk loading That's a DB2 question, not a DataStage one. It depends on the details of your DB2 installation. For example, your first question might be do you have BMC utilities available. If, you do, then it might be a lot faster to FTP your data...