Search found 111 matches

by greggknight
Mon May 02, 2011 5:05 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job hangs intermediately
Replies: 10
Views: 5119

what I have had happen in the past when a job that is inserting or updating is just sitting there is that my transaction log is full and cannot grow. After doing a TLOG backup the datastage job continued to process. We set our tlog backups to run quite frequent when we are processing the DW so that ...
by greggknight
Mon May 02, 2011 4:35 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Quick question on querying DS_JOBS table
Replies: 17
Views: 15539

I run this code in a batch job. Gives me three different lists in the director job run log. Folder is a param. The Folder option worked in versions prior to 8.0 have not tryed to figure out the issue in 8.xxx yet , to busy but I still get a list of all the jobs FailedOpens = "" tablename =...
by greggknight
Sat Apr 30, 2011 9:28 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Reusing the jobs
Replies: 5
Views: 2912

I think you need to clarify this question.
:!:
by greggknight
Sat Apr 30, 2011 9:20 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: APT_CONFIG_FILE
Replies: 8
Views: 5540

And to say it another way. when a DS job runs in spawns an OSH process for each node defined in your config. This process is called the conductor. Each conductor will spawn multiple OSH processes called players for the objects in the job.Due to the pipline parellelism architecture all stages start a...
by greggknight
Sun Apr 24, 2011 12:54 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: issue with the eccentric characters
Replies: 4
Views: 3318

`e could be a spanish char
The ` for example determines gender of a noun it is used in names and such and removing the char changes the meaning of the word.

Thats one thing to look at.
If so you might need to handle spanish charecters.
by greggknight
Tue Mar 29, 2011 1:02 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: datastage scd with no surrogate key state file
Replies: 2
Views: 3297

I have the same issues with the OLE DB for sql server. It requires values in all the properties, before sql after sql so on. To get around this I just put in a char(32) space. It then compiles I have not contacted IBM on this because I am on 8.5 now and the object is depreciated. We are migrating th...
by greggknight
Tue Mar 29, 2011 12:56 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: my job is taking 45 minits to load the data
Replies: 14
Views: 9268

I would also do inserts then update
less scanning.
by greggknight
Sat Mar 05, 2011 10:01 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Heap allocation failed w/ looping
Replies: 4
Views: 4706

[UPDATE] I have two patches coming from IBM One to fix the Heap allocation when using the two new functions GetSavedInputRecord and SavedInputRecord these functions cause memory consumption to soar till it runs out and the job aborts. They have found the issue and are unit testing it now. The surro...
by greggknight
Sat Mar 05, 2011 9:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generic Data Reconciliation
Replies: 22
Views: 16028

One approach to think about would be using schema files with the job. I had to read 100 differant files from a data mirror CDC output as the files arived. I did not want to have 100 jobs. I wrote one job which when run used a parameter set to define which schema to use. this way I only needed one jo...
by greggknight
Fri Mar 04, 2011 8:39 pm
Forum: General
Topic: General design principle for DataStage
Replies: 9
Views: 6478

Well my 2 cents would go like this. I have been building datastage jobs since version 3 I am currently using 8.5 32bit and 8.5 64 bit. That said Simpler is better, why when it comes time to determine why a job takes so long and you have 50 stages in the job you will understand why. second not only a...
by greggknight
Tue Mar 01, 2011 8:21 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML Parse Issue
Replies: 6
Views: 5135

:idea:
Did you creat a schema?
Did you read the documentation on using the object and how to configure it?
Did you define your repeating element?
:idea:
by greggknight
Tue Mar 01, 2011 5:22 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to Achive bellow logic in datastage
Replies: 6
Views: 5441

Try this stage PxCombineRecords Stage Combine records with identical keys into single record Data restructuring stage for Parallel Extender jobs, which combines rows in which particular key column's values are identical into vectors of subrecords. Or If you are using 8.5 use the new functionality (l...
by greggknight
Wed Feb 23, 2011 10:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Warnings due to date_from_string,julian_day_from_date fns
Replies: 6
Views: 7397

Try using this to make sure your data is correct. and reject the row that has invalid date conversions IsValidDate Returns whether the given value is valid for the type date. v Input: testdate (date) v Output: result (int8) v Examples. If the column mylink.mydate contains the date 2011-09-13, then t...
by greggknight
Wed Feb 23, 2011 10:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Require more information on datastage 8.5 transformer stage
Replies: 4
Views: 7112

There is a new Variable called @ITERATION which you use to controll the number of loops. like @ITERATION <= 5 will take one input row and create 5 output rows. You also have loop variables which you can define and use just like stage variables. Its pretty self explanatory for the basics but does hav...