Search found 111 matches
- Mon May 02, 2011 5:05 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Job hangs intermediately
- Replies: 10
- Views: 5119
what I have had happen in the past when a job that is inserting or updating is just sitting there is that my transaction log is full and cannot grow. After doing a TLOG backup the datastage job continued to process. We set our tlog backups to run quite frequent when we are processing the DW so that ...
- Mon May 02, 2011 4:35 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Quick question on querying DS_JOBS table
- Replies: 17
- Views: 15539
- Sat Apr 30, 2011 9:28 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Reusing the jobs
- Replies: 5
- Views: 2912
- Sat Apr 30, 2011 9:20 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: APT_CONFIG_FILE
- Replies: 8
- Views: 5540
And to say it another way. when a DS job runs in spawns an OSH process for each node defined in your config. This process is called the conductor. Each conductor will spawn multiple OSH processes called players for the objects in the job.Due to the pipline parellelism architecture all stages start a...
- Sun Apr 24, 2011 12:54 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: issue with the eccentric characters
- Replies: 4
- Views: 3318
- Tue Mar 29, 2011 1:02 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: datastage scd with no surrogate key state file
- Replies: 2
- Views: 3297
I have the same issues with the OLE DB for sql server. It requires values in all the properties, before sql after sql so on. To get around this I just put in a char(32) space. It then compiles I have not contacted IBM on this because I am on 8.5 now and the object is depreciated. We are migrating th...
- Tue Mar 29, 2011 12:56 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: my job is taking 45 minits to load the data
- Replies: 14
- Views: 9268
- Sat Mar 05, 2011 10:01 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Heap allocation failed w/ looping
- Replies: 4
- Views: 4706
[UPDATE] I have two patches coming from IBM One to fix the Heap allocation when using the two new functions GetSavedInputRecord and SavedInputRecord these functions cause memory consumption to soar till it runs out and the job aborts. They have found the issue and are unit testing it now. The surro...
- Sat Mar 05, 2011 9:34 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Generic Data Reconciliation
- Replies: 22
- Views: 16028
One approach to think about would be using schema files with the job. I had to read 100 differant files from a data mirror CDC output as the files arived. I did not want to have 100 jobs. I wrote one job which when run used a parameter set to define which schema to use. this way I only needed one jo...
- Fri Mar 04, 2011 8:39 pm
- Forum: General
- Topic: General design principle for DataStage
- Replies: 9
- Views: 6478
Well my 2 cents would go like this. I have been building datastage jobs since version 3 I am currently using 8.5 32bit and 8.5 64 bit. That said Simpler is better, why when it comes time to determine why a job takes so long and you have 50 stages in the job you will understand why. second not only a...
- Wed Mar 02, 2011 8:48 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: XML Parse Issue
- Replies: 6
- Views: 5135
- Tue Mar 01, 2011 8:21 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: XML Parse Issue
- Replies: 6
- Views: 5135
- Tue Mar 01, 2011 5:22 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to Achive bellow logic in datastage
- Replies: 6
- Views: 5441
Try this stage PxCombineRecords Stage Combine records with identical keys into single record Data restructuring stage for Parallel Extender jobs, which combines rows in which particular key column's values are identical into vectors of subrecords. Or If you are using 8.5 use the new functionality (l...
- Wed Feb 23, 2011 10:56 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Warnings due to date_from_string,julian_day_from_date fns
- Replies: 6
- Views: 7397
Try using this to make sure your data is correct. and reject the row that has invalid date conversions IsValidDate Returns whether the given value is valid for the type date. v Input: testdate (date) v Output: result (int8) v Examples. If the column mylink.mydate contains the date 2011-09-13, then t...
- Wed Feb 23, 2011 10:33 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Require more information on datastage 8.5 transformer stage
- Replies: 4
- Views: 7112
There is a new Variable called @ITERATION which you use to controll the number of loops. like @ITERATION <= 5 will take one input row and create 5 output rows. You also have loop variables which you can define and use just like stage variables. Its pretty self explanatory for the basics but does hav...