Search found 387 matches

by pradkumar
Wed Apr 14, 2010 10:03 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Concatination not working
Replies: 6
Views: 3539

Concatination not working

Hi Everyone. How to concatinate different columns in transformer stage? I have 10 columns in the input of which 9 are char datatype and one is decimal. My reuqirement is to concatinate all the 10 fileds to one field use the field as key to merge. what i have done is created a new filed ABC of dataty...
by pradkumar
Thu Apr 08, 2010 8:20 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Heap Allocation Error with XML output stage
Replies: 9
Views: 9840

Hi Everyone, I have opened a PMR with IBM and they noticed that datastage cannot support more than about 200MB per record. My requirement is to create the xml file with only one row for all the repeating elements. In this case as iam getting 1.35 million rows i assume the size of one row would excee...
by pradkumar
Mon Apr 05, 2010 3:29 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Heap Allocation Error with XML output stage
Replies: 9
Views: 9840

Hi,

I tried by setting APT_PHYSICAL_DATASET_BLOCK_SIZE to more than 597169415 but i got the warning as INVALID environment specification for APT_PHYSICAL_DATASET_BLOCK_SIZE;
the valid range is 8192 to 268435456; setting the block size to 131072.

Thanks
by pradkumar
Thu Mar 11, 2010 2:39 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Handling XML special characters
Replies: 4
Views: 2503

Hi,

Thanks for the inputs.. It worked fine.

Iam marking this thread as resolved.
by pradkumar
Thu Mar 11, 2010 1:39 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Handling XML special characters
Replies: 4
Views: 2503

Hi, Thanks for your response. But,I couldnt get what you meant "It will happen automatically". Here is my scenario. Character Escaped Value & ---------- & < ----------- < > ----------- > " ----------- " The requirement is.. if the source data contains the character values...
by pradkumar
Thu Mar 11, 2010 11:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Handling XML special characters
Replies: 4
Views: 2503

Handling XML special characters

Hi Everyone, Iam using DB2 API stage to read the data from DB2 Mainframe and creating xml files using xml output stage. I have a requirement to handle XML special characters in our data. There are few special characters that need to be escaped in the XML files. Character Escaped Value & -- &...
by pradkumar
Thu Mar 04, 2010 10:01 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job aborting with the error malloc():memory corruption
Replies: 1
Views: 1531

Job aborting with the error malloc():memory corruption

Hi Everyone, Iam extracting data from Mainframe DB2 using the DB2 plug-in stage and writing it into a dataset. I am doing simple conversions such as concatenation,chanding the data format.The job is aborting with the below error: APT_CombinedOperatorController,0:***glibc detected***malloc():memory c...
by pradkumar
Mon Dec 14, 2009 7:37 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to skip a job in the sequence
Replies: 1
Views: 1022

How to skip a job in the sequence

Hi, My sequence job looks like J1-->J2-->J3-->J4. I have requirement to skip J1 if we are doing huge load, but we still need it in the job. we are executing all the sequences through the shell script. Could any one suggest the ways to skip the job J1 based on an parameters to the seq?? Thanks in Adv...
by pradkumar
Mon Nov 09, 2009 12:27 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Import Error - Consumed more than 10000k bytes
Replies: 1
Views: 1301

Import Error - Consumed more than 10000k bytes

Hi Everyone, I have one job which reads the xml transactions(responses) from MQ and dumps into a sequential file. The next job reads from sequential file with format options as ( Record delimter string =</TCRMService>\n ,final delimeter = none) and dataype as varchat 30000. In the second job iam pul...
by pradkumar
Tue Oct 13, 2009 10:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem in reading response from MQ
Replies: 11
Views: 5717

Hi Could any one suggest how to remove the nulls in my case..i have searched the forum but couldn't get successfull while extracting from MQ Connector stage..
by pradkumar
Mon Oct 12, 2009 3:46 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem in reading response from MQ
Replies: 11
Views: 5717

Hi Ernie.

a) Its the MDM Java application

b) One XML document per MQ message

Please looking forward for your valuable suggestions.

Thanks in Advance
by pradkumar
Mon Oct 12, 2009 12:40 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Missing delimter and non ascii characters in the file
Replies: 6
Views: 2572

Hi,

The issue was resolved. For some fileds in the target sequential stage the prefix bytes property was set to 2 ( default). once we removed the property we dont see any issue.

Iam marking this thread as resolved.

Thanks for everyone
by pradkumar
Wed Oct 07, 2009 4:35 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem in reading response from MQ
Replies: 11
Views: 5717

Hi, I have tried different options in the MQ Connector stage to pull the xml transaction as a single message by putting the End of the row terminator to No but unsuccesfull.So i have designed the job to pull the responses from MQ and dumps into a sequential file by putting the End of the line termni...
by pradkumar
Fri Oct 02, 2009 12:38 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Missing delimter and non ascii characters in the file
Replies: 6
Views: 2572

Hi, below are the hex values for the above one record 0000000 3030 3030 3330 3130 3033 3831 3434 7c00 0000020 0432 3138 3931 3231 3430 3032 307c 0002 0000040 3239 527c 7c7c 3033 2f31 342f 3230 3038 0000060 7c31 322f 3331 2f39 3939 397c 447c 567c 0000100 447c 597c 4163 7469 7665 0000 0000 7c32 000012...