Search found 72 matches

by Jayakannan
Tue Oct 22, 2013 3:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Web service invocation with huge volume of data
Replies: 7
Views: 4538

Not to my knowledge, I was making a change in another parallel job and compiled it. At the same time this job status changed to Crashed. One more question. Since the response is still coming back, can we say that DataStage could have sent request to web service for all the 2.8 million records and we...
by Jayakannan
Tue Oct 22, 2013 1:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Web service invocation with huge volume of data
Replies: 7
Views: 4538

Thank you. DataStage job started on 10/19, run for around 48 hours and then the status changed to Crashed with below warning. "Job control process (pid 62587014) has failed" Previously, there were few warnings related to web service response - <faultcode>env:Server</faultcode><faultstring>...
by Jayakannan
Mon Oct 21, 2013 8:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Web service invocation with huge volume of data
Replies: 7
Views: 4538

Service team is invloved in this now.

So can we say that the bottleneck is only with the web service on the number of records being processed in a call?

Is there something can be done in DataStage job to increase the performance?
by Jayakannan
Sat Oct 19, 2013 6:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Web service invocation with huge volume of data
Replies: 7
Views: 4538

Web service invocation with huge volume of data

Hi, My job design is DataSet -> XML Output -> Web Service Transformer -> XML Input -> File The voulme of the source dataset is around 2.8 million records for the first run (full load), 5 fields to be sent to web service in the request XML. All the stages are running in parallel mode including XML an...
by Jayakannan
Fri Jun 07, 2013 7:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Maximum number of bytes in a record in flat file
Replies: 10
Views: 4349

This is resolved.

I changed the property of Record Delimiter String = DOS format to Record Delimiter = UNIX newline and the record count is proper now (without blank lines).

This file is going to be consumed by Mainframe system which has not happened yet.

Thanks for your help!!
by Jayakannan
Fri Jun 07, 2013 7:21 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Maximum number of bytes in a record in flat file
Replies: 10
Views: 4349

On the server itself because i viewed the data using WinSCP on server.
by Jayakannan
Fri Jun 07, 2013 6:35 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Maximum number of bytes in a record in flat file
Replies: 10
Views: 4349

Checked the data and there are couple of blank lines in between, not sure how they are populated.

Ray,

I am not familiar with BOM and there is no such explicit setting i could see.
by Jayakannan
Fri Jun 07, 2013 4:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Maximum number of bytes in a record in flat file
Replies: 10
Views: 4349

When I run the unix command wc -l then the result is showing correct record count but in viewing the file using WinSCP editor or Notepad++ the record/line count is wrong.
by Jayakannan
Thu Jun 06, 2013 7:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Maximum number of bytes in a record in flat file
Replies: 10
Views: 4349

No, it has multiple fields. But the last field's (FILLER) length is 3843 bytes to add spaces.

I just tried to split this field into multiple but still it is showing wrong record count (difference of 2).
by Jayakannan
Thu Jun 06, 2013 6:15 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Maximum number of bytes in a record in flat file
Replies: 10
Views: 4349

Maximum number of bytes in a record in flat file

Hi, I am trying to create the fixed length .txt file where record length is 4096 bytes/characters and with this length the file is showing wrong record count in that file. I reduced the record length to around 2500 bytes and then it is showing correct record count in that file. Is there any limitati...
by Jayakannan
Sun May 19, 2013 10:10 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to configure SAS stage?
Replies: 0
Views: 1284

How to configure SAS stage?

Hi,

I have a requirement to read data from SAS ODBC and process it in DataStage, can someone please guide me on how to configure the SAS stage for this requirement?

Also can someone please let me know the data format in SAS ODBC db as i am new to this?

Is there any document available to refer?
by Jayakannan
Fri Mar 15, 2013 3:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem in connecting with database
Replies: 5
Views: 4713

We modified the Sparse lookup to Normal lookup and the issue is resolved. I got the below reason for failure, When a job starts running, all the DB stages will try to estabilish connection to Database and if it doesn't happen within a specific time period (2 mins) the job aborts with the error messa...
by Jayakannan
Wed Mar 13, 2013 12:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem in connecting with database
Replies: 5
Views: 4713

Re: Problem in connecting with database

Unfortunately Nothing is the answer because it is a Read-Only job in QA and no migrations happened during this one week for this job.
by Jayakannan
Tue Mar 12, 2013 2:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML Output stage repeats element
Replies: 4
Views: 5356

Desc as key column in Input->Columns' tab of XML Output stage should work.
by Jayakannan
Tue Mar 12, 2013 2:32 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem in connecting with database
Replies: 5
Views: 4713

Problem in connecting with database

Hi, we are getting below error messages, lkp_LastCntlNbr,0: SQLExecute reported: SQLSTATE = 40003: Native Error Code = -30081: Msg = [IBM][CLI Driver] SQL30081N A communication error has been detected. Communication protocol being used: "TCP/IP". Communication API being used: "SOCKETS...