Search found 504 matches

by ShaneMuir
Tue Mar 12, 2013 3:22 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Regarding schema file
Replies: 16
Views: 8475

So you're saying that your target is static but your input (from a sequential file) is variable? Edit: What Prasanna said - provided that they can always provided the columns in the same position each time. ie if there is a column X in the full schema in position 3, then column X will always arrive ...
by ShaneMuir
Tue Mar 12, 2013 3:19 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Assign value for more then one record
Replies: 3
Views: 2753

Quick question first - what is your source?
by ShaneMuir
Tue Mar 12, 2013 2:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Regarding schema file
Replies: 16
Views: 8475

A schema file gives DS a list of columns and their definitions to a stage. By only passing 2 columns when its expecting 4 - then you are sending incomplete data - which will cause an error.

If you want to get around it, then you would have to pass different schema files.
by ShaneMuir
Mon Mar 11, 2013 9:49 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Pivot rows
Replies: 12
Views: 6265

But if you used Loop functionality, combined with some RCP, and schema files you could write the one job to do both circumstances (or any number of input columns).
by ShaneMuir
Mon Mar 11, 2013 9:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Loading data to SAP
Replies: 9
Views: 4878

Short answer: Yes - that is exactly what the Idoc Load stage is for. Long Answer: IDocs do not directly load SAP tables - direct loading of SAP tables is a big no-no. Also, I would be doubtful that the Idoc would be any quicker than the LSMW. They both are probably doing very similar processes to lo...
by ShaneMuir
Mon Mar 11, 2013 9:20 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: logic required for horizontal pivot
Replies: 13
Views: 5556

Which release of v8 do you have? Do you have access to the loop functionality? If yes, just read each row of the file in as a single value and then use the field function to loop through the row outputting to the required fields. eg loopvariable for description would be: if @ITERATION = 1 then CELL ...
by ShaneMuir
Mon Jan 07, 2013 10:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DS Job in not completing.
Replies: 20
Views: 11083

Are you able to check for table/record locks on your target tables? I had this problem a couple of times and each time it was that the table and/or record lock.
by ShaneMuir
Mon Jan 07, 2013 10:12 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sequential File
Replies: 11
Views: 6938

Use a combination of the a sequential file stage and an external target stage. For the input use a sequential file stage using a file pattern. Include a column for the file name itself. Extract your required values and perform whatever transforms you need to perform. Prior to output concatenate all ...
by ShaneMuir
Wed Oct 24, 2012 4:45 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Title Case
Replies: 4
Views: 1853

Couldn't you just set your lookup to be caseless? (A=a in the lookup key type)
by ShaneMuir
Mon Oct 22, 2012 9:10 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: sequential file-reading
Replies: 4
Views: 1897

Whoops sorry totally didn't read the original post correctly. In my defence it was first thing in the morning.

When reading this file in, you are not doing anything special are you? RCP? Schemas?
by ShaneMuir
Mon Oct 22, 2012 1:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: sequential file-reading
Replies: 4
Views: 1897

A little more information on the scenario might help. Are you actively choosing to read in only 4 rows from the file? If so how are you acheiving this? If not, ie you are expecting 10 rows of data but are only getting 4, then I would expect some sort of messages in the log (look at the informational...
by ShaneMuir
Mon Oct 22, 2012 1:52 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: To get data before commas and pipe
Replies: 5
Views: 3181

What version of DS are your running. 8.5? If so you can solve this with the loop functionality in the transform.
by ShaneMuir
Thu Oct 04, 2012 6:39 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Records flow one by one to Lookup table.
Replies: 13
Views: 7327

PhilHibbs wrote:Can you get the sparse lookup query to automatically supply this count?
You would need to write a custom SQL query and pass the approprate fields. Still a very basic query using either a group by or over(partition by ...) depending on the requirements.
by ShaneMuir
Thu Oct 04, 2012 2:50 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Records flow one by one to Lookup table.
Replies: 13
Views: 7327

I think that in either case - a sparse lookup or an in-memory lookup - you have to do the duplicate checking yourself. I don't think there is an automatic option to "reject if duplicates", you just get a warning in the log about duplicate rows being ignored. Agreed So, to detect duplicate...
by ShaneMuir
Thu Oct 04, 2012 2:13 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Records flow one by one to Lookup table.
Replies: 13
Views: 7327

Hi Phil,

As far as I have seen Oracle doesn't act any different.
Regarding returning multiple rows, I believe that a sparse lookup just returns as many rows for which there is a match automatically - you don't get the choice?