Search found 56 matches

by debrujr
Mon Jan 12, 2015 7:49 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: External Filter as Data Source - Add row number
Replies: 4
Views: 2341

The requirement is to read multiple files using a wildcard. The sequential file stage forces me to run it in parallel when I am using the multi file wildcard option.
by debrujr
Mon Jan 12, 2015 5:17 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: External Filter as Data Source - Add row number
Replies: 4
Views: 2341

Is this something that can/should not be done? Lack of response worries me...
by debrujr
Thu Jan 08, 2015 11:21 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: External Filter as Data Source - Add row number
Replies: 4
Views: 2341

External Filter as Data Source - Add row number

I have a requirement to add a row number to input files as they are read in. Maybe better states, I need to know the row number of an input stream but from multiple files read at once. The initial design was a sequential file stage that reads multiple wild carded files and then adds a row number thr...
by debrujr
Thu Jun 16, 2011 6:52 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Error with DB2 Connector stage
Replies: 4
Views: 7291

It would seem that you are having a problem with your table name but then again the errors can be misleading. Please give us some more insight as to what the variables are set to and exactly what you are doing. Write Mode ? Generate SQL? Table Action? From what I think is going on you could do a wri...
by debrujr
Tue Jun 14, 2011 11:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Error with DB2 Connector stage
Replies: 4
Views: 7291

Try looking into your APT Configuration File. I have seen similar symptoms caused by an ill written config.
by debrujr
Fri Jun 10, 2011 7:49 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hadoop - Jaql - Pig [Big Insights]
Replies: 5
Views: 3497

Sounds on par with my assumptions.
by debrujr
Thu Jun 09, 2011 12:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hadoop - Jaql - Pig [Big Insights]
Replies: 5
Views: 3497

Hadoop - Jaql - Pig [Big Insights]

I found an older thread that mentioned hadoop but not really much info. Looking at a solution of blue's big data and wanted to see what kind of hurdles I am looking at as far as getting DS to extract/load data to it. Still in the early early stages but trying to understand how it will all fit togeth...
by debrujr
Fri May 20, 2011 6:26 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Question on Sequential file stage parsing
Replies: 3
Views: 2670

Without actually trying it could you not disregard the thought of delimeters in your sequential file and set a field length of 1? Like I said I haven't tried it, but I would think some tinkering with that would allow it. If not then some use of the Restructure operators would allow it somehow. I hav...
by debrujr
Thu May 19, 2011 3:05 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generating A Session Key
Replies: 1
Views: 1421

Nevermind. I figured out a way to do it. I can sort the data like I had intended with using my individual id and then time and then copying the data and adding a key column to each copy, one starting and one and the other starting at 2. Then I can join them togethar by the key I appended and the ind...
by debrujr
Thu May 19, 2011 12:56 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generating A Session Key
Replies: 1
Views: 1421

Generating A Session Key

Greetings all, I am looking for a way to generate a key to be housed on my fact table that can be used to lookup many attribute records. Sounds simple but I can't find a good way to do it. The scenario I have is that I am trying to relate a number of clicks to a session or time period of an individu...
by debrujr
Tue Mar 08, 2011 8:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Conn options for db2part operator
Replies: 5
Views: 3821

bcarlson wrote:When we talked to IBM, they said it was a known issue and sent us a custom 'db2part' operator with the necessary options. If you talk to IBM, the PMR we used is 34835,370,000.

Brad.
Perfect! Sending an email now. Thank you!
by debrujr
Mon Mar 07, 2011 1:52 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Partitioning DB2 data manually - Solving Lock Issues
Replies: 2
Views: 2473

Re: Partitioning DB2 data manually - Solving Lock Issues

Moderator: Please move this to the parallel or appropriate category. My apologies.
by debrujr
Mon Mar 07, 2011 1:34 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Conn options for db2part operator
Replies: 5
Views: 3821

Anything ever determined on this? I tried to perform the same partitioning and run into the same issue..... DS 8.1.0.0
by debrujr
Mon Mar 07, 2011 1:12 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Partitioning DB2 data manually - Solving Lock Issues
Replies: 2
Views: 2473

Partitioning DB2 data manually - Solving Lock Issues

Datastage 8.1.0.0 - Not native to the DB server DB2 9.5 - 4 Node 16 Partitions AIX Parallel Job DB2_Connector -> DB2_Connector The first connector is a simple sql statement selecting key1, key2 from my table where value <> what it needs to be. Partition read method - DB2 Record Count 100000 Array Si...
by debrujr
Tue Aug 10, 2010 12:46 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Deleting the project
Replies: 2
Views: 1980

I'm guessing your not at the current release? There is a fix for things not being removed from Director that were deleted in Designer but I am unsure if it will inherently remove it in the manner that you performed by just deleting the folder.