Sequential File Stage

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Raftsman
Premium Member
Premium Member
Posts: 335
Joined: Thu May 26, 2005 8:56 am
Location: Ottawa, Canada

Sequential File Stage

Post by Raftsman »

I have a *.txt comma delimited file on the server. If I use the Server version of DS, I can view the data and process it. When I use the Parallel version, the view option abort and cannot process the file. I changed some defaults to DOS format and still not viewing the data.

Could someone please explain why something so easy in the Server DS world is so complicated in the Parallel world. You would think that it would get easier and not harder

Thanks
jhmckeever
Premium Member
Premium Member
Posts: 301
Joined: Thu Jul 14, 2005 10:27 am
Location: Melbourne, Australia
Contact:

Post by jhmckeever »

Raftsman,

I assume that you actually want help with your PX sequential file stage (or are you really aiming to start a discussion on "why something so easy in the Server DS world is so complicated in the Parallel world."? :-)

That's a big topic! But if you want some help with your sequential file stage then post the error message and stage settings for us to have a look at.

I also assume you've tried <a href="search.php">searching</a>, right? ;-)

J.
<b>John McKeever</b>
Data Migrators
<b><a href="https://www.mettleci.com">MettleCI</a> - DevOps for DataStage</b>
<a href="http://www.datamigrators.com/"><img src="https://www.datamigrators.com/assets/im ... l.png"></a>
Raftsman
Premium Member
Premium Member
Posts: 335
Joined: Thu May 26, 2005 8:56 am
Location: Ottawa, Canada

Post by Raftsman »

Yes, I searched for comma delimited, DOS linefeed etc. I am not trying to bash the Parallel DS. I am frustrated because I created a sequential comma delimited file, enter my schema representation and voila, I could view and work with it in the server world. I tried to do the same in the parallel world and I have had no luck. Frustration is setting in...

Anyway, the layout is

CD_TBL_ID:int16;
CSN:int16;
STD_AUD_INSR_DTTM:timestamp;
CD:nullable string[10];
CD_EDTTM:timestamp;
CD_XDTTM:timestamp;
CD_AEDESC:string[30];
CD_AFDESC:string[30];
CD_EDESC:string[max=254] {prefix=2};
CD_FDESC:string[max=254] {prefix=2};
AUD_UID:string[8];
AUD_ACTN_DTTM:timestamp;
AUD_ACTN_CD:string[1];
AUD_PGM_ID:nullable string[15];
)
The data is
00:00:00,"Person",2000-04-01-00.00.00.0000002,9999-12-31-00.00.00.000000,"Person","Person","Person","Person","JXS166",2006-11-24-00.00.00.000000,"I","JXS166"

The default parms are being used.

I get this message.

##W TOIX 000000 13:02:57(000) <Sequential_File_52,0> Bad trailing quote character at field "CD"; looking for '34' but found '0', at offset: 38
##W TOIX 000154 13:02:57(001) <Sequential_File_52,0> Import warning at record 0:
##W TOIX 000018 13:02:57(002) <Sequential_File_52,0> Import unsuccessful at record 0:
##W TOIX 000000 13:02:57(003) <Sequential_File_52,0> Field "STD_AUD_INSR_DTTM" delimiter not seen, at offset: 26
##W TOIX 000154 13:02:57(004) <Sequential_File_52,0> Import warning at record 1:
Raftsman
Premium Member
Premium Member
Posts: 335
Joined: Thu May 26, 2005 8:56 am
Location: Ottawa, Canada

Post by Raftsman »

The data looks like this,

9999,1,2006-11-24 00:00:00,"Person",2000-04-01-00.00.00.0000002,9999-12-31-00.00.00.000000,"Person","Person","Person","Person","JXS166",2006-11-24-00.00.00.000000,"I","JXS166"
jhmckeever
Premium Member
Premium Member
Posts: 301
Joined: Thu Jul 14, 2005 10:27 am
Location: Melbourne, Australia
Contact:

Post by jhmckeever »

Raftsman,

1. Go to 'Columns' tab of you file stage
2. Click 'Load'
3. Click 'Import' -> 'Sequential File Definitions'
4. Specify your file then hit 'Import'

The resulting dialog will walk you through the process. maybe you'll spot something amiss there?

HTH,
J.
<b>John McKeever</b>
Data Migrators
<b><a href="https://www.mettleci.com">MettleCI</a> - DevOps for DataStage</b>
<a href="http://www.datamigrators.com/"><img src="https://www.datamigrators.com/assets/im ... l.png"></a>
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Etiquette Note
When you mark a topic as Resolved please add a post explaining to future searchers HOW it was resolved.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Raftsman
Premium Member
Premium Member
Posts: 335
Joined: Thu May 26, 2005 8:56 am
Location: Ottawa, Canada

Post by Raftsman »

Sorry. I followed the previous post instructions and loaded a sequential file layout from the input data and everything worked fine. I didn't follow up on the post because I assume the previous posters answer solve my problem. I will follow up on future posts.

Thanks
Post Reply