I have a *.txt comma delimited file on the server. If I use the Server version of DS, I can view the data and process it. When I use the Parallel version, the view option abort and cannot process the file. I changed some defaults to DOS format and still not viewing the data.
Could someone please explain why something so easy in the Server DS world is so complicated in the Parallel world. You would think that it would get easier and not harder
Thanks
Sequential File Stage
Moderators: chulett, rschirm, roy
-
- Premium Member
- Posts: 301
- Joined: Thu Jul 14, 2005 10:27 am
- Location: Melbourne, Australia
- Contact:
Raftsman,
I assume that you actually want help with your PX sequential file stage (or are you really aiming to start a discussion on "why something so easy in the Server DS world is so complicated in the Parallel world."?
That's a big topic! But if you want some help with your sequential file stage then post the error message and stage settings for us to have a look at.
I also assume you've tried <a href="search.php">searching</a>, right?![Wink ;-)](./images/smilies/icon_wink.gif)
J.
I assume that you actually want help with your PX sequential file stage (or are you really aiming to start a discussion on "why something so easy in the Server DS world is so complicated in the Parallel world."?
![Smile :-)](./images/smilies/icon_smile.gif)
That's a big topic! But if you want some help with your sequential file stage then post the error message and stage settings for us to have a look at.
I also assume you've tried <a href="search.php">searching</a>, right?
![Wink ;-)](./images/smilies/icon_wink.gif)
J.
<b>John McKeever</b>
Data Migrators
<b><a href="https://www.mettleci.com">MettleCI</a> - DevOps for DataStage</b>
<a href="http://www.datamigrators.com/"><img src="https://www.datamigrators.com/assets/im ... l.png"></a>
Data Migrators
<b><a href="https://www.mettleci.com">MettleCI</a> - DevOps for DataStage</b>
<a href="http://www.datamigrators.com/"><img src="https://www.datamigrators.com/assets/im ... l.png"></a>
Yes, I searched for comma delimited, DOS linefeed etc. I am not trying to bash the Parallel DS. I am frustrated because I created a sequential comma delimited file, enter my schema representation and voila, I could view and work with it in the server world. I tried to do the same in the parallel world and I have had no luck. Frustration is setting in...
Anyway, the layout is
CD_TBL_ID:int16;
CSN:int16;
STD_AUD_INSR_DTTM:timestamp;
CD:nullable string[10];
CD_EDTTM:timestamp;
CD_XDTTM:timestamp;
CD_AEDESC:string[30];
CD_AFDESC:string[30];
CD_EDESC:string[max=254] {prefix=2};
CD_FDESC:string[max=254] {prefix=2};
AUD_UID:string[8];
AUD_ACTN_DTTM:timestamp;
AUD_ACTN_CD:string[1];
AUD_PGM_ID:nullable string[15];
)
The data is
00:00:00,"Person",2000-04-01-00.00.00.0000002,9999-12-31-00.00.00.000000,"Person","Person","Person","Person","JXS166",2006-11-24-00.00.00.000000,"I","JXS166"
The default parms are being used.
I get this message.
##W TOIX 000000 13:02:57(000) <Sequential_File_52,0> Bad trailing quote character at field "CD"; looking for '34' but found '0', at offset: 38
##W TOIX 000154 13:02:57(001) <Sequential_File_52,0> Import warning at record 0:
##W TOIX 000018 13:02:57(002) <Sequential_File_52,0> Import unsuccessful at record 0:
##W TOIX 000000 13:02:57(003) <Sequential_File_52,0> Field "STD_AUD_INSR_DTTM" delimiter not seen, at offset: 26
##W TOIX 000154 13:02:57(004) <Sequential_File_52,0> Import warning at record 1:
Anyway, the layout is
CD_TBL_ID:int16;
CSN:int16;
STD_AUD_INSR_DTTM:timestamp;
CD:nullable string[10];
CD_EDTTM:timestamp;
CD_XDTTM:timestamp;
CD_AEDESC:string[30];
CD_AFDESC:string[30];
CD_EDESC:string[max=254] {prefix=2};
CD_FDESC:string[max=254] {prefix=2};
AUD_UID:string[8];
AUD_ACTN_DTTM:timestamp;
AUD_ACTN_CD:string[1];
AUD_PGM_ID:nullable string[15];
)
The data is
00:00:00,"Person",2000-04-01-00.00.00.0000002,9999-12-31-00.00.00.000000,"Person","Person","Person","Person","JXS166",2006-11-24-00.00.00.000000,"I","JXS166"
The default parms are being used.
I get this message.
##W TOIX 000000 13:02:57(000) <Sequential_File_52,0> Bad trailing quote character at field "CD"; looking for '34' but found '0', at offset: 38
##W TOIX 000154 13:02:57(001) <Sequential_File_52,0> Import warning at record 0:
##W TOIX 000018 13:02:57(002) <Sequential_File_52,0> Import unsuccessful at record 0:
##W TOIX 000000 13:02:57(003) <Sequential_File_52,0> Field "STD_AUD_INSR_DTTM" delimiter not seen, at offset: 26
##W TOIX 000154 13:02:57(004) <Sequential_File_52,0> Import warning at record 1:
-
- Premium Member
- Posts: 301
- Joined: Thu Jul 14, 2005 10:27 am
- Location: Melbourne, Australia
- Contact:
Raftsman,
1. Go to 'Columns' tab of you file stage
2. Click 'Load'
3. Click 'Import' -> 'Sequential File Definitions'
4. Specify your file then hit 'Import'
The resulting dialog will walk you through the process. maybe you'll spot something amiss there?
HTH,
J.
1. Go to 'Columns' tab of you file stage
2. Click 'Load'
3. Click 'Import' -> 'Sequential File Definitions'
4. Specify your file then hit 'Import'
The resulting dialog will walk you through the process. maybe you'll spot something amiss there?
HTH,
J.
<b>John McKeever</b>
Data Migrators
<b><a href="https://www.mettleci.com">MettleCI</a> - DevOps for DataStage</b>
<a href="http://www.datamigrators.com/"><img src="https://www.datamigrators.com/assets/im ... l.png"></a>
Data Migrators
<b><a href="https://www.mettleci.com">MettleCI</a> - DevOps for DataStage</b>
<a href="http://www.datamigrators.com/"><img src="https://www.datamigrators.com/assets/im ... l.png"></a>
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact: