File Structure is same for both files. The file content also I given in my first post.
I want to load this both data into another sequential file using file patern option so that I have given below properties in sequential file and trying to view the data but i couldn't
Code: Select all
##I TFCN 000001 15:23:27(000) <main_program>
Ascential DataStage(tm) Enterprise Edition 7.5
Copyright (c) 2004, 1997-2004 Ascential Software Corporation.
All Rights Reserved
##I TOSH 000002 15:23:27(001) <main_program> orchgeneral: loaded
##I TOSH 000002 15:23:27(002) <main_program> orchsort: loaded
##I TOSH 000002 15:23:27(003) <main_program> orchstats: loaded
##W TCOS 000049 15:23:27(004) <main_program> Parameter specified but not used in flow: DSProjectMapName [osl\osl.C:651]
##I TCOS 000021 15:23:27(005) <main_program> Echo:
import
-schema record
{final_delim=end, delim=','}
(
name:string[max=255];
desc:string[max=255];
)
-rejects continue
-reportProgress yes
-filepattern 'D:\\Datastage\\DX444\\ISFiles\\Temp\\output*.txt'
[ident('Sequential_File_0'); jobmon_ident('Sequential_File_0')]
0> [] 'Sequential_File_0:DSLink2.v'
;
head -nrecs 10
[ident('_Head'); jobmon_ident('_Head'); seq]
0< 'Sequential_File_0:DSLink2.v'
0> [] 'Sequential_File_0:DSLink2_Head.v'
;
peek -all -delim '%%PEEK%%DELIM%%' -field name -field desc
[ident('_PEEK_IDENT_'); jobmon_ident('_PEEK_IDENT_'); seq]
0< 'Sequential_File_0:DSLink2_Head.v'
0> [] 'Sequential_File_0:DSLink2_Head_PEEK_IDENT_.v'
;
abort -nrecs 10
[ident('_ABORT_IDENT_'); jobmon_ident('_ABORT_IDENT_'); seq]
0< 'Sequential_File_0:DSLink2_Head_PEEK_IDENT_.v'
;
##I TFSC 000001 15:23:28(004) <main_program> APT configuration file: C:/Ascential/DataStage/Configurations/default.apt
##I TFSC 000000 15:23:28(005) <main_program>
This step has no datasets.
It has 1 operator:
op0[1p] {(sequential APT_CombinedOperatorController:
(Sequential_File_0)
(_Head)
(_PEEK_IDENT_)
(_ABORT_IDENT_)
) on nodes (
node1[op0,p0]
)}
It runs 1 process on 1 node.
##I TCOS 000022 15:23:28(006) <main_program> Explanation:
Step has 4 operators.
???, invoked with args: -schema record {final_delim=end, delim=","} ( name: string[max=255]; desc: string[max=255]; ) -rejects continue -reportProgress yes -filepattern D:\Datastage\DX444\ISFiles\Temp\output*.txt
output port 0 bound to data entity "Sequential_File_0:DSLink2.v"
???, invoked with args: -nrecs 10
input port 0 bound to data entity "Sequential_File_0:DSLink2.v"
output port 0 bound to data entity "Sequential_File_0:DSLink2_Head.v"
???, invoked with args: -all -delim %%PEEK%%DELIM%% -field name -field desc
input port 0 bound to data entity "Sequential_File_0:DSLink2_Head.v"
output port 0 bound to data entity "Sequential_File_0:DSLink2_Head_PEEK_IDENT_.v"
???, invoked with args: -nrecs 10
input port 0 bound to data entity "Sequential_File_0:DSLink2_Head_PEEK_IDENT_.v"
Step has 3 data entities.
Data "Sequential_File_0:DSLink2.v"(an Orchestrate data set)
written by operator "Sequential_File_0"
read by operator "_Head"
Data "Sequential_File_0:DSLink2_Head.v"(an Orchestrate data set)
written by operator "_Head"
read by operator "_PEEK_IDENT_"
Data "Sequential_File_0:DSLink2_Head_PEEK_IDENT_.v"(an Orchestrate data set)
written by operator "_PEEK_IDENT_"
read by operator "_ABORT_IDENT_"
##I TCOS 000023 15:23:28(007) <main_program> Dump:
{
text="import\r\n-schema record {final_delim=end, delim=\",\"} ( name: string[max=255]; desc: string[max=255]; )\r\n-rejects continue\r\n-reportProgress yes\r\n-filepattern 'D:\\\\Datastage\\\\DX444\\\\ISFiles\\\\Temp\\\\output*.txt'\r\n\r\n[ident('Sequential_File_0'); jobmon_ident('Sequential_File_0')]\r\n0> [] 'Sequential_File_0:DSLink2.v'\r\n;\r\n\r\nhead -nrecs 10\r\n[ident('_Head'); jobmon_ident('_Head'); seq]\r\n0< 'Sequential_File_0:DSLink2.v'\r\n0> [] 'Sequential_File_0:DSLink2_Head.v'\r\n;\r\n\r\npeek -all -delim '%%PEEK%%DELIM%%' -field name -field desc\r\n[ident('_PEEK_IDENT_'); jobmon_ident('_PEEK_IDENT_'); seq]\r\n0< 'Sequential_File_0:DSLink2_Head.v'\r\n0> [] 'Sequential_File_0:DSLink2_Head_PEEK_IDENT_.v'\r\n;\r\n\r\nabort -nrecs 10\r\n[ident('_ABORT_IDENT_'); jobmon_ident('_ABORT_IDENT_'); seq]\r\n0< 'Sequential_File_0:DSLink2_Head_PEEK_IDENT_.v'\r\n;",
line=1, column=1, name="", qualname="",
op={
text="import\r\n-schema record {final_delim=end, delim=\",\"} ( name: string[max=255]; desc: string[max=255]; )\r\n-rejects continue\r\n-reportProgress yes\r\n-filepattern 'D:\\\\Datastage\\\\DX444\\\\ISFiles\\\\Temp\\\\output*.txt'\r\n\r\n[ident('Sequential_File_0'); jobmon_ident('Sequential_File_0')]\r\n0> [] 'Sequential_File_0:DSLink2.v'",
line=1, column=1, name=import, qualname=Sequential_File_0,
wrapout={},
wrapperfile=import, kind=non_wrapper_cdi_op, exec_mode=none,
args="'record {final_delim=end, delim=\",\"} ( name: string[max=255]; desc: string[max=255]; )'-rejects'continue'-reportProgress'yes'-filepattern'D:\\\\Datastage\\\\DX444\\\\ISFiles\\\\Temp\\\\output*.txt'",
output={ text="\r\n0> [] 'Sequential_File_0:DSLink2.v'", line=13,
column=1, name="", qualname="Sequential_File_0[o0]",
data="Sequential_File_0:DSLink2.v"
}
},
op={
text="\r\n\r\nhead -nrecs 10\r\n[ident('_Head'); jobmon_ident('_Head'); seq]\r\n0< 'Sequential_File_0:DSLink2.v'\r\n0> [] 'Sequential_File_0:DSLink2_Head.v'",
line=16, column=1, name=head, qualname=_Head,
wrapout={},
wrapperfile=head, kind=non_wrapper_cdi_op, exec_mode=seq,
args="'10'",
input={ text="\r\n0< 'Sequential_File_0:DSLink2.v'", line=18,
column=1, name="", qualname="_Head[i0]",
data="Sequential_File_0:DSLink2.v"
},
output={ text="\r\n0> [] 'Sequential_File_0:DSLink2_Head.v'",
line=19, column=1, name="", qualname="_Head[o0]",
data="Sequential_File_0:DSLink2_Head.v"
}
},
op={
text="\r\n\r\npeek -all -delim '%%PEEK%%DELIM%%' -field name -field desc\r\n[ident('_PEEK_IDENT_'); jobmon_ident('_PEEK_IDENT_'); seq]\r\n0< 'Sequential_File_0:DSLink2_Head.v'\r\n0> [] 'Sequential_File_0:DSLink2_Head_PEEK_IDENT_.v'",
line=22, column=1, name=peek, qualname=_PEEK_IDENT_,
wrapout={},
wrapperfile=peek, kind=non_wrapper_cdi_op, exec_mode=seq,
args="'-delim'%%PEEK%%DELIM%%'-field'name'-field'desc'",
input={ text="\r\n0< 'Sequential_File_0:DSLink2_Head.v'", line=24,
column=1, name="", qualname="_PEEK_IDENT_[i0]",
data="Sequential_File_0:DSLink2_Head.v"
},
output={
text="\r\n0> [] 'Sequential_File_0:DSLink2_Head_PEEK_IDENT_.v'",
line=25, column=1, name="", qualname="_PEEK_IDENT_[o0]",
data="Sequential_File_0:DSLink2_Head_PEEK_IDENT_.v"
}
},
op={
text="\r\n\r\nabort -nrecs 10\r\n[ident('_ABORT_IDENT_'); jobmon_ident('_ABORT_IDENT_'); seq]\r\n0< 'Sequential_File_0:DSLink2_Head_PEEK_IDENT_.v'",
line=28, column=1, name=abort, qualname=_ABORT_IDENT_,
wrapout={},
wrapperfile=abort, kind=non_wrapper_cdi_op, exec_mode=seq,
args="'10'",
input={ text="\r\n0< 'Sequential_File_0:DSLink2_Head_PEEK_IDENT_.v'",
line=30, column=1, name="", qualname="_ABORT_IDENT_[i0]",
data="Sequential_File_0:DSLink2_Head_PEEK_IDENT_.v"
}
},
data={ text="\r\n0> [] 'Sequential_File_0:DSLink2.v'", line=13, column=1,
name="Sequential_File_0:DSLink2.v",
qualname="Sequential_File_0:DSLink2.v",
partwrapout={},
collwrapout={},
dir=flow, kind=ds, writer=Sequential_File_0, reader=_Head, pp=none,
trunc=default, ident="Sequential_File_0:DSLink2.v"
},
data={ text="\r\n0> [] 'Sequential_File_0:DSLink2_Head.v'", line=19,
column=1, name="Sequential_File_0:DSLink2_Head.v",
qualname="Sequential_File_0:DSLink2_Head.v",
partwrapout={},
collwrapout={},
dir=flow, kind=ds, writer=_Head, reader=_PEEK_IDENT_, pp=none,
trunc=default, ident="Sequential_File_0:DSLink2_Head.v"
},
data={ text="\r\n0> [] 'Sequential_File_0:DSLink2_Head_PEEK_IDENT_.v'",
line=25, column=1,
name="Sequential_File_0:DSLink2_Head_PEEK_IDENT_.v",
qualname="Sequential_File_0:DSLink2_Head_PEEK_IDENT_.v",
partwrapout={},
collwrapout={},
dir=flow, kind=ds, writer=_PEEK_IDENT_, reader=_ABORT_IDENT_,
pp=none, trunc=default,
ident="Sequential_File_0:DSLink2_Head_PEEK_IDENT_.v"
}
}
##W TOIX 000000 15:23:29(000) <Sequential_File_0,0> Couldn't find any files on host PRADEEP-0320510 with pattern D:/Datastage/DX444/ISFiles/Temp/output*.txt. [new-impexp\file_import.C:2624]
##I TOIX 000000 15:23:29(001) <Sequential_File_0,0> Output 0 produced 0 records.
##I USER 000000 15:23:29(002) <_Head,0> Input 0 consumed 0 records.
##I USER 000000 15:23:29(003) <_Head,0> Output 0 produced 0 records.
##I TOPK 000000 15:23:29(004) <_PEEK_IDENT_,0> Input 0 consumed 0 records.
##I TOPK 000000 15:23:29(005) <_PEEK_IDENT_,0> Output 0 produced 0 records.