External Source Stage Fatal error

[Ragunathan Gunasekaran]

Hi ,

I am using an external source stage to capture the file creation date and time . The source program is provided as below

Code: Select all

ls -t --full-time #pDirName#/filename.txt| sed  's/[0-9][0-9][0-9][0-9]-[0-9][0-9]-[0-9][0-9] [0-9][0-9]:[0-9][0-9]:[0-9][0-9]/:&:/'|cut -d':' -f2-4

The entire command is working fine in the command prompt of the Operating sysrem but throws a fatal error from Datastage

Error as below

Code: Select all

Invalid data source specified: Invalid hostname:

Any clues..?

[ray.wurlod]

Try "escaping" the single-quote characters ( \' ).

[Ragunathan Gunasekaran]

Adding escape character to quote Dint solve the problem..

While trying to view the score Datastage itself sends the commands to the operating system with proper escape characters

Code: Select all

#################################################################
#### STAGE: SrcEs_DetailFileCreationDateTime
## Operator
import
## Operator options
-dontUseOffsetsWithSources
-schema record
  {final_delim=end, delim=none, quote=none}
(
  CreationDateTime:string[];
)
-rejects continue
-source 'ls -t --full-time [&"pDirName"]\/filename.txt| sed  \'s\/[0-9][0-9][0-9][0-9]-[0-9][0-9]-[0-9][0-9] [0-9][0-9]:[0-9][0-9]:[0-9][0-9]\/:&:\/\'|cut -d\':\' -f2-4'
## General options
[ident('SrcEs_DetailFileCreationDateTime'); jobmon_ident('SrcEs_DetailFileCreationDateTime')]
## Outputs
0> [] 'SrcEs_DetailFileCreationDateTime:lk_DetailFileCreationDateTime.v'
;
# End of OSH code

[Ragunathan Gunasekaran]

Any ':' characters in the command will not work via External source stage. I have changed my command as

stat filename.txt | grep 'Change'|cut -d'.' -f1-1| cut -d' ' -f2-3

The stage worked Fine now

[ray.wurlod]

What do the colon characters do if executed at the operating system shell prompt?

[Ragunathan Gunasekaran]

It gives me a perfect result in the Operating system level. i.e the command displays the date and time as YYYY-MM-DD HH:MM:SS

[ray.wurlod]

Perhaps you need to "escape" the colon characters also.