Reading of Multiple files using Sequential File stage

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
ramu1
Participant
Posts: 14
Joined: Mon May 12, 2008 12:47 am

Reading of Multiple files using Sequential File stage

Post by ramu1 »

Hi Friends,

I am having two similar files in source with same metadata , FileNames like product1.txt,product2.txt.

I am trying to read two files with Readmethod= FilePattern ,Mechanism in SeqFile Stage, with file name like product*.txt, and also tried like product?.txt.
But Now rows were returned while i am trying to view the data.

Please help me in this issue as soon as possible.

Thanks&Regards
Ramu
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

We don't do "urgent". DSXchange is an all-volunteer site whose members post as and when they can. Being asked for urgent response is, frankly, offensive.

If you want urgent help, sign up with your official support provider for priority service, and learn just how much "urgent" costs.


What you have done looks alright, provided that the File Pattern property contains the full pathname of the files you want to read (including wildcard characters in the basename portion of the pathname).
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

No rows rather than an error usually means a metadata mismatch issue. Can you open a single file directly?
-craig

"You can never have too many knives" -- Logan Nine Fingers
GowthamSen
Participant
Posts: 21
Joined: Tue Nov 02, 2010 2:36 pm
Location: India

Post by GowthamSen »

Hi,

The post might be old, but, I am having the same issue.
chulett wrote:No rows rather than an error usually means a metadata mismatch issue. Can you open a single file directly? ...
-- Yes, I am able to open the single file directly by "view data" and then execute the job.

I have 2 files, and I am trying to read those 2 files using sequential file stage using File Pattern. But the job fails showing the error as "Couldn't find any files on host 01WE9UWIN2003 with pattern D:/Common/Team Data/training/DS Data/Files_Pattern/EMP1.txt."

Am I missing anything there?
Thank you,
Regards

Gowtham
(Learning DS)
vinothkumar
Participant
Posts: 342
Joined: Tue Nov 04, 2008 10:38 am
Location: Chennai, India

Post by vinothkumar »

What are your exact file names and how did you gave in Sequential file stage. Also check that the metadata is same for both files and you are able to view both files when read individually.
GowthamSen
Participant
Posts: 21
Joined: Tue Nov 02, 2010 2:36 pm
Location: India

Post by GowthamSen »

Hi

Thanks for your reply.
vinothkumar wrote:What are your exact file names and how did you gave in Sequential file stage. Also check that the metadata is same for both files and you are able to view both files when read individually.
The exact file names:

File Name1: D:\Files Pattern\EMP1.txt
File Name2: D:\Files Pattern\EMP2.txt

The meta data also same for both.

Any other thing I am missing here?
Thank you,
Regards

Gowtham
(Learning DS)
GowthamSen
Participant
Posts: 21
Joined: Tue Nov 02, 2010 2:36 pm
Location: India

Post by GowthamSen »

Hi All,

I found the issue. The issue is that. there are some "spaces" in the folder name.

Thanks to all for helping me.
Thank you,
Regards

Gowtham
(Learning DS)
vinothkumar
Participant
Posts: 342
Joined: Tue Nov 04, 2008 10:38 am
Location: Chennai, India

Post by vinothkumar »

Please mark it as resolved.
GowthamSen
Participant
Posts: 21
Joined: Tue Nov 02, 2010 2:36 pm
Location: India

Post by GowthamSen »

vinothkumar wrote:Please mark it as resolved.
Sorry Vinoth,

I cannot mark it as Resolved. because I am not the author of this post.
Thank you,
Regards

Gowtham
(Learning DS)
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Which is why you really should start your own post, even when you find someone else with "the same issue". :wink:

If you really think the older post is relevant to your discussion, link to it.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply