Search found 35 matches

by alraaayeq
Tue Mar 15, 2005 6:14 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: File Routing!!! is it possible??
Replies: 6
Views: 2658

Thanks,


I did it, see viewtopic.php?p=127254

:wink:
by alraaayeq
Tue Mar 15, 2005 5:58 am
Forum: IBM<sup>®</sup> DataStage TX
Topic: File Routing and TX
Replies: 1
Views: 2670

File Routing and TX

Hi all; we are working in environment where we receive many files from different sources (1500+ files from 6 sources around the clock), sometimes we use our ETL jobs against some files before we transform them to destinations. we built small software using Unix shell scripts and C++ that do the job,...
by alraaayeq
Sun Mar 13, 2005 2:01 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: File Routing!!! is it possible??
Replies: 6
Views: 2658

TX product.

I have received a proposal from (X) company saying that TX is really suitable for File routing!

Can any body who has experience with it help me and give me his comments. :!:
by alraaayeq
Fri Feb 11, 2005 9:51 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: File Routing!!! is it possible??
Replies: 6
Views: 2658

In terms of DataStage, could you use a Sequence that looks for existence of files and then calls FTP to transfer them to other machines... DataStage might be a bit overpriced for this :wink: It might best be solved with a short UNIX script. Or is there something else that you need to do? when it co...
by alraaayeq
Fri Feb 11, 2005 7:39 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: File Routing!!! is it possible??
Replies: 6
Views: 2658

File Routing!!! is it possible??

I think one of you might been in a situation when he receives XYZ files and want to forward them to ABC servers, personally; this got to be my daily activities and I suffered from some limitation of my code. I heard that there is a kind of product by Aacential that can do file routing stuff, is this...
by alraaayeq
Tue Feb 01, 2005 12:01 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: XML large files (to be or not to be)
Replies: 10
Views: 3053

Can anyone confirm that there is a 2G limitation on files read by DataStage server? Is this only for the XML stage? The initial post on this topic seemed to imply that it was possible but slow. Personally, as an Ascential's "HAPPY" customer I've opened a new case "ticket" since ...
by alraaayeq
Mon Jan 31, 2005 11:53 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: XML large files (to be or not to be)
Replies: 10
Views: 3053

kcbland wrote:
Jim, you're hijacking this thread away from the original poster. :shock:
YES he did :lol: , but fortunately he asked the same question that I would like to have answer for.

Thanks kcbland for your comments.
by alraaayeq
Mon Jan 31, 2005 11:45 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: XML large files (to be or not to be)
Replies: 10
Views: 3053

You can also go with the C or java verision of xerces from apache. The C is a little faster, but I found more robust. Both of these software are free. Hi Andrew, I went to http://www.saxonica.com/ and I found that Saxon XSLT is not free product! am I going to the right page or the free software men...
by alraaayeq
Mon Jan 10, 2005 5:25 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: XML large files (to be or not to be)
Replies: 10
Views: 3053

XML large files (to be or not to be)

Hi all; after trying to deal with large XML files 2 gig and plus. I realised that I am going to use Java/C++ instead of DS. tell you why: 1- Memory limitations and leakage 2- very slow 3- or can't even process the file successfuly yet, I could not find any confirmation form Ascential that large XML ...
by alraaayeq
Wed Jan 05, 2005 12:50 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How can DS listen/loop on a directory for coming files?
Replies: 10
Views: 3801

I found it better to use two loops

1- outer loop that is infinite loop and has
2- inner loop that every time get the list of coming files

please see how to get the list of files in a directory here
viewtopic.php?t=90528&highlight=
by alraaayeq
Sun Jan 02, 2005 12:49 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Filtering folder content according to file size,date....etc?
Replies: 10
Views: 3987

Thanks ray.wurlod for your code. I have added DSLoginfo function inorder to view file information FileMode = FileStuff<5> ; * permissions FileSize = FileStuff<6> Inode = FileStuff<10> AccessTime = FileStuff<13> AccessDate = FileStuff<14> ModTime = FileStuff<15> ModDate = FileStuff<16> Owner = FileSt...
by alraaayeq
Wed Dec 29, 2004 12:12 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Filtering folder content according to file size,date....etc?
Replies: 10
Views: 3987

[Quote="chulett And just to add what Ogmios said, don't be leary of taking advantage of your operating system via whatever means necessary - shell scripts, DSExecute, whatever. You'll find it comes in very handy for all kinds of things, especially in the before/after job arena. :wink:[/Quote] l...
by alraaayeq
Tue Dec 28, 2004 3:59 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Filtering folder content according to file size,date....etc?
Replies: 10
Views: 3987

Again, I got more troubles and I got stuck. the reason is this , I went back to use UNIX specific commands which I hate. I used to use C++ where there is kind of objects that I do <objectname>.<value> and this is it!!! again, can we have similar capabilities <SOMEHOW> rather using CLI/C++/Shell!!
by alraaayeq
Mon Dec 27, 2004 4:12 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Filtering folder content according to file size,date....etc?
Replies: 10
Views: 3987

Enjoy this routine: Function getFileList(SearchDir,SearchPattern,SearchCriteria) Ans = ..................... Return(Ans) Thank you Amos. I am not familiar with BASIC , what I did is just use some lines form your routine and put it in new job under "Job Properties>Job Control". "Ans&q...
by alraaayeq
Sun Dec 26, 2004 2:05 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Filtering folder content according to file size,date....etc?
Replies: 10
Views: 3987

Filtering folder content according to file size,date....etc?

Hi all;


I am trying to find a simple way to filter a list of files from one directory,usualy filtering criteria is the file last modification date, file size ...etc

can any one please help me out!

PS: I do not prefer using c++/CLI and similar stuff.