I have Datastage that picks up all the files and processes them. Then it sends the file via email. Then the unix script goes and makes the file and moves them to the backup drive.
Orders are sent to us every 15 minutes. So I think I'll be good.
Search found 17 matches
- Wed Jun 01, 2011 9:27 am
- Forum: General
- Topic: Is there a way to Capture what Sequential files were Process
- Replies: 11
- Views: 5227
- Wed Jun 01, 2011 8:02 am
- Forum: General
- Topic: Is there a way to Capture what Sequential files were Process
- Replies: 11
- Views: 5227
I got it i think
Here's the code that I did. it reads the contents of the folder and then writes that to LOGMMDDYYYYHHMM. Then it takes all the files in the folder with *.DAT and MOVES them to the BACKUP folder. -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= clear echo "OPTICOM BACKUP START" ...
- Tue May 31, 2011 3:05 pm
- Forum: General
- Topic: Is there a way to Capture what Sequential files were Process
- Replies: 11
- Views: 5227
- Tue May 31, 2011 1:43 pm
- Forum: General
- Topic: Is there a way to Capture what Sequential files were Process
- Replies: 11
- Views: 5227
Does this look right?
Here's what I put together but it's not writing anything to the file.
ls -a /data/DataStage/OPTICOM/SOURCE_FILES test.txt
and it's not writting to the file. Does that look wrong for a script?
-Joe
ls -a /data/DataStage/OPTICOM/SOURCE_FILES test.txt
and it's not writting to the file. Does that look wrong for a script?
-Joe
- Tue May 31, 2011 11:17 am
- Forum: General
- Topic: Is there a way to Capture what Sequential files were Process
- Replies: 11
- Views: 5227
- Tue May 31, 2011 10:23 am
- Forum: General
- Topic: Is there a way to Capture what Sequential files were Process
- Replies: 11
- Views: 5227
Is there a way to Capture what Sequential files were Process
I have a csv files that need to be processed 3 times a day at 9:30, 1:30 and 2:30 They are *.DAT files. The Souce / Read Method = File Pattern The job is processing on 1 Node to not mix up the rows. Example Files Filename Date/Time File1.DAT 05/31/11 08:02 AM File2.DAT 05/31/11 08:12 AM File3.DAT 05...
- Thu Mar 20, 2008 2:28 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Sequence Job not compiling Warning $JobStatus not defined
- Replies: 4
- Views: 5495
- Thu Mar 20, 2008 1:27 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Sequence Job not compiling Warning $JobStatus not defined
- Replies: 4
- Views: 5495
- Thu Mar 20, 2008 1:04 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Sequence Job not compiling Warning $JobStatus not defined
- Replies: 4
- Views: 5495
Sequence Job not compiling Warning $JobStatus not defined
I have a Sequence job that I am getting the following error when I try to compile. Warning: Variable 'DemandPlanningFCST.$JobStatus' not defined I have one Error trigger that uses expression type Failed - (Conditaional), one update status trigger and one load data trigger that both have an Expressio...
- Sat Mar 01, 2008 5:52 am
- Forum: General
- Topic: Lookup help or Join
- Replies: 14
- Views: 5724
Example
I'm sorry i'm still new to Datastage. Can you send me some screenshots of what it would look like?ray.wurlod wrote:Then uncheck the Range check box, look up the max value, and perform the comparison in an expression in a Transformer stage or Filter stage.
That would be a giant help.
- Fri Feb 29, 2008 12:30 pm
- Forum: General
- Topic: Lookup help or Join
- Replies: 14
- Views: 5724
...
In a Lookup stage, in version 8, if you check the Range check box you must also double click and enter a range expression. This means that you are doing a range ("between") lookup. If you want just an ordinary lookup, uncheck the Range check box. What I need is to do a Less Than or Equal ...
- Fri Feb 29, 2008 12:28 pm
- Forum: General
- Topic: Variance should I use a Compare Stage
- Replies: 2
- Views: 2027
Update
For every record you need to find the difference between the fields Historic and All Channel and populate a third field with this value. Is this understanding correct? If so then you can do it in a transformer stage. Create a field say VAR and in the derivation say All Channel - Historic. Not exact...
- Mon Feb 25, 2008 12:34 pm
- Forum: General
- Topic: Variance should I use a Compare Stage
- Replies: 2
- Views: 2027
Variance should I use a Compare Stage
I have one stream of data that has Historic and All Channel information. Lets say that Historic = 5000 for a QTY total. And All Channel = 5500 for a QTY total. I need to find a way to find the difference that is equaling that 500 QTY and be able to put in a DB2 table the 500 QTY and it's details as ...
- Wed Feb 20, 2008 10:02 am
- Forum: General
- Topic: Lookup help or Join
- Replies: 14
- Views: 5724
Screenshots
What's "not working" about it? People here would need details or your issue in order to provide any level of help. Here's some screenshots taht I have I just get a red line in the top section. How do I post screenshots into the msg board? 1st screenshot http://picasaweb.google.com/joefons...
- Wed Feb 20, 2008 8:30 am
- Forum: General
- Topic: Lookup help or Join
- Replies: 14
- Views: 5724
Re: Premium Content
Welcome aboard. Load the max date into a Lookup File Set with Entire partitioning. This has a constant (say "X") as its key, and the max date as a non-key field. Use a Lookup stage to lookup the re ... I just signed up for Premium Content how do i view the response? once you get your prem...