DSXchange

Thanks Mike and Craig. I'd patterned my job after: http://etl-tools.info/en/datastage-tutorial-L008_scd-implementation-datastage.htm, and http://etl-tools.info/images/scd2-job-design.jpg which has two database stages, one to close out the old record and one to insert the new one. Perhaps it's my ext...

chulett wrote:From memory - make a copy of the routine mentioned and then change the Open statement to OpenPath. No need for the VOC entry then, simply pass in the full path to the hashed file rather than just the name.

Thanks Craig, this worked great.

Hi, I've got a job that's doing SCD2 processing. It's also reading a hash containing the EffectiveDate, SK, and CRC value 3 times in the job, plus writing to it once. Here is a picture of the job: http://docs.google.com/View?docid=dcdxxjr8_16dv4w7rgv&pageview=1&hgd=1&hl=en Hopefully the ...

Sorry if this has been discussed before. I did search on "hashed file basic" and "hashed file routine" before posting. Is it possible to do a lookup against a hashed file in a routine? What I want to do is: SK = LookupDateSK(pInputDate,HashedFilePath) where pInputDate is derived ...

I would prefer small routines, one for each test, maybe in a category called Test. More modular. As always Ray, thanks for the reply. You too Craig. At this point, I'm just testing code snippets, often things like iconv/oconv patterns, and how it handles bad data. For now, the "branch" ap...

Why is it urgent? Why didn't you ask a week earlier? Why is it urgent on a Friday night? We don't do "urgent". DSXchange is an all-volunteer site whose participants post as and when they can, usually only if they have something useful to contribute. If you want urgent assistance sign up w...

1. How do you go about quickly developing and debugging your BASIC code before putting it in a job? What I'm currently doing is I've got a "dummy" routine with two arguments, Arg1 and Branch. If I need more arguments, I just compile them in the code rather than redefining the dummy routine...

I could swear I had a situation where I had a Rejected row link, another link (updating a hashed file) where the constraint was Not(REJECTED), and this was the last link, but was still getting output rows when the row was rejected by the database (violate null constraints). My job output links cons...

Welcome aboard. Probably easiest is to use sed as a filter command to change the two-character delimiter to a single character globally. I can recommend Perl, which is 1) free, and 2) (mostly) portable across Windows and Unix. Windows Perl can be downloaded here: http://www.activestate.com/activepe...

The logic given by you was implimented by me before i knew it from you.After all, my question is..There is a function "GetFiscalYear()" under DSRoutine in transformer stage.How can this help us as in this regard. So the logic is If Month <= 3 Then Year - 1 Else Year Extract month and year...

* Compile options $DEFINE DEBUG * Declare function DEFFUN FiscalYear(pDate) Calling "DSU.FiscalYear" * Declare constants Equate cRoutineName To "FiscalYear" * very cursory error check! If Len(pDate) NE 8 Then call DSTransformError(pDate:" not in YYYYMMDD format.",cRout...

Hi, Say we've got Routines categorized like: Routines AppName Utility Etc. Say we also want a category for routines under Development, say by each developer: Routines DEV Scott BillyBob Questions: 1) Is there a way I can copy a routine from one category to another? (Not apparent from the UI) 2) Sinc...

ps. There's no need to "set" them, that's handled in the generated code Thanks. Yes that's what I meant but didn't word well. I meant "If there is a way to ensure the REJECTED variables are set by DataStage without having a Reject link..." I could swear I had a situation where I...

Seems like this is why you've asked about the RowMerger stage. One thought... perhaps array notation would be more managable and would get you the Value Marks automatically. Use ArrayName<-1> to push an element onto the end of the array in a loop. And if you end up needing a different delimiter, th...

I haven't used the RowMerger as much as the RowSplitter, but it might be worth looking at the history....these stages were not designed to perform any meaningful manipulation of the row (emphasis added) --- but to dynamically re-assign metadata (in memory) to an existing row that is coming down-str...