Page 1 of 1

Mapping invalid fields?

Posted: Mon Aug 27, 2007 9:25 am
by ssi6
We'd like to be able to provide detailed information to our phone support reps on WHY an individual record failed (which field). We would like to do this without using the audit log (ugly) but haven't have much luck. Has anyone done this?

My first thought was to run the invalid records through a second map that would identify the field in error, but WSTX won't map invalid data.

Posted: Wed Sep 19, 2007 9:27 am
by janhess
Who's Jim and how do I get his handout?

...

Posted: Wed Sep 19, 2007 1:12 pm
by rep
Easy! Just send an email off to:

RequestTonsOfSpam@GodDamnThatsATonOfSpam.spam

You should get a response real quick.


;)

Posted: Thu Sep 20, 2007 2:04 am
by janhess
Rep said
I used the setting from the map in Jim's hand out, which is "Always".
Is that how you got yours?

...

Posted: Thu Sep 20, 2007 1:32 pm
by rep
Um...no.

Jim handed it out, hence, "Jim's hand out."


I don't have the softcopy, so if you really, really, really want one, I'll scan it and upload it.

But you're kidding, right?

Posted: Fri Sep 21, 2007 3:32 am
by janhess
But who is Jim? Did he hand it out on a street corner? Is he the Guru? Can I meet him?

...

Posted: Fri Sep 21, 2007 12:07 pm
by rep
Street corner? No.

That's Willy. And what he was handing out...for a price...would be very diffictult to scan and upload, plus, I'm not sharing any of that. :P



Jim...Jim is the two year datastage guy that is in my group (development). I'm the guru! And while he is a swell guy, I would recommend meeting the three Russian ladies in the Tech info group. Wow...just, wow. I mean, hey, if you want to meet Jim over the three Russian ladies, there's nothing wrong with that. I'm all for it. Eitherway, the next time you're in New Jersery, we'll all go out and grab a bite. And I'll tell Jim to bring his hand out. I'll tell him to bring all his hand out's.

:)

Posted: Tue Sep 25, 2007 11:57 am
by jvmerc
I had to do something like this for a small file ( <10mb ) and a larger file ( >80mb )

For the small one I had a validation map with trace on and another map that read the tace file and summarized issues. This worked fine for most invalid datasets. Problem was wasn't very efficient on large trace files....

The second solution consists of a series of maps.
First map (control map) reads in the data as loops of text. A submap (runmap1) is executed with each loop. The control map records all of the run information about the loop, ID + runmap1 return code + whatever.

The next map (runmap2) that is executed only processes the bad loops (identified by runmap1) at a record/segment level. The control map tracks info from runmap1 failure plus failure information related to the current map, runmap2. ID + runmap1 return code + runmap2 return code + record/segment number + copy of data passed to runmap2.

The last card in the control map reads the data in the card that executed runmap2 looking for issues which it summarises and send to BA.

Not elegant but it works. You might try something like that.