DSXchange

news78

Q1. Is this error possible, if the db operation takes a long time? Yes, that could be one reason. Your DBA could supply more, I'd wager. Q2. Any idea what this message means? Where are the bounds set? Not sure, but since it doesn't have an 'ORA' component, guessing it comes from the DRS stage. Are ...

news78

We are using DRSStage in a Server job. The DRS Stage connects to Oracle and inserts data into a table. The volume of records to be inserted varies between 3-4 million rows. Previously, we tried with ArraySize=1, TransactionSize=0, after some time the job aborts with error ORA-03113: end-of-file on c...

news78

Yes, I would think you should be able to use the Incomplete Column option set to a none 'warning or error' option (like Replace) and then constrain your Transformer to only pass a row on where a 'key' field (say the first) is not null. Pretty sure I've done that in the past. :? Dont' worry about th...

news78

I would still cat them. You could pass them thru something like 'sed' at the same time to strip the unwanted lines at the same time or simply skip processing them inside the job. ... Assuming I use cat. How do I skip processing them inside the job? The job errors out at the Sequential Stage itself,...

news78

Scenario: Multiple files of same format (same columns, csv) need to be processed. Each file also 3 extra lines at the start(description line, blank line, header line). What the best way to process these? Such that if one file fails, the others still should continue to be processed: Option 1. cat *.c...

news78

Is it true that MQ plug-in in DS 7.x can only access local MQ queue manager? Which means DS and MQ have to be located on the same box?

news78

ray.wurlod wrote:
Code: Select all
test -z #pathname# && rm #pathname#
handed to ExecSH as an after-job subroutine. ...

This worked for me:

Code: Select all

test ! -s #pathname# && /bin/rm -f #pathname#

news78

news78 wrote:
chulett wrote:Doesn't work that way - it will always create the file. ...
OK. So I guess I have to write some kind of after job routine whihc will delete the file if no row exists.

BTW, what does "Turtles all the way down" mean in your signature?

Nev mind, I checked the wikipidea.

news78

chulett wrote:Doesn't work that way - it will always create the file. ...

OK. So I guess I have to write some kind of after job routine whihc will delete the file if no row exists.

BTW, what does "Turtles all the way down" mean in your signature?

news78

My job design is as follows: [DRDBMS Stage] > [Transformer] > [Sequential file] Currently it creates a file of 0 size even if there are no records returned from the query. But I want the sequential file to be created only when there are records returned from database or else no file should be create...

news78

Just the way you showed. in.col[1,5]:char(013):char(010):in.col[6,5]:char(013):char(010) and so on... OK. Two points: A. I tried in.col[1,5]:char(013):char(010):in.col[6,5] this does not work in parallel job it prints just first record. In server job, it works fine but prints a ^M character at end ...

news78

Substrings are pretty fast. It should not have any performance impact. Run a test on 25% of your expected input. OK this may be a silly question, but is there any function to substring(I tried link.record[1,5]) after "every" 5 chars as you suggested or do I need to write a custom routine ...

news78

Well then in the transformer, you can substring and add Char(013):Char(010) after every fifth position. This way you are adding a unix new line character which will split them. Thing that am concerned about is the volume. As I said this one line will be large. Approx 603000000 characters. Which aft...

news78

DSguru2B wrote:Is it a single column input and single column output?

Yes it is Single column output. Input as I said is one line, which I assume can be considered as single col in input.

news78

We get a data flat file which has just one line. We need to fold/split this record at a fixed width and load the records into a oracle table. E.g. 1A000AER000UTQQ should get converted to(assuming width of 5) 1A000 AER00 0UTQQ Then these 3 records will be loaded into a table. Whats the best way to go...

DSXchange

Search found 44 matches

Re: DRSStage ORA-03113 or Transaction size out of bounds err

DRSStage ORA-03113 or Transaction size out of bounds errors

Multiple files of same format (same columns, csv)

MQ plug-in to access remote queue manager

Sequential stage should create file only when records exist

folding a single record into multiple records at fixed width