DSXchange

mhester

Craig is correct - kind of :) There is space there as you can clearly see from the df command, but when your job runs the sort operation consumes what available disk space is present. When the job aborts the temp sort files are removed which makes you believe that you have space. Also, I am not sure...

mhester

With these settings it is always preferred to set the non recoverable to True. If your job were to abort it will likely leave the table in a load/backup pending state which will require DBA intervention. If the table is in this state I know that inserts will return an error within DS, but I am not s...

mhester

In the schema file defined for the sequential file (input/output) define the decimal column like -

Code: Select all

USD_TA: not_nullable decimal[26,3] {null_field='00000000000000000000000000'};

mhester

Atually, conductor, section leaders and players should not be thought of as an "advanced" topic, but one that every developer should be aware of nor is it premium content since it can be found in the Parallel Job Developers Guide in Chapter 1. If you do not know where these documents are t...

mhester

You can get the score by either enabling APT_DUMP_SCORE = True at the project level or include it in your job and set it to True. You will see this and it will look something like this in the director log - main_program: This step has 10 datasets: Can you please include a copy of your configuration ...

mhester

I have 29 Million rows in PROD for refernce dataset Not a remarkable volume of data. Complicating this is the fact that its a single node system on windows 32 Bit, so im forced to use execution mode = sequential .. Apparantly there were install related issues for multi node config.. Forgive me but ...

mhester

Based on your job score (if it gets that far) how many processes on how many nodes are there? This error kind of makes me think that the section leaders are waiting for a response from the players (node specific processes) and this is where the issue is. Almost seems like there are not enough resour...

mhester

Here you go - something to get you started with your own -

Code: Select all

char *pfGetTimestamp()
{

    char* returnBuffer;

    TimeStampStringValue = APT_TimeStamp::now(true).asString();

    returnBuffer = TimeStampStringValue.content();

    return  returnBuffer;

}

mhester

Ok - not sure why I get the double posts! I submitted only once!

Craig, do your magic and remove one please

mhester

The restructure stages are simpler than the Transformer

Well said and I agree - nice to see folks actually using these stages

mhester

The restructure stages are simpler than the Transformer

Well said and I agree - nice to see folks actually using these stages

mhester

Try CurrentTimestampMS() and set the extended properties of the column to include micro seconds and set length to 26 and scale to 6. CurrentTimestamp() will give just seconds as you presented if the extended properties are not set. If they are you would get 000000 as the micro seconds. Using Current...

mhester

Thanks for asking. I should also add that I can use a Transformer stage and substring derivations without any problem. I do have a medium performance concern, or I wouldn't be trying to avoid using the Transformer. Actually glossed over this part, but I cannot think of too many reasons to avoid a t...

mhester

Thanks and by the looks of your input dataset schema you are not dealing with a subrec, but a normal dataset. In order to use the promote subrec operator you must have built a subrec. The subrec is actually nothing that you can manipulate in the traditional way within your flow except to use other r...

mhester

Would you be able to post the schema of the dataset used as input?

Search found 520 matches