DSXchange

Are there any stages or scenarios were it is not advisable to use auto partitioning.

An example of this is when sorting on a primary and secondary key but needing to partition on the primary key only - auto partition will partition using the primary and secondary keys in this scenario.

Thanks for the quick reply Ray.

In summary i think what this means is that using auto to decide the partitioning keys and method for a sort stage is OK except for the situation were the next stage after the sort is one such as a drop duplicates that needs to drop records based on column1.

Thanks for the quick reply Ray.

In summary i think what this means is that using auto to decide the partitioning keys and method for a sort stage is OK except for the situation were the next stage after the sort is one such as a drop duplicates that needs to drop records based on column1.

When using the auto partition method in a sort stage, if i set the partition key to be column 1 but sort on columns 1 and column 2, the incoming data to the sort stage is partitioned on columns 1 and 2 rather than column 1 only. My understanding was that auto would partition data based on the partit...

Thanks for the quick reply Ray.

When defining guidelines for enterprise developers is it best to recommend using auto partitioning method or for developers to explicitly select the partioning method required for the processing being performed.


Ascential recommend auto partitioning but are there issues with this recommendation.

I have a load file that contains a column defined as varchar(2000) and the target oracle column definition is also varchar(2000). I have checked what the column contains using a peek stage and it contains a value of 'UK' with no trailing spaces. Scenario 1: If apt_pad_string is set to x'00' (null) t...

Thanks ray the second option worked fine.

Hi Ray, I am trying to implement what you have suggested but was wondering how to reference a column on the input link in the user defined SQL as 0ne of the predicates. i.e. SELECT RATE_STERLING from CURRENCY_RATES_DIM where FINANCIAL_DATE >= CURRENCY_RATES_DIM.START_DATE and FINANCIAL_DATE <= CURRE...

I have a scenario were i need to lookup a date value on the input stream against a reference oracle table. Each reference table row contains a start and end date value and i need to lookup the row where the input date value falls between the start and end date values on the reference table row. what...

Thanks for that Craig. Ernie Ostic's document was very informative. I tried the 'ls' command and it passed just the name of the file without the full path name so i used 'echo' instead i.e. echo opt/dstransfer/dev/credit_sanctioning/xml_input/* ,which provided the full path name for the file as inpu...

Firstly, i'm not familiar with the external source stage.

It references 'source program' and 'source method' but not sure how the full XML path is defined using these options?

Secondly, where in the XML input stage is the file path value specified?

I am converting XML data using a sequential file stage that is input to the XML input stage but i am getting record format error :- "Sequential_File_10,0: Missing record delimiter "\n", saw EOF instead". When i use a folder stage in server to describe the same data the job runs s...

OK, Thanks for that. I had searched but found no resolution, which, I guess, is because there isn't one. I will use a different quote format.

Many Thanks.

Hi, I am writing an Enterprise job, writing data to a sequential file, whose quote format is set to 'double'. One of my input fields in a varchar and contains a double quote, this is causing me problems when I subsequently try to load the data. I could change the quote format to be something other t...