DSXchange

Hi ,

I need templates/inputs as to how to create a data profiling sheet (process).

Being in ETL all these days I dont have much idea as to how to document a profiling process.

I would appreciate any help on this.

Thanks in advance,

Regards,
Santosh.

Hi All,

I wanted to know what is the best way to create actual data model in a database.

I have a Erwin model (datamart) , should I just use forward engineer option and run the script (unchanged) in the backend database

Thanks.

By the way Thanks for teaching me a new word FINAGLE.

ray.wurlod wrote:Or two lookups, against the same Lookup File Set. You will need to finagle the key column names, but that's no big deal - you can do it with Copy stage.

Ray, I ve got your point. I lookup the dimension twice with two different dates (coming from source) and fact can have 2 dw (calendar ) keys for both dates in the same record. I was just wondering the idea of using Calendar DW key as DATE datatype. Would that help? Thanks, Santosh. Or two lookups, a...

Hi Ray, I have two DATE fields going into same FACT table. Instead of having the date as it is the in the FACT I want to populate the CALENDAR key. This way I can have all the information ( which a CALENDAR dimension provides) for both the dates. It should be physical join in the database to access ...

Hi Again,

I have a mindset where I am tempted to join two facts.

A fact to fact join.

Am I commiting suicide !!

Thanks.

Hi All, Can we create a DATABASE VIEW of a dimension table , In my case CALENDAR dimension and then use this view as lookup in fact load. I have multiple date fields going into fact , at the same time I need to associate these dates with Calendar dimension obviously to get related information. Is it...

Hi All, I have a situation wherein I need to look into probability of Joining 2 dimension in a data mart which we are designing. I am exploring the possibility of joining two dimension using joiner table (this I am doing coz I need to show many- to- many relationship between these dimensions). i.e. ...

How can i make the job to run on the conductor node i.e any environment variable value to be added or any variable to be added to job

Hi,

I am reading an EBCIDIC file and loading to a dataset.I tested the job on SMP system it is takeing one minute but when i do the same on DS 7.5.1A GRID box job takes 10 minutes.

how can i improve the performance.It is fixed width file.

Any help is appreciated.

how can i achieve in a transformer

Not much of diff.

I am just thinking of having 8 output links form tranformer to pivot with each having pivot columns.

I think this should give me some improvement.

If anyone has any other thought just let me know..

Is there any other way i can replicate the pivot stage functionality and improve performance.

Hi, I am running a job in DS7.5.1A and it is taking for 0.6 million records 3 hours. Design: oracle source--->Xfm------>Pivot----------->DataSet. From oracle stage to Xfm it is taking only 3 minutes. Pivot stage is the overhead. How can i improve the performance. I am pivoting 16 columns to rows. Th...

Why dont you use the same configuration file that created the dataset , for the second job? The issue might not exactly be becuase you are using a different config file. It might be because - for the second job you are tyring to use a config file that does not include the nodes that were used to cr...