ETL: More than Middleware?
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 407
- Joined: Mon Jun 27, 2005 8:54 am
- Location: Walker, Michigan
- Contact:
ETL: More than Middleware?
ETL: More than Middleware?
Last edited by Ultramundane on Fri Jun 18, 2010 4:28 pm, edited 1 time in total.
-
- Participant
- Posts: 407
- Joined: Mon Jun 27, 2005 8:54 am
- Location: Walker, Michigan
- Contact:
Re: ETL is just another piece of Middleware?
Last edited by Ultramundane on Fri Jun 18, 2010 4:29 pm, edited 1 time in total.
-
- Participant
- Posts: 407
- Joined: Mon Jun 27, 2005 8:54 am
- Location: Walker, Michigan
- Contact:
Re: ETL is just another piece of Middleware?
How important is a core competency?
I think you have answered by question below.
Thanks and you folks are awesome.
I think you have answered by question below.
Thanks and you folks are awesome.
Last edited by Ultramundane on Fri Jun 18, 2010 4:25 pm, edited 1 time in total.
-
- Participant
- Posts: 407
- Joined: Mon Jun 27, 2005 8:54 am
- Location: Walker, Michigan
- Contact:
Ok. I'll bite.
It is vastly more than just "another piece of middleware." It's often the core of the entire data integration infrastructure for thousands of companies. And as that "core," represents the lion's share of intellectual capital about "the" data and metrics that drive the enterprise. Often the folks who build decision support systems (still a majority of the apps that use ETL) know more about the data, it's meaning, its relationships, and its ideosyncracies than anyone else in the organization. Their understanding is reflected in ETL (whatever tool, or 3gl code they might be using) and in every other part of the lifecycle that surrounds it......profiling, data quality, modeling, cubing services, reporting, portals, legacy data stores, and more..........lots more.....
It can't be ignored by anyone, let alone be a delivery vehicle who results are the responsibility of end users.
Sure there are configurations where ETL is just a "movement process," but even there, treating it as just "plumbing" is a continuation of the habits that got us here in the first place (with hundreds of definitions of customer, no awareness of metadata, yada, yada.).
Ernie
It is vastly more than just "another piece of middleware." It's often the core of the entire data integration infrastructure for thousands of companies. And as that "core," represents the lion's share of intellectual capital about "the" data and metrics that drive the enterprise. Often the folks who build decision support systems (still a majority of the apps that use ETL) know more about the data, it's meaning, its relationships, and its ideosyncracies than anyone else in the organization. Their understanding is reflected in ETL (whatever tool, or 3gl code they might be using) and in every other part of the lifecycle that surrounds it......profiling, data quality, modeling, cubing services, reporting, portals, legacy data stores, and more..........lots more.....
It can't be ignored by anyone, let alone be a delivery vehicle who results are the responsibility of end users.
Sure there are configurations where ETL is just a "movement process," but even there, treating it as just "plumbing" is a continuation of the habits that got us here in the first place (with hundreds of definitions of customer, no awareness of metadata, yada, yada.).
Ernie
Ernie Ostic
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>