Hi,
I am able to read the data from HDFS files.
the folder structure as below.
/data/projectname/zonename/dbname/tablename/partfilexxxxx*
Question:
How do I read the read if the data is stored in partition on business_effective_date like below
/data/projectname/zonename/dbname/tablename/effective_date=20170915/partfilexxxxx*
/data/projectname/zonename/dbname/tablename/effective_date=20170916/partfilexxxxx*
Should I read them separately or is there a way to read from all the effective_date sub folders at once using file connector stage?
Reading Partitioned data from File Connector stage
Moderators: chulett, rschirm, roy
-
- Premium Member
- Posts: 258
- Joined: Tue Jul 04, 2006 10:35 pm
- Location: Toronto
Reading Partitioned data from File Connector stage
Cheers,
Samyam
Samyam
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact: