Java Client
Moderators: chulett, rschirm, roy
Java Client
In our current project we are extracting data from MYSQL database by using Unix Scripts then scheduled by CRONTAB. The out file is then transferred through PM4 Data Transfer to ETL server then it is loaded into TeraData Database.
Unix Script:
#!/bin/sh
#------------------------------------------------------------------------------#
#
Script name
# Author
# Created on : 06/04/2007
#
Modified by :
# Description :
#
Parameters: : None
#------------------------------------------------------------------------------#
USER=`grep -i "USER" .sh_param | awk 'BEGIN{FS=":";} {print $2}'`
HOST=`grep -i
"HOST" .sh_param | awk 'BEGIN{FS=":";} {print $2}'`
PASSWORD=`grep -i
"PASSWORD" .sh_param | awk 'BEGIN{FS=":";} {print $2}'`
DATABASE=`grep -i "DATABASE" .sh_param | awk 'BEGIN{FS=":";}
{print $2}'`
OUTPUT_DIR=`grep -i "OUTPUT_DIR" .sh_param | awk 'BEGIN{FS=":";}
{print $2}'`
TSStart=`date +"%Y%m%d%H%M%S"`
OUTPUT_FILE_NAME=$OUTPUT_DIR/ES3_ORDER_HEADER.txt
echo
"Select PK_ID
, LAST_UPDATE_DT
, WAREHOUSE_NBR
, OWNER_NBR
, SHIP_TO_CUSTOMER_NBR
, ZIP_5
,
ES3_REFERENCE_NBR
, ORDER_TYPE
, MFG_ORDER_NBR
, CUSTOMER_PO_NBR
, SHIP_MODE
, RDD_DATE
,
ORDER_RCVD_DT
, ALLOCATION_DT
, WHSE_LOAD_CLOSED_DT
, LOAD_TYPE
, ORDER_STATUS
From order_header
where
cast(last_update_dt as date) >= cast(curdate()-3 as date)" | mysql --user=$USER --password=$PASSWORD --database=$DATABASE | tr '\t' '|' >
$OUTPUT_FILE_NAME
--------------------
Mysql -> Crontab -> PM4 -> ETL -> TERADATA (this was designed in 2007)
Now we are planning to extract the data from MYSQL DB directly by using Datastage and load it into the target database TeraData.
MYSQL -> ETL -> TERADATA
Can I use JavaClient stage to connect MYSQL database and load it to Teradata? (JC-Transformer-TeradataMultiLoad)
Please suggest me the best solution
Note: Datastage version - 8.1
Unix Script:
#!/bin/sh
#------------------------------------------------------------------------------#
#
Script name
# Author
# Created on : 06/04/2007
#
Modified by :
# Description :
#
Parameters: : None
#------------------------------------------------------------------------------#
USER=`grep -i "USER" .sh_param | awk 'BEGIN{FS=":";} {print $2}'`
HOST=`grep -i
"HOST" .sh_param | awk 'BEGIN{FS=":";} {print $2}'`
PASSWORD=`grep -i
"PASSWORD" .sh_param | awk 'BEGIN{FS=":";} {print $2}'`
DATABASE=`grep -i "DATABASE" .sh_param | awk 'BEGIN{FS=":";}
{print $2}'`
OUTPUT_DIR=`grep -i "OUTPUT_DIR" .sh_param | awk 'BEGIN{FS=":";}
{print $2}'`
TSStart=`date +"%Y%m%d%H%M%S"`
OUTPUT_FILE_NAME=$OUTPUT_DIR/ES3_ORDER_HEADER.txt
echo
"Select PK_ID
, LAST_UPDATE_DT
, WAREHOUSE_NBR
, OWNER_NBR
, SHIP_TO_CUSTOMER_NBR
, ZIP_5
,
ES3_REFERENCE_NBR
, ORDER_TYPE
, MFG_ORDER_NBR
, CUSTOMER_PO_NBR
, SHIP_MODE
, RDD_DATE
,
ORDER_RCVD_DT
, ALLOCATION_DT
, WHSE_LOAD_CLOSED_DT
, LOAD_TYPE
, ORDER_STATUS
From order_header
where
cast(last_update_dt as date) >= cast(curdate()-3 as date)" | mysql --user=$USER --password=$PASSWORD --database=$DATABASE | tr '\t' '|' >
$OUTPUT_FILE_NAME
--------------------
Mysql -> Crontab -> PM4 -> ETL -> TERADATA (this was designed in 2007)
Now we are planning to extract the data from MYSQL DB directly by using Datastage and load it into the target database TeraData.
MYSQL -> ETL -> TERADATA
Can I use JavaClient stage to connect MYSQL database and load it to Teradata? (JC-Transformer-TeradataMultiLoad)
Please suggest me the best solution
Note: Datastage version - 8.1
Thanks
-
- Participant
- Posts: 11
- Joined: Thu Feb 10, 2011 1:09 am
- Location: Kuala Lumpur
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Ray,
Thanks for responding to my request, I never worked MYSQL as source before could you suggest me which stage would be better to serve my purpose (Javaclient or ODBC) as i explained above.
If I want to use JavaClient could you explain the advantages/disadvantages and same with ODBC.
Once again thanks for all of you.
Thanks for responding to my request, I never worked MYSQL as source before could you suggest me which stage would be better to serve my purpose (Javaclient or ODBC) as i explained above.
If I want to use JavaClient could you explain the advantages/disadvantages and same with ODBC.
Once again thanks for all of you.
Thanks
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Participant
- Posts: 11
- Joined: Thu Feb 10, 2011 1:09 am
- Location: Kuala Lumpur
Me too never used JavaClient stage
As far as i know, Java stages are used only when you want to make use of some java programs/functions in Datastage.
If you just want to pull data from MYSQL and load into TERADATA, ODBC should be better.
Check with them why they are using JavaClient.in our organisation they are using mostly JavaClient to connect MYSQL Database
As far as i know, Java stages are used only when you want to make use of some java programs/functions in Datastage.
If you just want to pull data from MYSQL and load into TERADATA, ODBC should be better.
- Kalyan