Page 1 of 1

RTI Export for integration of MDM and IIS

Posted: Thu Jul 23, 2009 3:59 pm
by divstands
I am integrating IIS with MDM where i have build few ISD jobs for Mexican Data standardization. How can i get the RTI export for the integration

Posted: Sun Jul 26, 2009 11:54 am
by eostic
ISD has a project level export....

Posted: Sun Jul 26, 2009 8:10 pm
by divstands
eostic wrote:ISD has a project level export....
There was a sample project that came along with IIS enterprise addition names MDMQS. Also attached was an RTI export file which gives the output schema for all the ISD jobs in the MDMQS in QualityStage. The sample Schema was for US data.

I tested, MDMQS was working perfectly. What it was doing originally was : MDM calls the ISD job-
ISM_MDMQS_Address_Standardization ( for US addresses standardization) and send back the result through WISD input/output.

What i did was:

1. replaced the US Address Stan. Rules with Mexican Rules,
2. mapped the output schema to the Sample Schema(for US data).

However, things dont work. In the MDM log, the xml input has phone data and address data. The phone standardization works. But not address. The log indicates reaching the job ISD_MDMQS_Address_Standardization but it does not give the desired Address output in the output xml to MDM. What comes is the exact data as sent in the input xml.

What could be the miss?

Posted: Sun Jul 26, 2009 11:44 pm
by ray.wurlod
Is the Standardization stage still using USADDR/USAREA rule set but trying to apply to Mexican data?

Are the Mexican rule sets properly provisioned?

What, precisely, do you mean by "not working"?

Posted: Mon Jul 27, 2009 12:17 pm
by divstands
ray.wurlod wrote:Is the Standardization stage still using USADDR/USAREA rule set but trying to apply to Mexican data?

Are the Mexican rule sets properly provisioned?

What, precisely, do you mean by "not working" ...
I am using MXADDR and MXAREA.

Not working = MDM sends the input, but in the output no change is happening. Output at MDM= Input provided by MDM.

Same job
tested as standalone
with same input data as sent by MDM
is producing a desired standardized result.

Posted: Mon Jul 27, 2009 4:57 pm
by eostic
If I remember correctly, MDM server uses the EJB binding. Deploy also with SOAP over HTTP and test with a tool like SOAPscope. See if it fails in that unit test.

Ernie

Integration of MDM and IIS in real time

Posted: Tue Jul 28, 2009 9:07 am
by divstands
The input xml we tested contains data for two components: Address and Phone.
From the generated MDM log, i have extracted few lines separately for Address and Phone:

Address:

[7/27/09 16:34:30:582 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/Party/Standardizer/Address/className , Item Value is com.ibm.mdm.thirdparty.integration.iis8.adapter.InfoServerStandardizerAdapter
[7/27/09 16:34:30:582 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:582 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:582 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/PerformanceTracking/enabled , Item Value is false
[7/27/09 16:34:30:582 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:582 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration




Phone:

[7/27/09 16:34:30:582 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/ThirdPartyAdapters/IIS/StandardizePhoneNumber/Converter/className , Item Value is com.ibm.mdm.thirdparty.integration.iis8.converter.PhoneNumberInfoServerConverter
[7/27/09 16:34:30:629 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:629 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:629 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/ThirdPartyAdapters/IIS/StandardizePhoneNumber/Service/basicPackageName , Item Value is com.ibm.isd.MDMQS.MDMQSService
[7/27/09 16:34:30:629 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:629 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:629 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/ThirdPartyAdapters/IIS/StandardizePhoneNumber/AttributesMap/Input/dataType , Item Value is PhoneNumberInput
[7/27/09 16:34:30:629 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:629 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:629 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/ThirdPartyAdapters/IIS/StandardizePhoneNumber/operationName , Item Value is standardizePhoneNumber
[7/27/09 16:34:30:629 GMT] 00000015 SystemOut O DEBUG - Constructing input object for datatype:com.ibm.isd.MDMQS.MDMQSService.PhoneNumberInput
[7/27/09 16:34:30:645 GMT] 00000015 SystemOut O DEBUG - Constructed input object for datatype:com.ibm.isd.MDMQS.MDMQSService.PhoneNumberInput
[7/27/09 16:34:30:645 GMT] 00000015 SystemOut O DEBUG - Converting business object to ISD input object.
[7/27/09 16:34:30:645 GMT] 00000015 SystemOut O DEBUG - setting object: fieldName:referencenumber value:4165551215 className:class com.ibm.isd.MDMQS.MDMQSService.PhoneNumberInput
[7/27/09 16:34:30:645 GMT] 00000015 SystemOut O DEBUG - Converted business object to ISD input object.
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/ThirdPartyAdapters/IIS/initialContextFactory , Item Value is com.ibm.websphere.naming.WsnInitialContextFactory
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/ThirdPartyAdapters/IIS/providerURL , Item Value is iiop://Servername052:2809
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O DEBUG - Getting service EJB, PROVIDER_URL:iiop://Servername052:2809
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/ThirdPartyAdapters/IIS/StandardizePhoneNumber/Service/name , Item Value is MDMQSService
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/ThirdPartyAdapters/IIS/StandardizePhoneNumber/Service/jndi , Item Value is ejb/MDMQS/MDMQSService
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/ThirdPartyAdapters/IIS/StandardizePhoneNumber/Service/basicPackageName , Item Value is com.ibm.isd.MDMQS.MDMQSService
[7/27/09 16:34:30:660 GMT] 00000015 SystemOut O DEBUG - Looking up service EJB, PROVIDER_URL:iiop://Servername052:2809,serviceJNDI:ejb/MDMQS/MDMQSService
[7/27/09 16:34:30:941 GMT] 00000015 SystemOut O DEBUG - Done looking up service.
[7/27/09 16:34:31:050 GMT] 00000015 SystemOut O DEBUG - Time before run: 2009-07-27 16:34:31.05 functionKeyName:/IBM/ThirdPartyAdapters/IIS/StandardizePhoneNumber
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - Time after run: 2009-07-27 16:34:32.112
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - Converting ISD output object to business object.
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - getting object: fieldName:unhandleddata_mnphone value:null className:class com.ibm.isd.MDMQS.MDMQSService.PhoneNumberOutput
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - getting object: fieldName:exceptiondata_mnphone value:null className:class com.ibm.isd.MDMQS.MDMQSService.PhoneNumberOutput
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - getting object: fieldName:invaliddata_mnphone value:null className:class com.ibm.isd.MDMQS.MDMQSService.PhoneNumberOutput
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/Party/LocationNormalization/enabled , Item Value is TRUE
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - getting object: fieldName:countrycode_mnphone value:1 className:class com.ibm.isd.MDMQS.MDMQSService.PhoneNumberOutput
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - getting object: fieldName:areacode_mnphone value:416 className:class com.ibm.isd.MDMQS.MDMQSService.PhoneNumberOutput
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - getting object: fieldName:exchange_mnphone value:555 className:class com.ibm.isd.MDMQS.MDMQSService.PhoneNumberOutput
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - getting object: fieldName:number_mnphone value:1215 className:class com.ibm.isd.MDMQS.MDMQSService.PhoneNumberOutput
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - getting object: fieldName:extension_mnphone value:null className:class com.ibm.isd.MDMQS.MDMQSService.PhoneNumberOutput
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - Convertted ISD output object to business object.
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:112 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/Party/LocationNormalization/enabled , Item Value is TRUE
[7/27/09 16:34:32:455 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:455 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:455 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/KeyGeneration/instancePKIdentifier , Item Value is
[7/27/09 16:34:32:455 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:455 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:455 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/SynchronizeTransactionTime/enabled , Item Value is false
[7/27/09 16:34:32:455 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:455 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:455 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/DataBase/TimeStampPrecisionIndicator/enabled , Item Value is false
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/Party/LocationNormalization/enabled , Item Value is TRUE
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O INFO - addPhoneNumber_COMPONENT level preExecute is started.
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/PerformanceTracking/enabled , Item Value is false
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/PerformanceTracking/enabled , Item Value is false
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/InternalValidation/enabled , Item Value is true
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/PerformanceTracking/enabled , Item Value is false
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O INFO - getPhoneNumber_COMPONENT level preExecute is started.
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/PerformanceTracking/enabled , Item Value is false
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/PerformanceTracking/enabled , Item Value is false
[7/27/09 16:34:32:611 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:627 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:627 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/ExtensionFramework/enabled , Item Value is true
[7/27/09 16:34:32:627 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:627 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:627 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/PerformanceTracking/enabled , Item Value is false
[7/27/09 16:34:32:627 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:627 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:32:627 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/RedundantUpdate/enabled , Item Value is false
[7/27/09 16:34:33:110 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:33:110 GMT] 00000015 SystemOut O DEBUG - RETURN com.dwl.management.config.client.Configuration getConfiguration
[7/27/09 16:34:33:110 GMT] 00000015 SystemOut O INFO - getConfigItem: Item Name is /IBM/DWLCommonServices/PerformanceTracking/enabled , Item Value is false
[7/27/09 16:34:33:157 GMT] 00000015 SystemOut O DEBUG - ENTER com.dwl.management.config.client.Configuration getConfiguration


So, clearly for Address, the package of the ISD job is not at all visible. What can be the issue?

Additional Information:-
in the RTI export of the project(where input and output definitions for all Address, Phone, Part, Person, etx are given, we have provided the following information:

<rtiProject description="MDMQS" name="MDMQS">
<rtiService basePackage="com.ibm.isd.#app#.#svc#" contactEmail="" contactName="dsadmin" excluded="false" name="MDMQSService">

rtiProject description="MDMQS" name="MDMQS">
<rtiApplication contactEmail="" contactName="dsadmin" deployDate="Mon Oct 15 16:03:44 EDT 2007" deployId="1ba67.8dbe8c89.70eda95.1146a328e85.521f9a89.118d0" name="MDMQS">
<rtiService basePackage="com.ibm.isd.#app#.#svc#" contactEmail="" contactName="dsadmin" excluded="false" name="MDMQSService">



<referenceProvider activationDelay="1000" activationThreshold="3" agent="Servername:31531" alwaysRunning="true" description="MDMQS - Address Standardization (ISD)" excluded="false" maxActive="5" maxIdle="0" maxRuntime="0" minActive="1" minIdle="60" name="ISD_MDMQS_Address_Standardization" path="MDMQS\MDMQS\Jobs\ISD\ISD_MDMQS_Address_Standardization" requestLimit="5" stuckTimeout="0" usedAsDefault="false">
<property name="DS_DESCRIPTION" value="MDMQS - Address Standardization (ISD)"/>
<property name="DS_PASSWORD" value="QbUrRmabmA7RQlsgdJNdUzsfAartnbXBJZCfT00pqcBrSG09x+7BqLhgXMm4WRwChWFM1P9t9S/K&#xa;vqJmnLnIoYQrZeMzXtywv8Kgt07QwbSmyrin9tYS8z1YA4YICkyMnhc20qwGmKiwJpoDz9iF7aoK&#xa;/HOGEMDSzCxwE4W2OVU=&#xa;"/>
<property name="DS_JOBNAME" value="ISD_MDMQS_Address_Standardization"/>
<property name="DS_HOST" value="Servername"/>
<property name="DS_PORT" value="31538"/>
<property name="DS_PROJECT_NAME" value="MDMQS"/>
<property name="CONNECTION_NAME" value="DSServer at Servername052:31538"/>
<property name="DS_USERID" value="dsadmin"/>
</referenceProvider>

Posted: Tue Jul 28, 2009 10:12 pm
by eostic
It's not clear at this point what the issue is. I'd first figure out why this service isn't working, fix it and then determine why perhaps the export/import has a problem.

Re-deploy it (the QS job) from scratch...do you still have the problem? Deploy it instead with the SOAP binding....debugging it from MDM is way too difficult.

Is this a config issue or a migration issue?

Ernie