DSXchange

We have some large files (~ few GB) that we need to get from outside vendors and one major problem is quality of the data files. We also have a fixed time window in which the profiling must complete and report back issues to the vendors. We are likely to do column profiling as well as primary key in...

Pls check with you DBA on SQLServer 's(Source Database) isolation level. It is quite possible that the SQL Server has been configured with a very high isolation level and that's causing the deadlock.

1 - Read Committed
2 - Repeatable read
3 - Serializable

Try with "Read Commited"

Ray, Thanks for the response. I do have some follow up questions. Will appreciate getting further clarity on these. We have some large files (~ few GB) that we need to get from outside vendors and one major problem is quality of the data files. We also have a fixed time window in which the profiling...

Can someone shed any light as to what IA is doing under the cover? And why does it need the IADB and ANALYZERPROJECT tables?

Thanks in advance.

Can someone shed any light as to what IA is doing under the cover? And why does it need the IADB and ANALYZERPROJECT tables?

Thanks in advance.

Thanks. Let me explore more.

Thanks for your reply Vincent. It clarified most of my questions. Based on the FastTrack documentation, I see how a user can create a mapping specification from which DataStage jobs could be created. However I don't see any mechanism how a user using FastTrack would be able tie up the business terms...

Folks, One of my clients is looking to undertake a new integration project and their needs are described below - The Data specialists who understand the business needs would like to define the business terms such as customers, profit margin, DSO etc. - The data specialist then need to map the busine...

Does anyone know when will parallel extender will be available as 64 bit on AIX 5.1?

Additionally, has anyone tried successfully invoking the a DB2 stored procedure in a parallel job? If so, could you pls post what are the steps needed.

Thanks in Advance.

The suppliers are sending data. When the data arrives, the system must take certain action within a pre defined period. The time period may changes depending on the supplier. The number of message can vary from day to day. I understand RTI would cost me additional. If I stage, the data, what would b...

Vincent, Thanks for the reply. I have the following situation. Suppose, for example one XML file has store name and store id. The other XML file has store id, product id and product name. The target XML file to include all the products in a given store before moving to the next store. In that scenar...

Rey, thanks for the explanation of the RTI and WebService. I do have few follow on questions - I don't fully understand this yet. 1. We get many intra day falt file (and XML) drops. These files have data that are related in some form and are used to generate XML files that we would like to push to d...

Ray, Thanks for the reply.

We are doing some basic column profiling and inter table key relationship. How much time should I allow for that volume of data ?

How much data did you profile in 2-3 hours and what sort of analysis? This would help me compare also.

We have about 100GB of data that we want to profile. For business reason, we can't use the sampling, and must profile the entire data set. The profiling seem to be hanging (or not able to complete). The data is ASCII data. Machine is a 4 CPU. I have two questions. a) Has anyone else seen this behavi...

I have data coming over JMS at variable message rate. Somedays, there may be only few messages (order of 10os) and on some other day, there may be many more messages (order of 1000s). What's the best way to handle this ? Can this be handled by Parallel Extender ? Do I need RTI ? Thanks for any help.