DSXchange

Does it have to be a parallel job? If not you could use a server job and use the string transforms DIGITS and LETTERS
DIGITS = extracts only digits
LETTERS = extracts only characters.

Or you could use a BASIC transformer in a parallel job to do the same thing.

Without testing - and this is pure speculation, I am guessing that the problem is that like statement is looking for the literal '%orchestrate.Input_break%' rather than the value that you are actually wanting to pass to that value. I have never tried to pass a like statement to a sparse lookup. But ...

Just to be clear, when I mentioned methodologies - I was referring to using SQL to do transformations in conjunction with ETL tools (eg use Datastage to load all your data into canonical models in the same db as your mapping tables, then create view which performs those mappings to use as the inputs...

This post might help
viewtopic.php?p=422451

We require this, as our ETL process is performing bad compared to ELT. We are going to convert ETL jobs to SQL scripts to do transformations. Or maybe you have badly designed ETL jobs? If your jobs are just a straightforward lookup to a table in the same DB and schema then it is quite possible that...

So a job would normally inherit the limit value from the controlling sequence, are you saying you do not want this to happen - ie for a particular job you want to override the limit warning?

Ahm so once I converted it using StringToDate its ouput would be a date format right? But on my mapping document it needs the format to be yyyymmdd. Hmmm. Im so lost. So I take it from this that you are loading your values into a DB then outputting them again to some sort of text file? If this is t...

You are doing nothing wrong. You are converting the data from a string to a date. Once converted, it will be "represented" as is the default in whichever tool you are using to view the data. In you target SQL - it will be stored as a date value in some sort of internal format, but when it ...

My modify stage syntax is a bit rusty, but I would lose the # symbols and/or close the meta data type with parenthesis rather than square brackets.

If there are only a few static values which need replacing then use the nested Ereplace option as its much easier. I would only bother with my other suggestion if there are a lot of values to replace I was thinking that you could have a delimited list of values to look for, and a delimited list of v...

It would depend on how flexible you want the outcome to be? You could, as Ray suggests have nested Ereplace functions but this would depend on how many specific replaces you have. A few more things would need to be answered first? Will multiple replaces for different values be required within the sa...

Could be the same issue? I am not sure of the datatypes out of that DB.

I seem to remember having a similar warning a while back. I am assuming given the warning you are connecting to SQL Server? If I recall, the issue that I encountered was because one of the fields that I was trying to extract was set as datatype nvarchar max (apparently a valid datatype in MS SQL Ser...

The only other thought is that its down to partitioning, and that your records are actually on 2 different partitions hence no match. If the partitioning is correct then usually at this point I would start performing checks like * outputting the lengths of the values in the input columns you are try...

The obvious answer is that they do not actually match.

Are you sure that there are no hidden characters in either source that would cause a mismatch (eg nulls, line feeds, spaces)?