DSXchange

I don't think anything about DS is "unfair", it has saved our butts many times and we enjoy working with it.

So let me clarify what you are saying: We need to change the files structure outside of DS and then change the DS jobs to handle the new changes.

Correct?

Thanks again

I have a job that takes complex flat sequential files and converts them to SQL tables using the ODBC driver. The current process works great and we are having no problems with it. Now the question: What do we do when the layout of the input files changes and those changes need to be replicated to th...

Found the problem!! We had data entry people who entered data in lower case AND upper case in the keyed fields. Our system was fixed a couple years back to upper case all stuff and these records were entered before that. So we ended up with keys in lower case and upper case that matched. I changed m...

I did this and ran it but none of my rows were moved to the reject file. I know that I have 1000 records (not real number) in the input file, once the stage is finished it says 1000 records were written, but when I look at the SQL file created it only has 995 rows in it. We have looked at the input ...

I would love to write them out to a seq. file. That would allow me to look at the data and see any issues.

I am new at the DS thing. Can you explain how I would use the reject link for this?

Thanks

I was just wondering if there was a way to trap ODBC write errors to SQL files. I am combining multiple files into one that have the same key information. I seem to be getting some files that have duplicate keys so they do not write. Is there anyway that I can trap out the records that are not being...

Thanks kcbland and Ditto!!

Thanks for the help. I do appreciate any advice that I can get (no matter how rude it is.......kcbland).

Let me try and throw some more info into my question. We have a database with millions of rows. The file that I am reading is either new rows for that database or the key of a row to be deleted. The input file is a complex flat file (just so you would know). The adding of the new row is no problem b...

I select User-Defined SQL from the update action field in the ODBC stage action. I want to enter a SQL statement that will delete the selected record that is being read. I need to match up three fields in the layout to know which row to delete. What would the syntax be in the Enter SQL section? This...

Gotcha!!! Great idea KCBLAND, I'll give is a shot and see what we can come up with.

Thanks again!!

Thanks for all the help (so far). Our database is a Microsoft SQL file. I see what you are saying by creating a file that will contain the keys to the records that we want to delete. Then use a SQL call for the records in that file to delete the SQL rows that need to be deleted.

Thanks again

We have a file that is coming in as a complex flat file. We take the file and read each line (they can either be modified, new or deleted) to check for the type of data. We then use DataStage to input the records into the appropriate SQL table using ODBC to update or add new. Our situation is that i...

Since I am a new user to the entire ETL structure can someone explain to me how I would use a Hash file? I have 15 files coming in and I need to convert them all to a single SQL file with a Key added to the front of each record. More details of the problem are in the first post of this thread. Thank...

The files all come across from different sources and we need to keep them seperate. We actually place a key in front of the entire record during the conversion to keep the data seperate in the SQL file.

Thanks and please keep the help coming.