DSXchange

Thanks Sainath& ArndW.
I will go try out sort->transform->sort->transform today.


I was wondering if there is any better way available to solve it in parallel edition(my client is planning on purchasing parallel edition)?

Hi, My requirement is to read data from a sequential file and move all records which have duplicates in primary key column to one file while moving others to a second file(order or records does not matter). Input File(first column is key column) abc, 123 rtr, 3434 abc, 5454 def, 34353 rtr, 343436 ef...

Did that and it worked. Thanks.

Hi, My requirement is to write system timestamp in one of columns of target table. Even if the job runs for two hours, it is okay to populate table with a single timestamp value instead of extracting timestamp from system for each row. In one of the transformations I am setting DSJobStartTimestamp v...

You probably need to constrain the output to pass only those rows that are complete. Thats precisely why I am using an Aggregator Stage(with last derivation) or a hash file stage which gives me last write. I will try putting up constraint in transformer itself, but the question still remains unansw...

Requirment is to club these multiple rows with same index value(the integer in third field) into one row. sample input: Field001,Field001_1,Field001_2,Field001_3,Value "wfappwols","hierarchies","0","cisid","3434" "wfappwols","hierarchi...

I tried using aggregator on a sample job, by replacing one of the end hash files with aggregator. But in DS Designer after I run the job, I see twice the number of rows passed between transformer & Aggregator stage, how is that possible? source----32rows----->transformer----20rows------>transfor...

Hi, I am doing vertical pivot on the lines of whats mentioned at - http://dsxchange.com/viewtopic.php?t=97681&start=0&sid=f2129441ee011480f77b45d58c385d2b Now, in the above solution, final data is being written in a hash file as it overwrites values for same keys with no extra effort. Since ...

Regarding ISO8601 standard, it allows negative dates for BCE. But when I tried to supply negative dates ( -1001-11-11) it gave error for the negative sign.


Julian format can be a workaround, but how do I convert dates in my source flat files to julian format?

Example of data: "timewithtimezone14","timestampwithouttimezone15","timestampwithtimezone16", "timewithouttimezone17" "24:00:00-1359","4897-12-31 AD 10:23:54","4897-12-31 AD 13:53:54+05:30","24:00:00", I can skip the AD/...

>what database supports 'large dates' like that. Well postgres database supports that, and i guess other datases would also support atleast dates with 5 digit years %yyyyy-%mm-%dd >why in the world would you want to use them why not, say I have a database of objects related to archeology(or may be e...

Hi, I wish to insert records with large dates as in 5874897-12-31. The field can contain smaller dates as well say 101-12-31. The function date_from_string in datastage requires exact date format %yyyy-%%mm-%dd, but my data can vary from %yyy-%mm-%dd to %yyyyyyy-%mm-%dd. Is there any way to convert ...

Hi, I was wondering if there is anyway to extract(or load) records of date/timestamp/time datatypes with *timezone* information. My Database fields for date/time have timezone information associated with them, but when I use datastage timestamp/date datatypes it gets truncated. Other way round, when...

This time I tried the same thing with DB2 v8. Here again, without partition reads jobs works fine and with partition reads the job fails. I am pasting the error log for Db2: I am using data direct driver for db2. Item #: 11 Event ID: 361 Timestamp:: 2007-10-26 17:33:31 Type: Info User Name: dsadm Me...

When I run the query 'SELECT partkey,name,mfgr,brand,size,container,retailprice FROM manish_part3 ' on my Database client tool it correctly fetches me 1012 records. Regarding the ODBC_"Partitioning trange too nerrow (0, 0)" error, i cut and pasted the exact log as seen from Director. I als...