DSXchange

Hi All, I have been using Lookup stage with both links partitioned as "Auto" for all the jobs developed so far. I have the understanding that internally lookup stage uses "entire" partitioning on the reference link if we choose "Auto". Is there a possibility of above no...

thanks all

closing the topic

thanks eric i thought the same and tried using the stage name within the shared container but DSGetLinkInfo does not recognize it either.

That is why i used DSGetStageList to get name of all stages in the job and it gives the name of SSC stage in the list

Thanks all for your replies

sorry for the wrong abbreviation

i am doing what qt_ky suggested but through DS routine.

Kindly anyone help me with the other question.

can i terminate (using terminator activity) a loop before loop repeatations are complete?


thanks
ravindras83

Hi All, We have a routine to find out the record counts on input, output and reject links. These counts are populated in to a Log table for every run. The routine uses DSGetLinkInfo function to fetch the counts. It used to work fine until now. Job name, stage names and link names are passed as argum...

Hi All I have a situation where we get about 350 different source files (with different metadata). These files have date suffix in the name but the file name is distinct. e.g A_02122012,B_02122012 etc. We need to wait for the files to appear before starting processing. I checked the wait for file st...

Hi I am using DS version 8.5 on unix box. I was looking for the Environment variables APT_PARTITION_NUMBER and APT_PARTITION_COUNT in the list of variables. I want to run Tera data Multiload stage in parallel mode which needs unique names for the Log and Err Tables. I wanted to use APT_PARTITION_NUM...

You've got a Teradata DBA in the house right? Yes Paul I understand and agree your point. For the moment with the changes cppwiz suggested job is running in reasonable time. There is some time for this to go in QA and PROD. I will get hold of the DBA (which is going to be difficult ) and try that a...

Thanks for your help cppwiz. I did the changes for the Min Sessions and Max Sessions and now the job runs considerably quickly in about 35 minutes. I think I will take that considering it is only one time load. Thanks Again.

Thanks Paul.
It is the same server actually its the same db schema also.

But i have to change the job afterwords to include some external sources. Also more importantly I do not have enough expertise to do stored procedure.

Thanks Ray I ran the job with peek as output and job runs in 20 mins for tha same volume. Job also runs fine when run only one months data (populating 1 million records) in about 7 mins. It takes time when i run on the entire data. Replace the target stage temporarily with a Peek stage to isolate wh...

Hi I have a job that loads about 11 Million records into teradata target table. I am using teradata connector stage as both source and target. Job looks like below Teradata Conn (Source) -----> Transforer -----> Teradata Connector (Target) Target table structure is as below Keycol1, Keycol2, Keycol3...

Hi Ravindra, Could you please give some more info on @PARTITIONNUM AND @NUMPARTITIONS My Understanding is if there are 4 partitions then @NUMPARTITIONS value is 4 but no idea on @PARTITIONNUM... trying to understad how this value will be fetched. Thanks in Advance @PARTITIONNUM is the partition num...

Since transformer is running in parallel the unique numbers generated through stage variables will be unique within the partition only. If you want unique numbers across all partitions then use the variables @PARTITIONNUM AND @NUMPARTITIONS in the transformer i.e give first value for stage variable ...

Plz help me to access SAS dataset for profiling using IBM Infosphere Information Analyzer V8. Do I need to install any specific connector to access SAS dataset or available ODBC driver will connect the SAS? I came to know that 'WebSphere DataStage Pack for SAS' is available, will it be able to conne...