DSXchange

We have a polling process that reads the files from a dir /project/inputfeeds. The filename would be like Src_Dst_1000_200808.csv (1000 is a increamental no. and ca go up to 1250). We have used a routine in polling process that fires a ls command with pattern Src_Dst_*_*.csv and gives back the filen...

In basic help PDF 'basic.pdf', there lot of functions for this. You would have to use set of these to get the log in file.

Complexity depends on the format and details to which you need the logs. Search for some of these functions and you might get some of the code which can be reused.

If you search on 'range lookup' you will get many posts and options available to implement this.

Search for "Error calling subroutine" and am sure you will get many posts on this.

As per my understanding this is problem with DS project indexes, which gets fixed when you do reindexing.

But search first.

Rather than going for IN clause and a parameterized approach there might be a simple approach to deal with this.

Is you table going to be constant in the SELECT stmt? If yes, you can go for something else in this case.

Hi, I ready many thread on the pivot stage in parallel and the performance issue. I created one temp job and tested it in parallel mode and seq mode. As expected the PX performance was better. In PX mode, I kept the partitioning to auto. Many of the threads mentioned that the pivot stage needs hash ...

Arnd, just wondering - can DS have any problem due to the 32 bit limits when we do this change?

Our DS Admins say that to go beyond 2 GB might have problem with other settings due to 32 bit probs. could there be any such problem?

We checked the limit for the $USER and it is unlmited for all. Still ulimit when run from DS jobs, is returning a limit of data segment?

Is there any DSENV parameter that needs to be changed so this limit changes?

Any thoughts?

After doing one more scan of the posts under this category, I saw one more post from Ray which said check the limits for $USER env variable. In prod I do not have rights to log on as another user. But then I added command "whoami; ulimit -a" and it returned following: *** Output from comma...

I also checked memory on Unix box. The real memory is completely used for the whole day, but virtual usage is just 10% for all the time.

Memory on windows box where SQL server is installed - real memory utilised avgly 95%, virtual is usage is 30%.

Hi, One the jobs in production is failing with error : APT_CombinedOperatorController,1: Fatal Error: Throwing exception: APT_BadAlloc: Heap allocation failed. The job is simple: DataSet to ODBC without any stage in between. There is no repartioning done by us. It is set to Auto. I searched on DSX a...

If I understand correctly what you want to do is - generate the missing months in the coming data with the no. that was assoicate with prev month in the input data. I am not sure if u can do it in a job as there is no utility to generate rows in DS. But yes, you can do it in basic routines and write...

Actually first I tried deleting all the data without the where clause and it was failing.
So I added where clause. Though the value looks numeric, in table the column datatype is VC.

Guys thanks for all the help. DSX is like a breath for people like me.

Hi I am trying to delete the data from a SQL server 2005 table. I am using DS server job with ODBC driver for it. For all the tables the DELETE stataments are working fine except for one table and its throwing following error. djsClearRFCore..tblRFCore.lnkClearRFCore: DSD.BCIOpenW call to SQLPrepare...