DSXchange

Are you trying to read from a file which has column names in the header or write in the file and want to have column names in output file in addition the data in the file :?: Edited to add- If you reading such file, command filter with tail command can be used to drop the column names while processi...

Rajan,

Have you searched on this topic? There are lot of discussions on this. There is very good article on ITToolBox by Vincent.

The links is below
Row leakage

I already had once created such routine for one my X assignments Craig!!!

Rajan, simple string find operations are required for this. Post the result if it worked or not.

As after the job abort it is clearing the partial file from the dir, it will be showing there is free space.

Just when the job is running keep an eye on space i.e. after each 2/3 secs, check the space available.

some points - if NFS drive is down the what? no access to DS.
While accessing the UV repository it will take more time to access the Engine and tables.

Try n search on build ops or custom stages you will find many posts on this topic.

Do you have any requirement to build one or is this question just like the inteview questions?

Actually I was referring to the file created by the OP. I assumed he has used DSLogGetSummary and then stored in the info in the seq file. That is the reason I mentioned it as sequential file. Rajan, have you written or using a routine to read the log files and then building the normal file from it?...

What do you mean by passing param to view? When you use a param in the query which is accessing view, the param value gets replaced when the SQL is prepared and executed. E.g. if you have view EmpDet on Employee table and you use select query on the view with a parameter in the query, DS will prepar...

Format is is visible from the log info itself. From the info shown in the log file, just use any name whatever you want and get the columns which you want. E.g. first one seems to be a event number, then the timestamp and then the eventy type and then last one is the message. Use the delimiter as '\...

So means only 3 nodes will be generated and if there is one more file provied in the property then it will generate 6 nodes. I just tested it on comma separated file. Observations - even though the file was CSV, still there a was performance improvement and all 3 readers were reading some of the rec...

Performance analysis in the HAWK is just amazing and it shows all the info like heap utilisation, memory and CPU usage, disk utilisation.

This one is just amazing and can help a lot in identifying the bottlenecks in the job. For each active process it gives all the details.

Kumar, does the number of readers per node are limited by no. of nodes in config file? My observation is - it does not depend on the number of nodes. Meaning I can define 2 nodes in config file and can have 3 readers per node in seq file stage. Now what PX does, if there is only one file to be read,...

Kumar,

From the warning one can not say that it is aborting due to stage var or something else.

Do you have any other decimal operation or column in your mappings?

Again this setting is like no. of nodes in config file.

You have to find out the optimum value for this by repited execution with diff values.

Have you checked why this is used and when it can be used?

This options should be used only if your sequential file is fixed width.