DSXchange

ray.wurlod wrote:How did your ETL process the date? That is, precisely what transformations were effected? ...

Ray,

ETL does not have any transformations. It is very basic ETL which has three stages as below.



SFDC_Stage------->Transformer------------->Oracle Enterprise Stage.

chulett wrote:Please also tell us what database this is and what your target column's data type is. ...

Thanks Craig.
Target database is Oracle 10g. Target column data type is 'TimeStamp'.

date/time does not match across SFDC and DB after ETL process. example: SFDC created_date = 2009-01-28T06:28:58.000Z DB Table created_date = 2009-01-28 11:28:58 As per the documentation SFDC stores date/time in UTC format. But after ETL process there is 5hr difference between SFDC and DB dates. When...

Hello all. I just wanted to see if anyone else has had any experience and pointers when working with DataStage and SalesForce.com. Here is the scenario: We have an instance of SalesForce.com that we're wanting to get data from and push data to on a nightly basis. Our current job design consists of ...

Also I know the connection to the server and table are correct because I am using truncate, and all the data dissapeared the first time I ran it. greggknight, how this issue was resolved? I have the same issue. I saw Ray's post which says '*Topic Relocated......*', but I could find this topic in an...

ray.wurlod wrote:Not necessarily the case in version 8.

Using Director, release all locks n the job then logout all processes in the job using Cleanup Resources. ...

Thanks Ray.

I tried to 'clean up resource'. I got below error.

ERROR: Cannot find any process numbers for stages in job 'Job Name'

Were you able to resolve the issue? I have exactly same problem? Which issue you are talking about? I am facing an issue of the jobs getting aborted abruptly(No message of Fatal or warning found in Director log and log is incomplete). or Error setting up internal communications (fifo RT_SCTEMP/BIW_...

ArndW wrote:If you stop the job and check the directory, is the fifo file still there? If so, delete it. Also, are you using BASIC stages in the PX job? ...

I am not using any BASIC stages in my PX job. My job has errored out. I am not sure how to check 'fifo' file?

thanks anyway.

chulett wrote:Please shed some light on your job design. ...

Hi Craig,

We were able to pull data running same job with different user id. My job is very simple just read & write. Both users have exactly same privileges.

Thanks for the response.

I am facing an issue of the jobs getting aborted abruptly(No message of Fatal or warning found in Director log and log is incomplete). When the job is restarted it is showing the following error message: Error setting up internal communications (fifo RT_SCTEMP/BIW_Dimen_Vehicle_Vehicle_01_SIT1.fifo...

I am trying to pull data from salesforce.com into DB2. I am able to connect to Salesforce.com and 'Browse Objects' from DataStage. But when I kick off my job it is running forever and nothing shows up in 'Monitor'. What could be the issue? Is there a way to check if 'read' process is still running? ...

Maybe so... but source systems get things wrong... ETL's purpose is/can be to validate the data for its quality and either provide handling for scenarios where mistakes are made or standards aren't met, or to report out errors. "Getting the source system to sort it" isn't always feasible ...

Is your database on the same server as DataStage? If not, then it might be best to do it in the DB. Even if both applications are on the same server it can be faster to limit the data at the first (database) level. Do you mean that you wish to use non-indexed columns are part of your selection crit...

Why not process your correct records and save the rejects to a file and determine what fields are missing? This could be done by having the source file owner review/correct the records in error. If you alter the job to accept bad data what will be the downstream affects of the bad data to the syste...

Data is not typed strictly in server and you could get a length of 1. Code: LEN(Char(32):Char(32)) is going to be 2. Thanks Andrew! It is indeed server job. I apologize for posting it to parallel forum. I am wondering how our situation can be handled if data type is not strictly followed in Server ...