I need some suggestions to read this file using datastage. This is a log file data which need to be loaded into a table.
These all are the columns i am after:
DATE
TIME
Event
Username
Application
Created_By
IP
Details
ClientId
Log_Type
see the below sample records from two different files, though it contains same event type. I thought to use the space delimiter, but it is not working. I am thinking to use to string match and then find a way to load the data by using field function.
Code: Select all
2017-04-03 12:56:43 [http-bio-aaaa-exec-10] INFO a.b.c.d.AppUserManagementController - Event=User_Created Username=ABCDl8 Application=XYZ Created_By=Admin IP=0:0:0:0:0:0:0:1 Details="Roles_Added=ZZZZZZZZ Office_Added=OrganizationProfile{orgId:12323112, orgName:ASDASDDS}" ClientId=useradmin Log_Type=audit
2017-04-05 11:37:29 [WebContainer : 0] INFO a.b.c.d.AppUserManagementController - Event=User_Created Username=12345 Application=ABCD Created_By=Admin IP=0:0:0:0:0:0:0:1 Details="Roles_Added=SDFDS SDS SS Office_Added=OrganizationProfile{orgId:45455465, orgName:ASDASFDFDSF}" ClientId=SDFSFD Log_Type=audit
Please throw some light.
Notes: In the same file, i may end up getting 33 different event. In such case i may need to find 33 different ways to fetch the relevant data.