Sample Header Ad - 728x90

Informatica job log files process through shell scripting

1 vote
0 answers
56 views
Log file raw data :
READER_1_1_1> BIGQUERYV2_10000 [2022-11-04 01:55:20.724] [INFO] Job statistics - \n Job ID [job_PsfUvYJkPeBfecxeIzUUrIIa9TEc] \n Job creation time [2022-11-04 01:54:54.724] , \n Job start time [2022-11-04 01:54:54.936], \n Job end time [2022-11-04 01:55:10.88], \n Bytes processed [4,081,564,561] .

DIRECTOR> CMN_1740 [2022-11-04 03:25:53.269] Table: [src_BQ_CONSUMER_CURRENT] (Instance Name: [src_BQ_CONSUMER_CURRENT] Instance UI Name: [src_BQ_CONSUMER_CURRENT])

     Output Rows , Affected Rows , Applied Rows , Rejected Rows 
DIRECTOR> CMN_1740 [2022-11-04 03:25:53.269] Table: [Account] (Instance Name: [Account] Instance UI Name: [TGT_ACCOUNT])

     Output Rows , Affected Rows , Applied Rows , Rejected Rows 
DIRECTOR> CMN_1740 [2022-11-04 03:25:53.269] Table: [EU_Delta_Account_txt] (Instance Name: [EU_Delta_Account_txt] Instance UI Name: [tgt_FILE])

     Output Rows , Affected Rows , Applied Rows , Rejected Rows 
DIRECTOR> TM_6020 [2022-11-04 03:25:53.269] Session [s_mtt_0117JZ0Z000000000047] completed at [Fri Nov 04 03:25:53 2022].
Need to capture fields like Table:,Job start time, completed at,appended rows,error rows data into another file. These fields data store it in Hadoop hive table for mail send.
Asked by kasim basha (19 rep)
Nov 9, 2022, 01:31 AM
Last activity: Nov 10, 2022, 05:27 PM