You have two issues preventing you from running the RTE protocol script in version 12.55:

First: Although the VuGen and Performance Center software is supported on Windows Server 2016, the RTE protocol is not supported on Windows 10 or Windows Server 2016. You must downgrade the OS to use the RTE protocol.
https://admhelp.microfocus.com/lr/en/12.55/help/PDFs/PC_LR_12.55_System_Requirements.pdf

Second: It appears that the inputs for col2 and row2 have exceeded the boundaries of the screen, and this will return a -1 value every time and fail on this step. Timeout value is also set too high.

I suggest that you check values of your terminal emulator screen manually to get the specific values. The TE_wait_text function's values should be more like the example below:

TE_wait_text(''login as:'',30,1,1,80,24,&iCol,&iRow,cmatch);

The terminal emulator screen is measured in characters. The character with position 1,1 is in the top left corner of the screen. If you specify illegal values for col2 or row2 (meaning that the values are smaller than those specified for col1, row1), the function assumes the last row and column on the screen. For example, to indicate that the function should search for text anywhere in the first row, without knowing the precise length of the row, you can specify

TE_wait_text (''login as:'',30, 1,1,-1,1, retcol, retrow, match);

Since the col2 parameter is set to -1, the function will search for text until the last column in the first line.