This ping counter does not have any link with server response time. It's a ping involved between the controller and the load generators. The server response time is computed by the load generator itself.
This ping duration shows the latency between your controller and load generator. That can impact the stability of the connection between them.