If those resources are excluded from the recording NeoLoad will not request them during the replaying unless you have configured your pages to retrieve dynamically the resources.
Even with that settings the resources will be downloaded once and if they did not change they will not be downloaded since they will be considered as inside the cache.
So yes removing them may impact the page response time especially for the first iteration but it's not really true for the next iterations.