If anyone has any tips on settings to verify in VMware

a bit late... I've seen VM slowness when the Memory "Limit" was set to less than the VM's allocated ram. I think this was a legacy vCenter <= 5.x thing (now it sets Limit to "unlimited" IIRC). tl/dr; I had a VM with 2gb of ram, which was manually increased to 4gb. the memory limit was not increased. when transferring a file >2gb in size, the transfer slowed to about 15kbps once it hit the 2gb mark. The VM's memory was being pushed into the hypervisor's local swap

I'm also going to assume that both (or more) VMkernel interfaces that are using iSCSI, can connect to all of the FA iSCSI ports, correct (using vmkping -I vmX iSCSI_IP)? I've seen issues where vmk1 and vmk2 could only connect to 1/2 of the ports, even though they are in the same subnet. When vmk1 tried to get to the ports it couldn't reach, and vice versa, it added latency as those unreachable paths were constantly being attempted.

With it being iSCSI, I'm sure you guys have looked at DelayedAck being enabled=false. And looking at one of your arrays, you're using a flat network, so I'm sure you have Port Binding configured. Are the iSCSI ports connected directly to your core? Or are there switches between the array & core?

purity 6.1.14 esxi 7.0.2 & 7.0.3 hosts running over 25GB iSCSI The queue depths were looked at, if I remember we ran into a roadblock trying to find the 'default' for the Broadcom NICs

What version of vSphere? What protocol (iSCSI/FC)? What version of Purity?