Use the <1ms left over server-step sleep time in next step

Use the <1ms left over server-step sleep time in next step #323