You may have been looking for a way or are unaware that it’s even possible. Either way, you, like me, find the clicking noise extremely…undesirable.
The setting is surprisingly easy to miss (or just me going blind for ha-ha reasons) so here is a screenshot to show you exactly where it is.
And there you have it.
Now go adjust your volume in peace.