since I'm on a laptop at the moment with only two CPU cores and no hyperthreading I'm noticing this much more than on my desktop computer (a quadcore with hyperthreading).
I am in a channel with 3 people and noone is talking. The client is taking 10-20% CPU.

Codec is set to Speex Ultra 32kHz 7/1, build 14642

What gives?