So sometimes when a person does a whisper, I miss the first second or so of the whisper whilst other people heard the whole sentence. Any ideas on how I can tackle this issue?

tl;dr : Can't hear the first second of whispers, need help.