That is one axis of psychacoustics, but there is also the axis of expectation bias, habituation, sequence, threshold of hearing, etc.
Hifianonym has a highly provocative/illuminating video on YouTube:
https://www.youtube.com/watch?v=jbyw7SmoKTA
Unfortunately it is in German, but maybe with subtitles it becomes accessible to others as well. Has some funny experiments re psychoacoustics in there. Don't want to spoil it, but a really good reality check.