Ironically, it is more apparent on the most detailed recordings with the most specific and dimensional soundstage. On recordings with less focus it is not as noticeable, which makes sense. As mentioned, the placement shifts are subtle and noticeable only with listening concentration, so yes, it may be the result of critical listening. In other words, yes, it could be me.
The room is very large with an extremely high ceiling without acoustical treatment, which I suspect may play a role as well.