There can be. Things like impedance matching for example should be a non-issue with items from the same manufacturer, and "voicing" should be the same. I had a pretty nice system that consisted of a hodge-podge of brands. It got a lot better when I went with a combination of Herron monoblocks, preamp, and phono stage. I certainly might be able to change out one of those items with something "better" from another manufacturer and have more pleasing results.
This is one of the reasons some people prefer integrated amplifiers to separate amps/preamps.
Having a stack of the same brand should take any guesswork about how well the components will match up out of the equation.