I've been spending a fair bit of time re-discovering French rock & blues lately, mind you I do speak French so I suppose it's not really "foreign" to me. When I travel I hear all kinds of different music and quite enjoy it so... yes I like foreign lyrics.
p.s. if you enjoy bluesy rock you definately need to give Offenbach a listen (Gerry Boulet's voice was made for the blues, awesome whiskey growl), and Harmonium sounds like a French CSNY. Both Quebec-based bands from the 1970's & 1980's that may be unfamiliar to most here.