Keep them upright to prevent warping. Angled storage will eventually lead to warping as will laying flat due to the weight of other albums on top. Safe to lay flat, I suppose, if you only had 2-3 in each stack, but you would either need a very large storage area or a very small LP collection lol