Yes, it's cool. I'd bring a jacket
It's little cool as you go into the back caves so I suggest a light jacket.
We were not cold. We danced too so it actually was quite warm then.
Get quick answers from Wabasha Street Caves staff and past visitors.