The defining trait is the even size and spacing of the dots; irregular or scattered spots read as something else. Dot scale changes the mood, from subtle and elegant to bold and playful.
Polka dots carry a strong 1950s and pin-up association and pair naturally with feminine shapes like fit-and-flare and wrap dresses.