If something hasn't been spoken out loud, it's unsaid. Even when something is unsaid, its meaning is sometimes understood anyway.
It's more common to use the adjective unspoken when you're talking about something that's implied indirectly but not articulated in words, but you can use unsaid this way too. In print, you're most likely to see it in its role as the past tense of unsay: "Once you've said something mean, it can't be unsaid."