Hmm, I wonder....as they learn to read, it seems likely they'd pick up on similar word endings and learn the idea, from the definition if nothing else.

Spelling and pronunciation discrepancies would likely mean their definition of rhyming would be slightly different from a hearing person's. For example, they might agree with you that can, ban, fan, and man rhyme. But they might feel that bough, rough, and slough rhyme while you would not. And they'd probably be confused about why you'd think that why, high, and Thai could rhyme.

I think they'd have a similar difficulty with meter. They could learn to recognize spellings that indicate syllables, and perhaps with a visual-phonetic cue (such as a light that changes intensity with volume, and color with pitch) they could get the idea. But it might be difficult.

That's all pure conjecture though; I'd love to have a person who is deaf share their experiences!