I mean, now I'm really just theorizing, but... that someone could have interfered then and shattered the gem after Steven removed it. That would explain why we're still doing a trial, and why none of us would have marks from struggling with him.