That's fine - Steve really doesn't want to come in, and at least the door doesn't get slammed in his face right off the bat. He shifts his weight, body posture going tense, and says, "Yeah. You can explain what the hell you thought you were doing in the library."

Part of him means setting the fire. But part of him means, leaving an inmate to die in it.