Little One does step back because stabbing a solid wall at speed looked like a very bad idea indeed. She doesn't even understand what the woman is saying so dismisses it as more stupid things that she doesn't need to worry about.

Hibiki's sword hits the unyielding metal with a dull thud, the wall is indeed impenetrable and so left Hibiki with a lot of momentum that needed to go... somewhere.