Asriel startles, and he startles pretty hard! There's no attempt at violence towards Spark, really, but he still may end up getting jostled out of Asriel's lap.

"Geez! What the heck?" He might sound mad, but mostly he's embarrassed. He wouldn't just be sitting here petting and talking at someone if he'd know they were a person and not an animal!