"I... I don't want to be in the way. I can." He shook his head, "I'm used to being alone."

He had spent so much of his life on his own. Given the choice though, staying with Inigo was better, having someone to hold. That was better than being alone.

But still, he doesn't want to be in the way. He is sure Inigo has better things to do than look after him.