"... He doesn't know who you are. Not right now." Much as he wants to give Chikusa some comfort, he has to be realistic. "You'd just confuse him." If someone had approached him when he didn't know who he was... he would have been suspicious and angry.