It's okay? I mean, Kogarasumaru would've fallen without Ikki and Agito, it's better no one noticed we were missing. I went back home once and was right where I was before I left, so it's not as if I've missed out on anything. Aside from the things Ikki remembers that I don't.