Context: MC is talking with his servant about the fact that when he was still a student like her, he also forgot everything the moment after the test was over.
G1: 昔、白蓮ちゃんたちと一緒に風鈴先生のところでやったはずなんだけど。こんなはずじゃないのになぁ
MC: あーわかるわかる。俺もテスト……試験がおわったら、その瞬間に全部忘れてたし
G1: ご主人様もなんだ!一緒だね~♪
MC: 喜んでちゃいかんだろ。いや俺も俺だけど
Can someone help me understand what he meant here?