Answer:
This saying is supposed to indicate a feeling of guilt/regret
Explanation:
This is because in this point of the story he was brainwashed by O'Brien and so he genuinely believes in Big Brother as a benevolent, omniscient father figure. The "O" at the beginning of the above quotation indicates his incredulity. He doesn't quite understand how or why he didn't believe in Big Brother before.