I don't know that he really expected to get out of duffer duty, but I think he might be annoyed that he got a male duffer (well, duffer adjacent) as it makes it a lot less likely that he'll ever get a good same-sex pairing. We know they take celebs' requests into some consideration, so I wonder if Richie wanted him and the producers granted it? I'm pretty sure Kym requested Graz and Ellie requested Johannes, so that left it between him and Kai to get Kaye and Richie. I think he maybe would have preferred it the other way around - had Kaye to fulfill his post-win duffer duty, and then campaigned to get a good male celeb next year that would gain him attention and a shot of winning again. Or maybe he was trying to dodge duffer duty, and thought Richie would be a bit better than Kaye, but had more trouble making it work than he was expecting? But I think it's more likely the former, and the sour grapes are because he's pissed he's probably lost the chance to have a successful same-sex partnership and the publicity that would bring.