IF, and that's a pretty big IF, Daryl was gay, then I think that would be awesome.
That typed, I've always been a fan of his chemistry with Carol. From what little we've seen of his personal interactions with potential female love interests, I did have the impression that Daryl was simply extremely inexperienced with women for any number of potential reasons (one of which could be that he's not all that interested in women (or men)).