The X-men movies in general have never been huge money makers though. Profitable, yes, but never hit the levels of Spider-man or Batman. Days of Future Past was an outlier, I think that movie was one of those rare perfect storm events that can't easily be replicated. It was a great film that brought back old friends and made all the fans happy by erasing/ fixing the bad movies, and I think that movie benefited greatly from fan and critic word of mouth.
But the X-Men never had that massive, phenomenon movie power with the GA, at least not until Deadpool.