You're still thinking that Collector would be trying to assemble the infinity gautlet instead of trying to keep the gems safe, to stop them from being assembled, however this wouldn't work.... It would spread out the Infinity Quest across movies. Regardless of my whole Thanos possessing Collector idea, I think what we're saying is that whatever anyone does to try to stall Thanos's own quest for the gems will not work anyway.
This would be someone trying to compete with Thanos, however Thanos ultimately succeeds by Avengers 3, so it could simply be a way to stretch out the Infinity quest across movies and have someone try to stall Thanos. Collector would fail, because of something like destiny not being able to be avoided, or something.
In the comics Knowwhere is used to calculate things based on probabilities and view timelines, they view the ends of many timelines, not just one. So even if Collector is acting to stop the future and Yondu is a fugitive from this disastrous 31st century, it could be that the future is hard to avoid and in 50% of the timelines, half of the universe is destroyed by the 31st century, or for example maybe sometimes there is no 31st century for Yondu to return to.
It would just explain how Del Toro would be in multiple films and not be Thanos. Someone who moves across movies for the light side, and maybe not a guardian of the galaxy but maybe secretly a part of the group called Infinity Watch... He could be at every turn trying to get to the infinity gems before Thanos gets them, and puts one in a museum that the Kree guard, thinking it was safely guarded there before Thanos comes directly after Collector's mind.
Maybe something like Collector putting Drax in suspended animation inadvertently creates Infinity Watch in the first place... Moondragon is drax's daughter and would get abducted from Earth to Titan before Drax got to space... way before this story would start... an "adopted" daughter of Thanos similar to Nebula or Gamora. Maybe' it's drax's destiny to kill Thanos, and only Thanos/Collector could forsee this, which would be the future Thanos wants to avoid, Drax's intended purpose... If he also put Warlock in suspended animation, this could have affected the makeup of infinity watch. If Warlock was in the story right now he would act as a force who watches over the infinity gems. Warlock, Moondragon, and Drax are members of Infinity Watch, but can't form it yet.
What I'm thinking is that the Elder of the Universe's mind/body eventually sides with those who are trying to protect the entire timeline, and all of Infinity, but that Thanos outsmarts everyone, including supreme intelligence, and ends up with a gem or two before GoTG ends.