Apparently in medieval Europe they also whispered secrets to the bees.
So imagine the mildly eldritch God you worship talks to you and tells you secrets, but these secrets make no sense to you and are incomprehensible to understand or even know they are secrets. But your God does make vibrations at you, so thats probably a good thing right??
Also occasionally the Swarm decides there is not enough room in the Hive because the eldritch god didn't take the offering of Honey at their normal time. So enough of a Swarm builds up that the second queen is able to leave without decimating the first Swarm. They are all set to search out a new place that will likely not have your God anymore (but really that's not too much of a struggle, they have abandoned you, that's part of why you've left, even though the first Swarm still holds out hope for their return).
And then, the scouts find another Hive right next to the old Hive. Literally right next to it. So the Queen lands to inspect it and wow, it's a good deal. The area already has enough food to support 2 Hives, so it's a not problem to stay in the area now that they have the space, but...this wasn't here before.
And then you see God, they've come to help the Swarm move to the new Hive and take the offering from the old Hive. Truly this must have been their plan all along