Well, those who received the holy spirits gift of tongues were not in the temple. Because the temple elders were about killing Jesus. So they'd certainly never permit the followers of Jesus to gather in the temple where the plot to kill Jesus was hatched.
Besides the fact there is no scripture...