This is a photo of just a small part of our sky, about 1/10th the visual diameter of the moon. All of those lights are individual galaxies, not stars. Click on the image to see a larger version, then just contemplate that each galaxy you see contains over 100 billion stars, and each star may have dozens of planets, with intelligent life on some of them. Our universe is immense indeed!
But there are an infinite number of universes, and don’t imagine that all universes have stars in them. There are universes without stars, galaxies and planets. Just as one small example, there are universes of flat parallel planes, stretching to infinity, populated by luminous beings who fly across and through the planes. There are no suns, for everything glows with an inner light.
I know this for an absolute fact. If one were to deny it, they would be limiting God, Who knows no limits.