Can wasp nests be underground?

Yes! Wasps can build their nests underground, so long as there is some kind of surface to attach the nest to. This can be a foundation of loose soil, a wall, or a piece of wood. The wasps will excavate a series of tunnels below the surface, and will build a series of cells in which to raise their young.