It's a self solving problem though. If businesses _need_ janitors and there are very few janitors around, those remaining ones can charge very high rates for their work.

Then you either pay very high rates for basic labor or you push the government to build cheaper housing. It all fixes it self.