Union members said the loss of these workers will only further slow the legal path to citizenship for migrants.