Retired civil servants reportedly make up the bulk of a task force established to reduce the months-long work permit backlog at the Labour Department.