The UK government has been criticised for chartering a flight to deport up to 50 people including a vulnerable drug user and a man who arrived in the country as a baby.