State failed to deal with colonialism, apartheid legacy, say unions