Khosa, Nzimande hit back at allegations