The KwaZulu-Natal Health Department is concerned about rising infections in the province.