“I'm not wearing white,” Rivers tells PEOPLE exclusively of her upcoming wedding ... I wouldn't wear black because I wear so much black. But navy and dark gray are still in play.” ...