The “I Can’t Love You Anymore” hitmaker wowed in a plunging sheer dress that featured glitter embellishments ... and even showed off her stylish black underwear underneath!