Totally agree.
From my experience, my favorite artists, bands, composers, were not immediately appreciated by me, on the first few listenings. It took several or more times until they gelled for me.
I was not a fan of classical, at all, until I heard Bartok, Stravinsky, Britton, Ravel. I didn't become a obsessed until I discovered Carter, Wourinen, Berg, Schwantner, Schoenberg, Lindberg, Ades, Tower, etc.
Classical music from earlier than about 1920 does nothing for me. And it's not for lack of trying. The vast majority of the classical I listen to is post 1950.
If I had to choose, I would always pick 20th-century music. Fortunately I don’t have to choose!
Listen to Glenn Gould play Bach, or the Bach Cello Suites, and the late Beethoven quartets. In their way, they are just as “out there” and exciting as anything from the 20th century.