You need a bit of knowledge to get the most out of a complex music, which sounds intimidating.
Or you can just go to the concert blind and take in all the emotions, but people don’t know that’s a perfectly valid way to enjoy classical music. (It is! go to the concerts and don’t be afraid to have an opinion)