Nearly all of the characters you’re trying to skim out are regex metacharacters. Most of them shouldn’t have any effect inside a character class, but it’s possible that the implementation you’re dealing with is substandard. The “escape everything possibly meaningful” version looks like ^[^\/:*?"<>|]+$ (MummifiedClient5000 missed the |, which is a regex “or” operator).
If you’re not given to labelling your files in non-ASCII character sets, you can always go in the reverse direction and list the characters that are permitted, something like ^[a-zA-Z0-9. -_~&%]+$ (add a few more punctuation marks at the end if you need 'em).
The other possibility, which I’m hoping is not the case, is that your regex filter is expecting POSIX regular expressions rather than the normal Perl-compatible, in which case you’ve got some more reading to do. (I doubt it, though.)