I recently started doing something similar with my cold brew. I found that I actually prefer either a lot of creamer or no creamer. The middle ground of some or a little creamer just doesn’t taste right to me. One unexpected benefit is that omitting creamer has made rinsing/washing my cup much easier.