Some materials have higher carbon emissions than others, in terms of refinement, processing, and transportation. The third point is location dependant, but creating and shaping different materials will have different contributions to global warming.
Edit: There are also concerns with the product’s end of lifespan. How long it takes to biodegrades, how easily recyclable it is, and how much the available disposal methods will effect the environment. Plastic is not great on several of these accounts. Recycling plastic water bottles isn’t very efficient either, compared to glass bottles for instance.