Nothing inherently, you can go ahead and eat apples from your apple tree.
The main issue with “organic” foods is that the term is usually very badly regulated. Sometimes there is no difference between “organic” and “non organic”… besides price. Sometimes “organic” foods use very ecologically unfriendly techniques, or are grown/processed in countries where supply chains are not inspected anyway.
Then there’s the fact that if something is different, it may not always be an environmental or health win. Growing your food in 30cm of water may be one organic and traditional way to avoid using pesticides (see: rice), but doing that with corn in the middle of Arizona would obviously be a terrible idea!
Anyway, overall I don’t think organic foods are worse if you’re well off enough that the price is not an issue. But you shouldn’t feel personal guilt for buying whatever’s cheaper, because quite often the alternative does not justify the price anyway. Eating truly “organic” food unfortunately requires a lot more involvement than picking the green package at a national supermarket chain.