No, there are a lot of things that are not legal but also not criminal. Here, the difference is whether or not the President is empowered to take such action. Similarly, the President cannot enact a new tax law or bind the nation to a treaty as he lacks the legal authority to do so, but attempting to do so wouldn’t (under some scenarios) be an otherwise criminal act.