That’s already the case simply because you can go through a portal from the bottom of a cliff to the top of a cliff without doing work; this obviously lets you build a perpetual motion machine.
(Do gravitational fields pass through portals? If you try to go through a portal from earth to deep space, will Earth’s gravity pull you back?)