Yes, you can bring up a channel as if its a community by searching it on Lemmy, for example !thelinuxexperiment_channel - then each video will be its own post, and commenting on the post will forward the comment to PeerTube!
If the channel isn’t already “known” by your instance however, you may have to wait until a new video is posted before it is visible to Lemmy.