I’ve seen plenty of people who did the plywood thing, works fine. Weather stripping is recommended if you have lots of bugs (or are otherwise bothered by any intrusions).

If you want to see out that portion of the window, I recommend still using a plywood frame for where the door is, and plexiglass above it.