For a lasting and proper fix, yes. New or good / used.
There are some self-tapping oversize (aftermarket repair plugs) out there. At least there use to be. Also a rubber expanding plug of some sort comes to mind. But you still have to remove the plug you have, first off. Google it.
Is it the drain plug that is stripped or the metal bung / flange around it turning, as in some pan designs? I can't recall the exact design on our pans. If this style, you MAY be able to weld the bung to keep it from turning, but it may leak at the joint.