Professional metalworker here: 1000% this! A stick welder is the simplest thing. No movíng parts, low barrier to entry.

A hobbyist should keep the following rod on hand: 6011: Deeply penetrating, high tolerance for rust/paint/etc. 6013: Great for sheet metal! Anything 14ga and under. 7014: Nice bead appearance, simple to use "drag rod", better shelf life and easier arc starts than 7018.