You've built half a bearing. See how the wood overhangs one half of the axle? You need to have a corresponding piece of wood on the other side of the axle. Two little "legs" and a bridge piece going across the axle would work (An "n" shape").

Or just throw on another washer or two and call it good. I'm pretty sure that would be fine for your golf clubs.