Here’s the video I recorded of me soldering header strips onto a small board like the ESP you are using.

https://youtu.be/2X6eAIEl7ZU

To clean up your joints, get some liquid flux and flood the joints then reflow them with your soldering iron and add solder if needed.