When "potter" comes into English in the 17th century, it means to poke at something repeatedly. From there, it comes to mean to occupy yourself in an ineffectual or trifling way. ... "Putter" appears to be a variant of "potter" that shows up at the beginning of the 19th century.

How do you spell puttering around?

: to spend time in a relaxed way doing small jobs and other things that are not very important I didn't do much last weekend. I just puttered around.

Where does the expression pottering about come from?

I have been pottering about with my stick, and my family have all been on their knees grubbing i' the ashes. Family Secrets by S J Pratt, 1797. It appears in the seventeenth century but derives from the Old English pote, to push, thrust or butt.