After emptying the frozen mashed potatoes into a medium saucepan or Dutch oven, cook them on the stovetop with the heat on low and stir them occasionally until they begin to defrost. The potatoes should be covered at this point, and you should stir them occasionally until they are fully smooth and warmed through.