Quality stainless steel safety pins will not rust. You must use inexpensive safety pins. Skip the bleaching step for a light rusting. Also use this method to rust bells and other tin items.
How do you remove rust from pins?
Baking soda
Method: Rinse the metal item and shake dry. Dust with baking soda (it will stick to the damp areas), making sure to cover all rusty areas. Leave the item for an hour or so, then scour with steel wool or a metal brush, removing the rust down to the metal. (If cleaning a pan, use a scouring pad.)
What is the best homemade rust remover?
You can use white vinegar for effective rust removal. The rust reacts with the vinegar and later dissolves. Simply soak the rusty metal object in white vinegar for a couple of hours and then just wipe to remove the rust.