First, you don't want a cardigan to be too big, loose, and baggy. When buttoned up, it should sit close enough to the body that the v-neck doesn't gape open when you lean over. ... You also don't want the cardigan to be too tight. The fabric shouldn't pull around the buttons when closed or cling to your bulges.
Should you size up in cardigans?
Size down in longer cardigans and/or choose cardigans that are more fitted. Slouchy cardigans are trending for the younger set, but let's be honest — unless you are tall and skinny, slouchy oversized cardigans tend to add visual weight. I find that I look best in cardigans that are designed to fit closer to the body.
How do you know if your cardigan is too small?
Length. While wearing the sweater – when you bend your wrist, so your palms are facing the ground, the sleeves should end where your wrist ends. So where the white shirt cuff stops in my picture below. A sweater's sleeves shouldn't be totally smooth and ripple-free – if it is, that usually means it's too small.