It sounds like a variety of upright juniper may be the plant you're looking for. You're right, while deer will eat nearly everything if they are hungry enough. Junipers, unlike arborvitae, have a good track record of deer resistance.

Do deer eat Spartan junipers?

Thuja Green Giant – Because it has genes from the Redcedar, this plant, the best hedging plant you can grow, is also resistant to deer. ... Spartan Juniper (Juniperus chinensis) – As well as making wonderful clipped specimens, this tough juniper grows into a beautiful drought-resistant hedge that animals leave alone.

What animal eats junipers?

Juniper berries are one of the top winter foods for many birds and mammals. Rabbits, foxes and most birds – turkeys, bluebirds, robins, chickadees and waxwings to name a few – covet the deep blue berries.