Encoded categorical variables contain values on 0 and 1. Therefore, there is even no need to scale them.

Should you normalize categorical variables?

I think the answer can be really short. There is no need to normalize categorical variables. You are not very explicit about the type of analysis you are doing, but typically you are dealing with the categorical variables as dummy variables in the statistical analysis.

Should I scale dummy variables?

If in a multivariate model we have several continuous variables and some categorical ones, we have to change the categoricals to dummy variables containing either 0 or 1. Now to put all the variables together to calibrate a regression or classification model, we need to scale the variables.