Can you drive around with temporary plates?

If it is legally registered (even with dealer-issued temporary tags) in the state where you bought it, then you can drive the vehicle anywhere including out of state.

Is there a grace period for expired temporary tags in Texas?

The temporary tag you get initially expires in 30 days, while an existing registration normally has a five-day grace period before you can face issues if you continue driving the car.