Though he was born in Ulm, Germany, his family moved to Munich when he was a young child. Munich is within the Swabian dialect region, and he grew up speaking this dialect.
It's worth noting that Einstein's spoken German was likely heavily influenced by the various dialects he encountered throughout his life, as he moved frequently. However, Swabian is considered his primary dialect.