can you start a sentence with with that being said

That being said you are thinking about this very simplistically. You could use said at the beginning of a sentence in conversatio…