The apostrophe after "Bachelor" is essential to indicate that it's possessive, showing that the degree belongs to a bachelor.
You can also use the more formal Bachelor of Arts (BA) or Bachelor of Science (BS) to indicate the specific type of degree.