Likely does not exist.
Mississippi started requiring birth certificates in 1912. General compliance was not achieved until 1921.
However, some counties may have earlier birth records. If they exist, they would be filed with the specific county, and not the state.