I'm a college admissions representative, so I'm going to put on that hat to answer your question. My advice is DO NOT change your career plans!
First, BFS is managable. It may be annoying, and may be worse when you're stressed, but SOMETHING out there is always going to be stressful. Whether you go to vet school or not, you are still going to have BFS. It's kind of like adults who tell me, "But if I go back to school, I'll be 45 when I graduate." I tell them, well, you're going to turn 45 anyway, with or without the degree.
Secondly, years from now when you look back, if you did not follow your dream, or at least attempt to follow your dream, you'll ALWAYS have regrets and always wonder, "What if . . ."
Find what you love and do it. If you love what you do, you will be a much happier person, and so will those around you. If you end up doing something you never really wanted to do, and dread going to work every day, you will be unhappy and your home and family life will suffer as well. It sounds overly simplisitic, but it's very true.
Good luck in vet school!