I've been in leadership roles for the past 6 years and absolutely love my job and find it very rewarding. It wasn't always like that and for the first half of my career I was miserable a lot of the time. Sometimes to the point where I would experience horrible anxiety on Sunday just knowing I had to go into the office on Monday and work in my pointless job.
What changed everything for me was the discovery of stoicism. Once I grasped the concept that noone can control how I feel about something I felt so free. I just stopped viewing work so negatively and would see the positive in it. The idea that you will just eliminate stress by changing careers is good in theory but the ultimate source of the stress is from within. You are the one allowing yourself to feel that way about your job.
I am also a big believer in the concept of job fit in regards to organizational behavior. So quitting to find a job that is a better fit is probably a more appropriate goal than just to reduce stress.
Life is way too short to be miserable in work of life. There's no better time to make a change than when you're ready.