Dear Jessie,
I was about to enthusiastically advise: “follow your heart!” But then I saw you are a recent mother, which bungs that up a bit. I, for one, have no kids, and that was what allowed me to prioritize my writing career and learn to live with very little money until I start earning more exclusively through writing.
Conclusion? Have never felt happier in my entire life. I worked for YEARS in jobs I despised, also for the money. I ended up crashing and burning because of it, big time.
Am going to finish reading, though, am still not done!