From my experience, it could depend on what strain you smoke. Some will relax and some will, well, spark anxiety or the like. I used to wake and bake. Never had anxiety or worry much. Once, I remember smoking some strong 70/30 kush (or something like that) and watching a street fight... made my heart pound through my chest and I passed out for 2 mins. After that I was always careful what, when and where I smoked. However, I havn't smoked at all since my first child... I always want to be sharp in case I'm needed. I don't miss it.
You'll be happy to hear that on average, even after decades of heavy use, lost brain volume is regained within 29 months after cessation. The exception are those who used heavily as teenagers, in which case a certain an amount of loss, about 8 IQ points worth on average, appears permanent.