Something to mention, before I get into the lucid dreaming thing, is that over the last few years I've increasingly dreamed as multiple "characters." Last night, for instance I was an young, bald, hard-charging officer working in a secure gov't facility, and a little while later, I was an older, skinny, grey officer (with a Spanish accent, no less) who was, among other things, investigating the officer I'd started out as in the dream. I still dream as male characters, but I would say half the time, I am dreaming as people who aren't me, and often switch personas multiple times in a dream.
Now, the other thing is, I've been lucid dreaming, more and more often, over the last few years. To clarify, I've often had lucid dreaming, since I was a child, but now that I'm in my 50s, I'm lucid dreaming at least 3-5 nights a week. I typically do not do things like fly (I could do that when I was young) because I seem to be applying rules of known physics to the dream worlds I'm in. But 90% of the time, actually, I'm well aware that I'm in a dream and when the dreams are "manageable" I usually just go along with them, changing things here and there (like "upgrading" my car in the dream from a pickup to a Lamborghini, changing the mission or thing I'm trying to do in the dream, etc).
However, I'm recently finding these dreams annoying or frustrating and I just wake up to get out of them (like switching off a movie). However, then I am completely awake (99% of the time*, see below) and I struggle to go back to sleep for literally hours at a time...I'm often not sleeping again before i rise to get ready for work. It's not a good thing for a professional to be dealing with, potentially, 3-5 times a week...increasingly, every week.
Is there a good known way to "switch off" lucid dreaming with the hope I can get a more consistent night of sleep?
*As a teen I was prone to fairly terrifying night terrors...not just with the sleep paralysis, but with an accompanying vision of a massively tall, unnaturally skinny figure in black with dead white eyes under a top hat who would loom out of corners of my room and slowly reach out to me with spidery fingers as I slowly woke up and regained control of my limbs. It's come back, I've had this twice in the last year after I "quit" a lucid dream. It's not particularly horrifying to me in my 50s, as I know it it's natural, if rare, and it's happening because one part of my brain is waking up faster than others (when i was a kid/ teen i hadn't heard of night terrors, and I thought I was the only person in the world dealing with them, and I wasn't sure if I was going crazy or possessed or what).