Have you considered lightening up on yourself? Not expecting perfection? Just enjoying the process not the end result?
The older I get (and the sicker I get) the more I am focused on the enjoyment of simply being able to sit down at the piano and play. I'll NEVER be great. I'll never be good in the eyes of others. But what I know is that every time I sit down at the piano, I am in love. I am passionate. I am in a good spot.
I am so grateful for the woman who gave me a piano 5 years ago and that I had the determination to finally start what I'd wanted to do since childhood. Learn to play the piano.
Whether I hit the right notes, whether I remember to place my hands gracefully, whether I remember the dynamics.......I know I am in love with the process. The results come and go depending upon the day. But the joy is there always. And that's my benchmark.
To clarify, I'm only speaking for me and where I am in life. I DO connect with your frustrations. And, I have been known to put pieces away and do it so quietly that my teacher doesn't even know it missing from our lessons. LOL (I'm tricky that way).
Only you can decide and neither option is right or wrong. Go with your gut.