Do you ever get the feeling that you could/should be doing better at what you're doing or not doing? Like you could/should be doing more than what you're doing? Then, feel guilty when the opportunity to do nothing arises? Give it up! It's all ego. It's all conditioning handed down from our parents, our peers, and it's complete bullshit. Our projection on what we think other people think shapes our insecurities, our feelings of not being good enough. All of that is built on a foundation of lies that you have been feeding yourself all of your life.
You have permission to enjoy downtime and just do nothing. You also have the opportunity to use your downtime to do some inner exploration. Just the act of directing attention inward has a very calming effect. Couple that with an unconditional acceptance to what comes to you and you have a winning combination for inner peace.
InJoy your quiet time when the opportunity arises, and create some inner silence periodically throughout the day. Every second counts, and all there ever is is this second. It's always this second, so what is a second? What evidence is there that seconds exist? A number on a clock changing. There was a land before time not that long ago, where the only evidence of passing time was the movement of the earth. But I digress.