Imagine a world where walls are capable of cognitive thought. But don't act on it. You can think about it as much as you want, but you can never act on this thought. You understand that you can think about this thought, but you also understand that you can't do anything to act on this thought. Pretty annoying right? That's exactly how it would feel to be a wall capable of cognitive thought. Prove me wrong.
I'm pretty sure this has been done in sci-fi many times, with various inanimate (or immobile) objects capable of advanced cognitive thought, and yet completely unable to act on those thoughts or change the environment around them. It gets into themes of existential dread, suffering, and/or agony, so I hope that no universe ever has this sort of situation. It's pretty horrifying to think about, all told.
You know you're right, standing around all day only being able to think about thinking is indeed annoying.
That sounds like torture to be a wall... think of all the random insects that climb up against them, people who pin nails to hang things on them, even the occasional slam or rage punch through the wall would probably make them internally scream in agony. This is a PSA for Wall Mental Wellness.