What does this mean?

Remember those walls I built
Well Baby they're tumbling down
And they didn't even put up a fight
They didn't even make a sound