2 options
also, your all music playlist is doing exactly that (all music).
but what you seem to want is (all music that I have not heard recently)
which is not the same thing.
the #2 link will give you an example of how to avoid recently heard music from even being in the playlist.