Multisite: Backend Site is not changing site when a differen

For some reason, in the backend, my multisite is not allowing me to change to a different site when I select a different one in the drop down in the upper right. It will always stay on the site I logged in with. If I login from a url from a different site it will show me the backend items for that site only.


Is there some setting that would cause this behavior and restrict the backend to the site that goes with the url?