Wasn't there myself but a mate of mine did a visit a few years back and said the shadow activity on the fourth floor was unlike anything he'd encountered before. Not your usual peripheral stuff either, he said they were holding solid form for several seconds at a time which is pretty unusual in my experience.
What were the conditions like when you saw them? Temperature, time of night, how many in your group? I always find that stuff useful for working out whether its residual or something more interactive.
There's a theory I've been mulling over that some of these older buildings with a lot of concentrated death and suffering act almost like a kind of battery for this type of manifestation. Waverly obviously has the history to fit that pattern. Did anything seem to react to your presence or was it just doing its own thing regardless of you being there?