Fix bug where we attempt to attach a child to its parent a second time.  Also only set anim priority when applicable.