Remembrance was a serious piece of retcon for the Doctor.
You’re right, there was more than just a Totter’s Lane mention, IM Foreman’s was part of the action, as was (IIRC) Cole Hill School. Certainly, Ace at one point picks up in the science lab the same book that Susan Foreman is reading at the beginning of Unearthly Child.
The whole premise of the episode is that the Doctor returns to Earth in 1963 very shorty after his and Susan’s departure with Ian and Barbara to finish what he started: disposition of the Hand of Omega. Somehow the Daleks and Davros are chasing the Doctor even before he ever met them, A serious reconstruction of the Doctor’s history.
The episode did kick off the 25th Anniversary season.