From one tower to a whole spread
At the end of the year of the Norman Conquest, work began on this riverside. The name that remains is the White Tower that William had built in 1078 — square, thick-walled, small-windowed, with a small turret at each corner. It was both a residence and a mark pressed onto the city; the locals were not necessarily glad to see it.
Over the next hundred-odd years, Richard I, Henry III and Edward I kept expanding outward, turning the curtain into inner and outer rings with a moat beyond. So 'Tower of London' names a whole complex, not a single tower; the White Tower, ringed again and again, became the innermost room.
From across the river the nested layers read most clearly: the low outer wall by the water, the inner towers rising higher, and that pale square tower a notch above. Inside the grounds it's easy to lose your bearings, because each expansion turned the old boundary into an inner wall.