This is the infamous "Wall".  It is located between King's Cross and Taylor's Square, and surrounds the
East Sydney Technical College, which was formerly a jail.

If someone in the Gay part of Sydney says that he was "sent to the wall", chances are,
he wasn't sent broke in business.  More likely this was the wall he was referring to.