We used to perform the Friday prayer with the Messenger of Allah (may Allah's peace and blessings be upon him) and leave at a time when the walls had no shadow that we could take as shelter

Salāmah ibn al-Akwa‘ (may Allah be pleased with him) mentioned that they used to attend the Friday prayer with the Prophet (may Allah's peace and blessings be upon him). They used to perform it early to the extent that they would listen to the two sermons, finish the prayer, and go home at a time when the walls had no enough shadow for them to take shelter in.
The second version of the Hadīth states that they used to perform the Friday prayer with the Prophet (may Allah's peace and blessings be upon him) after the sun passes the meridian then they would return to their homes.
Scholars have agreed that the due time of the Friday prayer ends at the same time Zhuhr prayer ends. It is preferable, though, to perform that prayer after the sun passes the meridian because this is what the Prophet (may Allah's peace and blessings be upon him) used to do most of the time. Scholars also unanimously agree on that time. However, it is permissible to perform that prayer just before the sun passes the meridian in case there is a need for that, like in extremely hot weather and there is no shadow to take shelter in, or when people want to set out for Jihad before or around the meridian time.