The worker, aged in his 40s, was helping unload cargo from the unnamed vessel when the incident occurred.
Ambulance Victoria said they treated the man at the scene, but he could not be saved.
Toll spokesman Christopher Whitefield told ABC the company would be conducting a full investigation into the incident.
