The 78-year-old, who was in palliative care for terminal cancer, coached several Olympic and world champion swimmers.
But it took until his final years for his abusive behaviour against girls in the 1970s and 80s to finally catch up with him.
Caine was arrested in 2022 and accused of horrific sexual assaults on several young athletes who trained under him at the Carss Park swimming pool in Sydney's south.
Victims ranged in age form 10 to 16.
Due to his declining health, Caine was excused from answering the allegations directly and never faced trial.
Instead, the case proceeded by way of a special hearing, which in August ended with a District Court judge finding Caine committed 39 acts including rape and indecent assault.
Assaults took place at the pool as well at Caine's home and in his car.
The court heard one of the victims held genuine Olympic and Commonwealth Games aspirations that had been dashed due to Caine's conduct.
One of the victims told the court she was a virgin when she was raped by Caine, and had never been kissed by a boy.
A number of the victims gave evidence they were scared of Caine because of his authority and coaching style.
One of the victims gave a graphic account of having her hands tied, while afterwards remembered seeing a used condom next to the bed.
Caine was due to be sentenced on December 6.
His death on Wednesday was confirmed by court officials.
1800 RESPECT (1800 737 732)
National Sexual Abuse and Redress Support Service 1800 211 028
11°C