It was always going to be a tough task for Cushing.
The 40-year-old had been out of management since he was sacked by New York City's men's side in November, while he only had four days with the team to prepare for a cup final against England's most dominant team.
Cushing spent more than six years in charge of City previously, winning two League Cups along with the club's first WSL title before leaving in 2020.
The club parted ways with Taylor after a string of disappointing results left City fourth in the WSL, 12 points adrift of Chelsea and at risk of missing out of a Champions League place next season.
An early Chelsea goal was far from ideal on Cushing's return, but his side looked impressive as they controlled possession and pushed forward.
Blocks from Bright and Sandy Baltimore denied Khadija Shaw, while Hampton, who may have been disappointed at conceding at her near post, made a brilliant stop moments after City's leveller to stop Shaw from putting them ahead.
Attention for Cushing will quickly turn to City's next three encounters against Chelsea, starting with the first leg of their Champions League quarter-final on Wednesday.