Derby council AI savings plan prompts concern

The council has faced complaints about its existing AI digital assistants Darcie and Ali

A new £7m deal for Derby City Council to use more AI technology in its public services has been signed.

It is estimated the move will save £4m in the 2024-25 financial year, rising to a minimum of £12.25m annually once fully installed.

The Labour-run authority already uses digital assistants Darcie and Ali, saving £200,000 in agency staff costs.

But Conservatives on the council said they were concerned the system would not be 100% reliable.

The use of Darcie and Ali, designed to help website visitors and telephone callers, led to a volume of complaints and the setting up of a "customer focus group" to discuss initial problems.

But the council said staff in three service areas would soon be using "AI co-pilots" to help carry out jobs more effectively.

The first phase, involving adult social care, is expected to be in place in four months, according to the Local Democracy Reporting Service.

AI will be used to review care packages and help staff decide if someone who needs support living at home is receiving the right level of care.

In addition, Darcie and Ali "will be upgraded and expanded to meet the needs of citizens", the council said, and the new technology will be used to process emails more quickly and also recover outstanding debt.

Derby City Council leader Baggy Shanker said: "Derby City Council is a trailblazer in using AI, and we will always make sure the needs of all our citizens are at the heart of this project.

"New advances bring risks, which we will manage, but also some incredible opportunities to deliver the best outcomes for our citizens in a more efficient and cost-effective way."

But Conservative group deputy leader Jonathan Smale said the complaints about Darcie and Ali should give pause for thought.

"I have grave concerns on the use of AI in social care because we're talking about vulnerable people who need support and care," he said.

"The system has to be 100% effective if we're going to trust AI to help deliver any health packages or care support to those who need it, we can't afford for mistakes in this area when lives could be at risk.

"I have yet to be demonstrated any confidence in its deliverability."