Business locked in expensive AI 'arms race'

"Fear and greed" is driving investment in AI says Jon Collins

There’s no doubt we’re in an AI arms race says Jon Collins.

He’s worked in IT for 35 years in various roles, including as a software programmer, systems manager and chief technology officer.

He’s now an industry analyst for research firm Gigaom.

The current arms race was spurred by the launch of ChatGPT at the end of 2022, says Mr Collins.

Since then, many such generative AI systems have emerged, and millions of people use them every day to create artwork, text or video.

For business leaders the stakes are high. Generative AI systems are very powerful tools that can digest more data in minutes than a human could in several lifetimes.

Suddenly company leaders are aware what AI could allow them, and their competition, to achieve, Mr Collins explained.

“Fear and greed is driving it,” he says. “And that creates an avalanche of momentum.”

With the right training a customised AI system could allow a company to leap ahead of its rivals with a research breakthrough, or by cutting costs by automating work currently done by humans.

In the pharmaceuticals sector, firms are customising AI to help them discover new compounds to treat disease. But it’s an expensive process.

“You need data scientists, and you need model engineers,” explains Mr Collins.

Those scientists and engineers need to understand, at least to some extent, the area of pharmaceuticals that the AI will be working in.

And it does not stop there. “You need the infrastructure engineers that can build your AI platforms,” he continues.

Such highly skilled workers are not easy to come by.

There are just not enough people who “understand how to make these systems, how to make them really perform, and how to solve some of the challenges going forward,” says Andrew Rogoyski, director of innovation at the Surrey Institute for People-Centred AI at the University of Surrey.

Salaries for those who can tackle these challenges have hit “ludicrous” levels, he adds, because they are so important.

“We could produce hundreds of AI PhDs, if we had the capacity, because people would give them jobs.”

AI developers can command "ludicrous" salaries

Beyond the skills shortages, just gaining access to the physical infrastructure needed for large scale AI can be a challenge.

The sort of computer systems needed to run an AI for cancer drug research would typically require between two and three thousand of the latest computer chips.

The cost of such computer hardware alone could easily come in at upwards of $60m (£48m), even before costs for other essentials such as data storage and networking.

Part of the problem for business is that this kind of AI has appeared rather abruptly. Previous technology, like the emergence of the internet, was built up more slowly.

A big bank, pharmaceutical firm or manufacturer might have the resources to buy in the tech it needs to take advantage of the latest AI, but what about a smaller firm?

Italian start-up Restworld is a recruitment website for catering staff, with a database of 100,000 workers.

Chief technology officer Edoardo Conte was keen to see if AI could benefit the business.

The firm considered building an AI-driven chatbot to communicate with users of the service.

But Mr Conte said that, across thousands of users, “The cost grows very much.”

Instead, it looked at a narrower problem – the issue that candidates don’t always present their experience in the best way.

For example, a candidate might not list waitering as a skill. But the algorithms Mr Conte developed make it easier to uncover additional information, including whether they had applied for and gained a waiting role in the past.

“The AI can deduce that they’re a waiter, or they might be interested in other waiter job offers,” he says.

One roadblock in hospitality recruitment is getting candidates to the interview stage.

So, Mr Conte’s next challenge is to use AI to automate and customise the interview process for its candidates.

The AI might even conduct a “conversation” with candidates and produce summaries to pass onto recruiters.

It might speed up the whole process, which currently can take days, in which time a waiter or chef might have found another job.

Edoardo Conte has been developing an AI for Italian start-up Restworld

In the meantime, larger firms will continue to pour cash into AI projects, even if it’s not always clear what they’re likely to achieve.

As Mr Rogoyski says, the adoption of AI is in a “Darwinian, experimental phase,” and it’s difficult to see what the consequences will be.

“That's where it gets interesting. But I kind of think that we have to go with it,” he says, before adding “I'm not sure we get a choice.”