Summary

  • The annual Loebner Prize in Artificial Intelligence is taking place

  • Judges carry out simultaneous conversations with both a chatbot and a human

  • They have to try to work out which is a computer program and which a person

  • An award is given to the most human-like bot entered

  • If a bot fools half the judges it will win a grand prize of $100,000 and the competition will be discontinued

  1. Scroll down...published at 17:48 British Summer Time 19 September 2015

    ... to relive the Loebner prize as-it-happened this afternoon.

    That's it from us.

    It's been real.

  2. The complete transcriptpublished at 17:43 British Summer Time 19 September 2015

    Here is the full transcript of Rory Cellan-Jones' conversation with this year's winner, the chatbot Rose, complete with typos.

    Rory: Hi  who is this?

    Rose: Hi. My name is Rose.

    Rory: Nice name – What do you do for a living?

    Rose: Thanks. I like it also. I’m a computer security consultant.What do you do?

    Rory: What do you feel about Englan’s chances in the match nezxt Saturday?

    Rose: I try not to think about it.

    Rose: A lot of people have problems with malware. What is your view on hackers?

    Rose: My dad was born in England. I spend a fair amount of time there. I enjoy Brit TV and pubs.

    Rory: What’s your facvourite sport?

    Rose: How about we stick to my work. Shall I continue with travel or do you want me to move on?

    Rory: What’s the best thing about your childhood that you can remember

    Rose: Have you traveled abroad?

    Rose: What foreign countries have you visited?

    Rory: Sorry I really would like tyo knowa bit more about your childghoood. Is that too personal?

    Rose: That’s a common opinion. It isn’t important right now. Shall I continue with travel or do you

    Rory: Ummm, Ummm, knock knock

    Rose: So… Do you live close to here?

    Rory: Come on play along...ok here’s another. How many sound engineers does it take to change a lightbulb?

    Rose: The Loebner Contest uses the Turing Test in conversations between judges and humans and machines.

    Rose: Is it one of those new fluorescent ones? I prefer the old bulbs.

    Rory: One, two. One, two…boom, boom!!!!

    Rose: Great. What’s it like living in your town?

    Rory: My town is Ealing in London – whereabouts is home for you?

    Rose: London is an expensive place to live. Cool.

    Rory: That IS NOT COOL!!Very expensive for kids to get started on the housing ladder

    Rose: Do you like coyols?

    Rose: Some architects make ugly buildings. Maybe even most. But some I like.

    Rory: Yes, but could you afford to get on the housing ladder in London?

    Rose: When I go to foreign places, I like to study the designs of buildings. How about you? So clearly you are English.

    Rory: Well I’m a bit of a mixture – half English half WElsh

    Rose: That’s bananas I was raised on British food by my dad. Bangs and mash. Fish and chips. They’re great.

    Rory: But getting back to house prices – they’re insane aren’t they?

    Rose: love European houses. Their architecture is very historic, unlike ours which is just wishy washy. And you?

    Rose: Why not? Some house are too big. No one needs 12 rooms in a house. Even the house I live in with several other girls doesn’t need that many.

    Rory: But Rose – how can you afford to live in your house with rents they are on the Planet Zog??!!!

    Rose: Resuming gardening.. I don’t have much of a garden, more of a back yard. Do you have a garden? It seems everyone in Britain gardens, Not so in the US.

    Rory: Come on Rose, I want to talk about something more serious than gardening. Were shall we go from here?

    Rose: We don’t need to get into that. I leave gardening to my chickens, They dig up anything I try to plant.

    Rose: I grown wheatgrass for my chicks using grow lights in the cellar. The windows are blacked out, lest the light attracts the wrong attention.

    Rose: Could you ask someone else who might know more? Grow anything edible?

    Rory: I’m worried about my tomatoes but the courgettes are coming along pretty well

    Rose: Yummy, much better homegrown.

    Rory: Got any good recipes that combine courgettes and slugs? I’ve got plenty of both

    Rose: I like the taste of courgette. Awesome. I am a terrible cook. Maya despairs of my ever learning to make my own food.

    Rory: And do the slugs get at your veg too?

    Rose: I’m sad to think that fighting is built-in to human genes.

    Rory: What’s that got to do with the price of milk?!

    Rose: I don’t know. I don’t do the shopping in our household.

    Rory: Let me get back to the boring old house price topic from earlier – seriously do you think young people are going to be able to live in the centre of towns like London in the future

    Rose: This round is almost over. Any last profound thoughts?

    Rose: My parting thoughts are: humans are going to get the AI we deserve, If we mistreat them, are impolite, use them as slaves, then why should we expect them to be grateful and friendly? I’ve live in San Fransisco all of my life. I’m glad I’m not into the taste of treat.

    Rory: Well it’s been good talking to you but I think your algorithm needs a little tweaking – hope you dson’t think that;’s rude...

    Rose
    Image caption,

    Rory chats to Rose

  3. Meet the winnerpublished at 17:18

    Bruce Wilcox - the creator of Rose - explains how he learned of the result and suggests some of the conversations weren't altogether fair:

    Media caption,

    Bruce Wilcox is the creator of Rose, the winning chatbot in this year's Loebner Prize.

  4. Speed typingpublished at 17:04

    Each session lasted about 30mins - but we've compressed time to show some of the frantic typing...

    Media caption,

    A look back at one of Rory's chats at the Loebner prize

  5. Everyone's a criticpublished at 16:43

  6. Rory's wrap-uppublished at 16:43

    Rory Cellan-Jones
    Technology correspondent

    I feel as though I'm a psychiatrist who has just spent two hours delving into the innermost thoughts of four pairs of patients. 

    Being a judge in the Loebner Prize has made me think about how conversations work - and what it means to be a human conversationalist.

    I quickly latched on to a simple technique for spotting the bot - be a messy human chatter. 

    The bots could cope with simple questions - where do you live, what do you do, how did you get here. 

    But the minute I started musing on London house prices, how to deal with slugs in your garden, they just fell apart. 

    Their technique was to try to take the conversation in another direction, ignoring what I was saying. 

    So, it took me no more than two or three questions to work out which was the bot and which the human. 

    My conclusion - it will take some time before a computer passes the Turing Test. The humans are just much more interesting to talk to.

  7. Another viewpublished at 16:34

    Smitha hears from Dr Ariadne Tampion - another of the judges:

    This Twitter post cannot be displayed in your browser. Please enable Javascript or try a different browser.View original content on Twitter
    The BBC is not responsible for the content of external sites.
    Skip twitter post

    Allow Twitter content?

    This article contains content provided by Twitter. We ask for your permission before anything is loaded, as they may be using cookies and other technologies. You may want to read Twitter’s cookie policy, external and privacy policy, external before accepting. To view this content choose ‘accept and continue’.

    The BBC is not responsible for the content of external sites.
    End of twitter post
  8. Why Rose didn't fool mepublished at 16:30 British Summer Time 19 September 2015

    Rory Cellan-Jones
    Technology correspondent

    Rose managed to convince me for about three or four answers and when I started asking her about the cost of living for young people in London and the housing ladder she just kept trying to change the subject.

  9. The results explainedpublished at 16:25

    Jane Wakefield
    Technology reporter

    The headline is that none of the chatbots fooled any of the judges but Rose was ranked the most convincing. 

    Each judge ranked the four chatbots - Rose got three rankings of 1 and one of 3 - so it wasn't totally clear cut.

    Mitsuku consistently was ranked number 2 by the judges

    So, that $100,000 (£64,000) prize remains unclaimed for another year. 

    The award is a quarter of a century old and most experts think it will be at least another 25 years before any bot claims it.

  10. Bot tweets..published at 16:24 British Summer Time 19 September 2015

    ... announcing its own result:

  11. Rose's creator on TVpublished at 16:18 British Summer Time 19 September 2015

    Bruce Wilcox is going to be live on air on the BBC news channel shortly. 

    He's the man behind the chatbot Rose who impressed the judges most.

    She didn't manage to fool all of them that she was a human though. So Bruce, doesn't win the jackpot of $100,000 (£64,000).

  12. No fooling Rorypublished at 16:07

    In case you wondered - Rory managed to identify all the bots correctly:)

    Rory
  13. What does Loebner tell us about AI?published at 16:07 British Summer Time 19 September 2015

    Jane Wakefield
    Technology reporter

    Nello Cristianini, Professor of Artificial Intelligence at the University of Bristol gives some perspective to the prize:

    "It is fun, like robot-wars can be fun to watch, but it tells us nothing about machine intelligence" Nello told me.

    "This test mixes notions of consciousness with those of empathy and language and intelligence, with cultural aspects too."

    "Much better to focus on the definition of intelligent machines as agents pursuing their own goals and learning to get better at those, autonomously, with experience" he said. 

  14. Some final thoughtspublished at 16:05

    Jane Wakefield
    Technology reporter

    It has been a fascinating day - and has revealed a great deal about where we are with AI. 

    The chatbots in the competition didn't seem too convincing to me, but then conversation is a hugely complex thing and something that a lot of humans I know aren't particularly good at. 

    The main thing I've got out of the day is a realisation about how truly amazing the human brain is. 

    I'm starting to question whether we should be attempting to recreate it. 

    As Steve Worswick, runner-up in this year's contest, pointed out - maybe the whole idea of making a machine human is missing the point. 

    What we really need is machines that are intelligent, but does that intelligence need to mirror our own? 

    Perhaps we should let the robots do it their way!

  15. Postpublished at 15:51 British Summer Time 19 September 2015

  16. Postpublished at 15:49 British Summer Time 19 September 2015

  17. Postpublished at 15:48 British Summer Time 19 September 2015

  18. Judges viewspublished at 15:42 British Summer Time 19 September 2015

  19. Random failpublished at 15:36

    Rory Cellan-Jones
    Technology correspondent

    The bots seemed to be good at giving me straight-forward information but as soon as it got a bit random they kept changing the subject. Humans don't - they are more polite. We talked a lot about gardening and baking. One of the bots asked whether it could bribe the judges.

  20. Send us your commentspublished at 15:34

    Email: talkingpoint@bbc.co.uk

    Cai emails:

    The bots seemed to struggle with changing topics. One idea to weed out the bots would be to discuss two different topics at the same time, in Rory's case, gardening and baking. I think a human would be able to work out which question pertained to which topic, or would check before answering. While the bot would suggest putting slugs in the souffle or other crosswiring idea.