> This league played with five minute negotiation turns; these time controls all... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

mkagenius on Nov 22, 2022 | parent | context | favorite | on: CICERO: An AI agent that negotiates, persuades, an...

> This league played with five minute negotiation turns; these time controls allowed games to be completed within two hours. Cicero ranked in the top 10% of participants who played more than one game and 2 nd out of 19 participants in the league that played 5 or more games. Across all 40 games, Cicero 's mean score was 25.8%, more than double the average score of 12.4% of its 82 opponents. As part of the league, Cicero participated in an 8-game tournament involving 21 participants, 6 of whom played at least 5 games. Participants could play a maximum of 6 games with their rank determined by the average of their best 3 games. Cicero placed 1st in this tournament.

Seems too low amount of data to conclude anything?

erehweb on Nov 22, 2022 | [–]

Winning a tournament and good average scores means that we can conclude that Cicero is not an appalling player - reasonable to say it's human level.

spunker540 on Nov 22, 2022 | [–]

It is small I agree. It I think it’s like if a chess engine wins against a grandmaster a handful of times, it’s enough data to know that it works.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact