2017 Competition Results

Last week, the 2017 Text-Based Adventure AI Competition results were announced at the IEEE Computational Intelligence and Games Conference in New York. The results were:

1st. BYU 2016 Agent - Nancy Fulda, Daniel Ricks, Ben Murdoch, David Wingate. Brigham Young University, USA

2nd. CARL – Nancy Fulda, Daniel Ricks, Ben Murdoch, David Wingate. Brigham Young University, USA

3rd. The Golovin Agent – Bartosz Kostka, Jarosław Kwiecień, Jakub Kowalski and Pawel Rychlikowski. University of Wrocław, Poland

Our winners again this year, was last year’s winning agent that the team from BYU have made available as open source and published at IJCAI.

2nd and 3rd place was a close decision as both agents achieved the same score on our test game. Therefore, we went to our second scoring criteria (a subjective decision by the competition judges on the agent’s freedom from a priori bias) and awarded 2nd place to BYU’s new agent CARL.

Our 3rd place competitor, The Golovin Agent, is also available as open source and was both published and nominated for the best paper award at CIG.

We would like to take this opportunity to publicly thank all competitors for the world-class research they have produced in participating in this competition. In particular we are taking inspiration from the evaluation methods they have used and considering options to adopt similar approaches in future iterations of the competition.

Finally, as shown by the evaluation in both papers and the competition results, there is still significant room for improvement in general text-based adventure AI performance. We hope this competition, the codebases available and the papers published all help to engage more of the game AI community in pursuing this challenging open problem!

2017 Submission Instructions

We’re in to the final two weeks until the competition deadline: August 1st 2017 23:59 UTC-12.

For the submission of agents, please email:

  • all files necessary to run your agent;
  • instructions for executing your agent;
  • a brief (1 page max) document explaining the method you have used.

To: TextAdventureAIComp@gmail.com

The absolute final deadline for the submission of agents is August 1st 2017 23:59 UTC-12. After this date no revisions of agents will be accepted. So it is worthwhile sending us your code earlier, and talking with the team, to ensure that we can run your code as you intend to provide it.

We’re excited to see what you have all been working on!

Competition Announcement

We are proud to announce the 2nd Text-Based Adventure AI Competition will be taking place at the 2017 IEEE Conference on Computational Intelligence and Games at NYU in New York City.

The deadline for the submission of agents is August 1st 2017 23:59 UTC-12. Further details on how to submit will be announced here closer to the deadline.

To get started please visit the Github repo and join the conversation in our Google Group mailing list.

2016 Competition Results and Future Plans

We are pleased to announce the winner of our 2016 competition was the BYU TextPlayer by David Wingate, Daniel Ricks, Nancy Fulda and Ben Murdoch from the Perception Control and Cognition lab at Brigham Young University.

The winning team achieved an impressive score of 18 (out of a maximum 100) on our test environment game, and are considering releasing their agent as open source after publishing their methodology.

The competition team are now considering how best to proceed in 2017 and are keen to hear:

  • if there is enthusiasm from the community for the competition to run again?
  • and about any issues that prevented teams from submitting this year?

Please feel free to comment in reply via the mailing list or directly to the competition organisers at TextAdventureAIComp@gmail.com

Submission Instructions

With just over a week left until the competition deadline, its great to see activity picking up on the Google Group and Github repo!

For the submission of agents, please email:

  • all files necessary to run your agent;
  • instructions for executing your agent;
  • a brief (1 page max) document explaining the method you have used.

To: TextAdventureAIComp@gmail.com

The absolute final deadline for the submission of agents is August 31st 2016 23:59 UTC-12. After this date no revisions of agents will be accepted. So it is worthwhile sending us your code earlier, and talking with the team, to ensure that we can run your code as you intend to provide it.

We’re excited to see what you have all been working on, and look forward to hopefully meeting some of you at the conference!