Publications

2020

1. Aske Plaat:
   Learning to Play: Reinforcement Learning and Games, February 2020, forthcoming
2. Sebastian Risi, Mike Preuss:
   From Chess and Atari to StarCraft and Beyond: How Game AI is Driving the World of AI. KI 34(1): 7-17 (2020)
3. Mike Preuss, Sebastian Risi:
   A Games Industry Perspective on Recent Game AI Developments. KI 34(1): 81-83 (2020)
4. Lena Clever, Dennis Assenmacher, Kilian Müller, Moritz Vinzent Seiler, Dennis M. Riehle, Mike Preuss, Christian Grimme:
   FakeYou! – A Gamified Approach for Building and Evaluating Resilience Against Fake News. MISDOOM 2020

2019

1. Marcello A Gómez Maureira, Isabelle Kniestedt, Max J Van Duijn, Carolien Rieffe, Aske Plaat:
   Shinobi Valley: Studying curiosity for virtual spatial exploration through a video game,
   Annual Symposium on Computer-Human Interaction in Play , page 421-428, Barcelona, Spain, October 22 – 25, 2019
2. Hui Wang, Michael Emmerich, Mike Preuss, Aske Plaat:
   Policy or Value? Loss Function and Playing Strength in AlphaZero-like Self-play,
   SSCI, China, 2019
3. Hao Wang, Michael Emmerich, Mike Preuss, Aske Plaat, Thomas Back:
   On the Potential of Evolution Strategies for Neural Network Weight Optimization
   in: GECCO 2019, Prague, 2019
4. Sheir Yarkoni, Hao Wang, Aske Plaat, Thomas Back:
   Boosting Quantum Annealing Performance using Evolution Strategies for Annealing Offsets Tuning,
   First International Workshop on Quantum Technology and Optimization Problems (QTOP’19), March 18-21, Munchen, Germany, 2019
5. Antonios Liapis, Georgios N. Yannakakis, Mark J. Nelson, Mike Preuss, Rafael Bidarra:
   Orchestrating Game Generation. IEEE Trans. Games 11(1): 48-68 (2019)
6. Raphael Patrick Prager, Laura Troost, Simeon Brüggenjürgen, David Melhart, Georgios N. Yannakakis, Mike Preuss:
   An Experiment on Game Facet Combination. CoG 2019
7. David Churchill, Mike Preuss, Florian Richoux, Gabriel Synnaeve, Alberto Uriarte, Santiago Ontañón, Michal Certický:
   StarCraft Bots and Competitions. Encyclopedia of Computer Graphics and Games 2019
8. Santiago Ontañón, Gabriel Synnaeve, Alberto Uriarte, Florian Richoux, David Churchill, Mike Preuss:
   RTS AI Problems and Techniques. Encyclopedia of Computer Graphics and Games 2019

2018

1. Hui Wang, Michael Emmerich, Aske Plaat:
   Assessing the Potential of Classical Q-learning in General Game Playing,
   30th Benelux Conference on Artificial Intelligence (BNAIC 2018), ‘s-Hertogenbosch, Netherlands, 8-9 November 2018 Best Paper Award Regular Paper
2. Thomas M. Moerland, Joost Broekens, Aske Plaat and Catholijn M. Jonker:
   A0C: Alpha Zero in Continuous Action Space,
   ICML/IJCAI/AAMAS 2018 Workshop on Planning and Learning (PAL-18), 15 July, Stockholm, Sweden, Also in: arxiv.org/pdf/1805.09613.pdf, and at European Workshop on Reinforcement Learning, Lille, France, 1-3 October, also at BNAIC 2018, ‘s-Hertogenbosch, Netherlands, November 8-9, 2018
3. Thomas M. Moerland, Joost Broekens, Aske Plaat and Catholijn M. Jonker:
   Monte Carlo Tree Search for Asymmetric Trees,
   ICML/IJCAI/AAMAS 2018 Workshop on Planning and Learning (PAL-18), 15 July, Stockholm, Sweden, Also in: arxiv.org/pdf/1805.09218.pdf, 2018
4. Bas van Boven, Peter van der Putten, Anders Astrom, Hakim Khalafi, and Aske Plaat:
   Real-Time Excavation Detection at Construction Sites using Deep Learning,
   Seventeenth International Symposium on Intelligent Data Analysis (IDA 2018), Den Bosch, Netherlands, 24-26 October 2018
5. Ali Mirsoleimani, Jaap van den Herik, Aske Plaat, Jos Vermaseren:
   Pipeline Pattern for Parallel MCTS,
   ICAART2018, 10th international Conference on Agents and Artificial Intelligence, January 16 – 18, 2018 Funchal, Madeira, Portugal, 2018
6. Ali Mirsoleimani, Jaap van den Herik, Aske Plaat, Jos Vermaseren:
   A Lock-free Algorithm for Parallel MCTS,
   ICAART2018, 10th international Conference on Agents and Artificial Intelligence, January 16 – 18, 2018 Funchal, Madeira, Portugal, 2018
7. Sheir Yarkoni, Aske Plaat, Thomas Back:
   First results solving arbitrarily structured Maximum Independent Set problems using quantum annealing,
   IEEE CEC Congres on Evolutionary Computation, July 8-13, Rio de Janeiro, Brasil, 2018
8. Marwin Segler, Mike Preuss, Mark Waller:
   Planning chemical syntheses with deep neural networks and symbolic AI. Nature, vol. 555, no. 7698, 2018
9. Mike Preuss, Thomas Pfeiffer, Vanessa Volz, Nicolas Pflanzl:
   Integrated Balancing of an RTS Game: Case Study and Toolbox Refinement. CIG 2018
10. Vanessa Volz, Kevin Majchrzak, Mike Preuss:
    A Social Science-based Approach to Explanations for (Game) AI. CIG 2018
11. Vanessa Volz, Mike Preuss, Mathias Kirk Bonde:
    Towards Embodied StarCraft II Winner Prediction. CGW@IJCAI 2018: 3-22

2017

1. Esther Kuindersma, Jelke van der Pal, Jaap van den Herik and Aske Plaat:
   Building a game to build competencies,
   GALA 2017: Games and Learning Alliance Conference, Lisbon, December 5-7, 2017
2. Ali Mirsoleimani, Aske Plaat, Jaap van den Herik, Jos Vermaseren:
   An Analysis of Virtual Loss in Parallel MCTS,
   ICAART2017, 9th International Conference on Agents and Artificial Intelligence, Porto, Portugal, February 2017
3. Ahmed Khalifa, Mike Preuss, Julian Togelius:
   Multi-objective Adaptation of a Parameterized GVGAI Agent Towards Several Games. EMO 2017: 359-374
4. Pieter Spronck, Elisabeth André, Michael Cook, Mike Preuss:
   Artificial and Computational Intelligence in Games: AI-Driven Game Design (Dagstuhl Seminar 17471). Dagstuhl Reports 7(11): 86-129 (2017)

2016

1. Aske Plaat, Jaap van den Herik, Walter Kosters (editors):
   Proceedings of the 9th International Conference on Computers and Games CG2016, June 29-July 1, Leiden, Netherlands, LNCS 10068, Springer Verlag Heidelberg/Berlin, December, 2016
2. Esther Kuindersma, Jelke van der Pal, Jaap van den Herik, Aske Plaat:
   Comparing Voluntary and Mandatory Gameplay,
   International Journal of Serious Games, 3(3), 67-83, October 2016
3. Deepak Soekhoe, Peter van der Putten, Aske Plaat:
   On the Impact of dataset Size in Deep Transfer Learning
   15th International Symposium on Intelligent Data Analysis, IDA2016, Poster presentation, 13-15 October, Stockholm, Sweden, 2016
4. Armon Toubman, Jan Joris Roessingh, Pieter Spronck, Aske Plaat and H. Jaap Van den Herik:
   Rapid Adaptation of Air Combat Behaviour
   Conference on Prestigious Applications of Intelligent Systems 2016, August 31 – September 2, 2016, The Hague, Netherlands, 2016
5. Ali Mirsoleimani, Aske Plaat, Jaap van den Herik, Jos Vermaseren:
   An Efficient Computation Pattern for Parallel MCTS
   Extended Abstract, ICT.Open, Amersfoort, the Netherlands, 2016
6. Ali Mirsoleimani, Aske Plaat, Jaap van den Herik and Jos Vermaseren:
   Ensemble UCT needs High Exploitation,
   ICAART2016, 8th International Conference on Agents and Artificial Intelligence, Rome, Italy, February 2016
   Also in arXiv: 1509.08434, September 2015
7. Michael Buro, Santiago Ontañón, Mike Preuss:
   Guest Editorial Real-Time Strategy Games. IEEE Trans. Comput. Intellig. and AI in Games 8(4): 317-318 (2016)
8. Marlene Beyer, Aleksandr Agureikin, Alexander Anokhin, Christoph Laenger, Felix Nolte, Jonas Winterberg, Marcel Renka, Martin Rieger, Nicolas Pflanzl, Mike Preuss, Vanessa Volz:
   An integrated process for game balancing. CIG 2016
9. Hendrik Horn, Vanessa Volz, Diego Perez Liebana, Mike Preuss:
   MCTS/EA hybrid GVGAI players and game difficulty estimation. CIG 2016

2015

1. Aske Plaat, Jaap van den Herik, Walter Kosters (editors):
   Proceedings of the 14th Advances in Computer Games Conference ACG2015,
   July 1-3, 2015, Leiden, the Netherlands, Lecture Notes in Computer Science LNCS 9525, Springer Verlag, Heidelberg/Berlin, December 2015
2. Shoshannah Tekofsky, Pieter Spronck, Martijn Goudbeek, Aske Plaat, and Jaap van den Herik:
   Past Our Prime: A Study of Age & Play Style Development in Battlefield 3,
   IEEE Transactions on Computational Intelligence and AI in Games, volume 7, number 3, pages 292-303, January 2015
3. Armon Toubman, Jan Joris Roessingh, Pieter Spronck, Aske Plaat, Jaap van den Herik:
   Transfer Learning of Air Combat Behavior,
   IEEE International Conference on Machine Learning and Applications, Miami, FL, December 9-11, 2015
4. Esther Kuindersma, Jelke van der Pal, Jaap van den Herik, Aske Plaat:
   Voluntary Play in Serious Games,
   Games and Learning Alliance conference (GALA 2015), Rome, Italy, December 9-11, 2015
5. Ali Mirsoleimani, Aske Plaat, Jaap van den Herik, Jos Vermaseren:
   Scaling Monte Carlo Tree Search on Intel Xeon Phi,
   21st IEEE International Conference on Parallel and Distributed Systems (ICPADS 2015), Melbourne, Australia, December 14-17, 2015
   Also in arXiv:1507.04383, July 2015
   
6. Taichi Ishitobi, Aske Plaat, Hiroyuki Iida, and Jaap van den Herik:
   Reducing the Seesaw Effect with Deep Proof-Number Search,
   Aske Plaat, Jaap van den Herik, Walter Kosters (eds.), 14th International Conference Advances in Computer Games 2015, 1-3 July, Leiden, the Netherlands, pages 185-197, Springer LNCS 9525, Heidelberg/Berlin, 2015
7. Armon Toubman, Jan Joris Roessingh, Pieter Spronck, Aske Plaat, Jaap van den Herik:
   Rewarding Air Combat Behavior in Training Simulations,
   IEEE International Conference on Systems, Man, and Cybernetics 2015, Special session on Interaction-Centered Analytics and Design for Human-Centric systems, October 9-12, Hong Kong, 2015
   Also extended abstract in BNAIC 2015, November 5-6, 2015, Hasselt, Belgium.
8. Ali Mirsoleimani, Aske Plaat, Jaap van den Herik, Jos Vermaseren:
   Parallel Monte Carlo Tree Search from Multi-core to Many-core Processors,
   13^th IEEE International Symposium on Parallel and Distributed Processing with Applications (IEEE ISPA-15), Helsinki, Finland, 20-22 August, p.77-83, 2015

2014

1. H. Jaap van den Herik, Hiroyuki Iida, Aske Plaat (editors):
   Proceedings of the 8th International Conference on Computers and Games CG2013,
   August 13-15, 2013, Yokohama, Japan, Lecture Notes in Computer Science LNCS 8427, Springer Verlag, Heidelberg/Berlin, August, 2014
2. Ben Ruijl, Jos Vermaseren, Aske Plaat, Jaap van den Herik:
   HEPGAME and the Simplification of Expressions,
   Keynote at the 11th International Workshop on Boolean Problems, Freiberg, Germany, 17-19 September 2014
   Somewhat improved version as: Simplification of Extremely Large Expressions, in Problems and New Solutions in the Boolean Domain, Bernd Steinbach, ed., Cambridge Scholars Publishing, May 2016
   Also in arXiv 1405.6369
3. H. Jaap van den Herik, Jan Kuipers, Jos A.M. Vermaseren and Aske Plaat:
   Investigations with Monte Carlo Tree Search for finding better multivariate Horner schemes,
   Invited Paper, Agents and Artificial Intelligence, Revised Selected Papers, ICAART February 15-18, 2013, Joaquim Filipe, Ana Fred (Eds.), Communications in Computer and Information Science, volume 449, pp. 3-20, Springer, Berlin/Heidelberg, November 2014
   Also Extended Abstract published in BNAIC 2013, 7-8 November 2013, Delft, The Netherlands
4. Ali Mirsoleimani, Aske Plaat, Jos Vermaseren, Jaap van den Herik:
   Performance analysis of a 240 thread tournament level MCTS Go program on the Intel Xeon Phi,
   28th European Simulation and Modelling Conference – ESM’2014, October 22-24, 2014, pp. 88-94, FEUP – University of Porto, Porto, Portugal, 2014
   Also in arXiv.org 1409.4297
5. Armon Toubman, Jan Joris Roessingh, Pieter Spronck, Aske Plaat, Jaap van den Herik:
   Centralized versus Decentralized Team Coordination Using Dynamic Scripting,
   28th European Simulation and Modelling Conference – ESM’2014, October 22-24, 2014, FEUP – University of Porto, Porto, Portugal, 2014
6. Armon Toubman, Jan Joris Roessingh, Pieter Spronck, Aske Plaat, Jaap van den Herik:
   Improving Air-to-Air Combat Behavior Through Transparent Machine Learning,
   Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC), Orlando, FL, December 1-5, 2014
7. Catholijn Jonker, Joost Broekens, Aske Plaat:
   Virtual Reflexes,
   14th International Conference on Intelligent Virtual Agents, pp. 222-231, August 27-29, Boston, 2014
   Also extended abstract in BNAIC 2014, Nijmegen, The Netherlands, 6-7 November 2014
   Also in arXiv 1404.3920
8. Richard Absalom, Dap Hartmann, Marcus Luczak-Rösch, Aske Plaat:
   Crowd-Sourcing Fuzzy and Faceted Classification for Concept Search,
   Collective Intelligence 2014, Massachusetts Institute of Technology, Cambridge, MA, June 10-12, 2014
9. Armon Toubman, Jan Joris Roessingh, Pieter Spronck, Aske Plaat, Jaap van den Herik:
   Dynamic Scripting with Team Coordination in Air Combat Simulation,
   27th International Conference on Industrial, Engineering & Other Applications of Applied Intelligent Systems (IEAAIE-2014), 1, p. 440-449, Kaohsiung, Taiwan, June 3-6, M. Ali, J-S. Pan, S-M. Chen, M-F. Horng (eds.), Modern Advances in Applied Intelligence, Springer, Heidelberg, 2014
10. Ben Ruijl, Jos Vermaseren, Aske Plaat, Jaap van den Herik:
    Combining Simulated Annealing and Monte Carlo Tree Search for Expression Simplification,
    Proceedings of International Conference on Agents and Artificial Intelligence 2014 (ICAART2014), Angers, France, pages 724-731, March 6-8, 2014
    Also in arXiv 1312.0841, December 4, 2013
    Also extended abstract in BNAIC 2014, Nijmegen, The Netherlands, 6-7 November 2014

2013

1. Jan Kuipers, Aske Plaat, Jos Vermaseren, and Jaap van den Herik:
   Improving multivariate Horner schemes with Monte Carlo tree search,
   Computer Physics Communications, volume 184, number 11, pages 2391-2395, 2013
   Also in arXiv 1207.7079 July 2012
2. Shoshannah Tekofsky, Pieter Spronck, Aske Plaat, Jaap van den Herik and Jan Broersen:
   Play Style: Showing Your Age,
   Proceedings of the IEEE Conference on Computational Intelligence in Games (CIG2013), p. 1-8, 11-13 August 2013, Niagara Falls, Ontario, Canada, 2013
3. Mohamed Abbadi, Francesco Di Giacomo, Giuseppe Maggiore, Aske Plaat, Renzo Orsini and Pieter Spronck:
   Resource Entity Action: A generalized design pattern for RTS games
   Proceedings of the 8th International Conference on Computers and Games (CG2013), 13-15 August 2013, Yokohama, Japan, LNCS 8427 Springer Verlag, Heidelberg/Berlin, 2014
4. Shoshannah Tekofsky, Pieter Spronck, Aske Plaat, Jaap van den Herik and Jan Broersen:
   PsyOps: Personality Assessment Through Gaming Behavior,
   Proceedings of the 8th International Conference on the Foundations of Digital Games (FDG2013), p. 166-173, Chania, Crete, Greece, 14-17 May 2013 and BNAIC2013, extended abstract, Delft, The Netherlands, November 8, 2013
5. H. Jaap van den Herik, Aske Plaat, Jan Kuipers and Jos Vermaseren:
   Connecting Sciences,
   Keynote at The 5th International Conference on Agents and Artificial Intelligence (ICAART 2013), Volume 1, pages IS-7 to IS-16, Barcelona, Spain, February 15-18, 2013