基于多目标集成剪枝的多样内容在线生成方法

在线生成多样内容是近年来程序化内容生成领域的新兴研究方向之一，不仅可以满足用户的不同偏好进而提升用户体验，也可以为人工智能算法的训练和测试提供海量的场景集和问题集。近期研究提出了基于负相关集成强化学习的多样内容在线生成方法，但此类方法无法有效地匹配不同用户的偏好。此外，训练与部署集成模型中的个体学习器需要消耗大量的计算资源。针对这两个问题，在负相关集成强化学习的框架下，本文提出了基于多目标集成剪枝的多样内容在线生成方法。该方法通过多目标优化算法搜索模型集成的权重，使获得的集成模型不仅能够有效地匹配给定的用户偏好，还能提供权衡模型性能与计算资源消耗的帕累托集。此方法通过调整个体学习器的集成权重来匹配用户需求，而非重新训练个体学习器，因此降低了计算资源消耗。

Online diverse content generation is one of the emergent research directions in the field of procedural content generation in recent years. It can not only meet users' different preferences and enhance user experience, but also provide a large amount of scenarios and problems for training and testing artificial intelligence algorithms. Recent research proposed online diverse content generation methods based on negatively correlated ensemble reinforcement learning, such methods cannot effectively meet the specific preferences of different users. Furthermore, training and deploying individual learning models requires significant computational resources. To address those two issues, this paper proposes an online content generation approach based on multi-objective ensemble pruning, built upon the negatively correlated ensemble reinforce- ment learning framework. This approach searches for the weights for integrating individual learning models through an efficient multi-objective optimization algorithm, so that the obtained ensemble model can not only effectively match us- er preferences, but also offer a Pareto set that exhibits tradeoff between model performance and computational resource consumption. This approach matches user preferences by adjusting the weights of individual learning models instead of retraining models, thereby reducing the computational resource consumption.