Hello all!
I'm working on a couple different games right now, and one thing that I'd really like to be able to do is come up with better estimates for expected game length. From what I can understand, Monte Carlo simulations could provide a lot of data on what games should be averaged at. I know, I could just play the game 1000 times and get the same information, but I'd like to go into playtesting with a bit more info.
Has anyone used a particular tool or program to run Monte Carlo simulations on thier games? If so, did you think it was a good/useful process, or did playtesting invalidate the simulation results?
The entire purpose of the Monte Carlo simulation would be to determine models of possible results by substituting a range of values—a probability distribution—for any factor that has inherent uncertainty. This would functionally provide the equivalent of an AI framework.
I hadn't thought of building out portions of it in Python, which I am familiar with, and a quick google search revealed a wealth of supportive code snippets and math libraries. Hopefully I will be up to the programming task, but if anyone has played with spreadsheet based tools (even ones you pay for) that was more where I was asking for advice or recommendations.
I always find that I need 20-30 playtests before I start seeing all the angles of what people's choices can do to a game. If there is a choice point where people only take that option 5% of the time, I may need even more games before I can really understand the impact of that choice. I'd much rather run 1000 simulations, get an idea for what the upper bounds are, and then play out specific scenarios that emerge as problematic. I'm hoping I can cut the playtests needed to determine very basic information like game time, and use them more to focus on specific gameplay elements.