Dunno if it's a bug or feature but it seems like the more you let it train, the more apt it is to fall back to going in circles and not scoring as a strategy. "The Only Winning Move."

Cool project!

I noticed that if you go from training to watch and then back, the training temporarily drop significantly in score.

More details and implementation notes please?