My Reinforcement learning playground.

'This grid world is full of thingies that love apples.'

• Thingies can move in the grid in four directions.

• Thingies spend apples to move around.

• From time to time, trees with apples appear in the grid

• Thingies can collect apples from the trees.

• A thingy dies if it has 0 apples.

• Thingies can perform a fixed number of actions each turn.

• The order in which thingies play is randomly chosen.

• No more than one house or tree is allowed in the same spot.

• From time to time, the season switches between summer and winter.
• When is summer, more apples appear in the trees.
• When it is winter, fewer apples appear in the trees.
• When it is winter, and you are not in a house, you are punished in happiness.

• There are houses in the grid. They start as 'Wild' houses
• When a thingy stays in a house, it eats fewer apples.
• A house can hold a maximum number of thingies.

• A thingy can buy a 'Wild' house, paying a one-time fee in apples. The house becomes 'Owned'
• If a thingy stays in an 'Owned' house, pays apples to the owner.

• A thingy can occupy a 'Wild' house gaining 'ownership' proportional to the stay. The house becomes 'Fractional'
• All thingies, owners or not, pay rent in 'Fractional' houses. Paid apples go proportionally to the previous owners.

• Thingies are mortal. There is a probability of death, proportional to their age.

• Thingy's can have little thingies

• Variants:

• In case of death, 'Owned' houses can be inherited by the first child
• In case of death, 'Fractional' houses can be inherited by the first child

• Thingies can plant trees, paying in apples
• Thingies can 'own' the trees they plant
• Thingies can build barricades, paying in apples
• Thingies can give away apples to other thingies

A combination of:

• points each turn the thingy is still alive

• points each turn their offsprings are still alive

• points proportional to gathered apples.

• punishment if they die

The games use ursina engine for rendering.

to install:

pip install git+https://github.com/pokepetter/ursina.git

RL uses ACME

https://github.com/deepmind/ACME

Author: Cristian Vasquez