By saving the position of the center point of each object, you can trace the previous position of the objects and predict what the immediate next will be. Here is a small example in the image. Before ...

Command line Python script that 1) directory of images, 2) identifies objects in the image, 3) writes a json document with the identified objects and their position in each image. - future-mine/obj ...