The full code of the DQN-CRLMM program is MDP_Graph.py. It is built on the knowledge and programs of the previous chapters and previous sections of this chapter.
The DQN-CRLMM contains three components:
- A CRLMM convolutional network that will analyze each frame it receives from the webcam that is located right over the pieces of garment packs on the conveyor belt coming from the cutting section.
- An optimizer using a modified version of the Z(X) described before that plans how the assembly stations will be loaded in real-time.
- An MDP that will receive the input of the optimizer function and schedule the work of the assembly stations. It also produces the modified Z(X) updated value of the weights of each assembly station for the next frame.
In the physical world, the conveyor belt transports the garment packs, a picture (frame) is taken every n seconds...