Comment by amelius

Perhaps we can even do away with transformers and use a fully connected network. We can always prune the model later ...