encoder inference Attention-UNet
encoder based TensorFlow implementation for manifold top-k.
- Input
- 2289-dim embedding
- Encoder
- 18 x Attention-UNet with 20 heads
- Output
- rouge-l projection
Training config
optimizer=NAdam, lr=0.655, scheduler=plateau, warmup=1016