← All problems
Illustration by IOAI Training
🇺🇸 USA USAAIO 2026, Round 2
Linear Attention Is All You Need
✍️ Solved by us
Derive and implement linear attention with relative positional encoding and use it in a transformer for FordA time-series classification.
- Statement
- English
- To hand in
- A predictions file and the notebook that makes it
- Hardware
- Needs a GPU (free Colab works)
- Data type
- 📈 Time series, ✍️ Written questions
- Estimated difficulty
- ★★★☆☆
- Correction
- Our worked correction · best opened after you have tried
Get ready on the platform
The chapters of the learning path that prepare for this problem.
These chapters are picked from the solution: showing them may hint at the approach.
›How to tackle it
- Read the statement. What to hand in, the metric that scores you, the time and hardware limits.
- Explore the data. Size, format, missing values, how the labels are spread.
- Score yourself first. Keep part of the training data aside to measure your work before submitting.
- Start simple, then improve. A first solution that works end to end, then one change at a time.
- Compare with a solution. Once you have searched, open it and see what you would have done differently.
The statement, data and solutions belong to their authors; we only link to them.
Are you the author or organiser? Ask for a correction or removal