초록: A transformer is a neural network architecture widely adopted in models such as GPTs. We apply transformer models to predict Frobenius traces $a_p$ of elliptic curves, given other traces $a_q$. Our experiments reveal that these models achieve high accuracy, even without relying on explicit number-theoretic tools. We also present preliminary findings on model interpretability.