Fractal Self-Similarity in Semantic Convergence: Gradient of Embedding Similarity across Transformer Layers
This paper presents a mathematical analysis of semantic convergence in transformer-based language models, drawing inspiration from the concept of fractal self-similarity. We introduce and prove a novel theorem characterizing the gradient of embedding similarity across layers. Specifically, we establ...
| الحاوية / القاعدة: | Fractal and Fractional |
|---|---|
| المؤلف الرئيسي: | |
| التنسيق: | مقال |
| اللغة: | الإنجليزية |
| منشور في: |
MDPI AG
2024-09-01
|
| الموضوعات: | |
| الوصول للمادة أونلاين: | https://www.mdpi.com/2504-3110/8/10/552 |