Ключевые слова:
искусственный интеллект, нейронные сети, многоязычие, машинный перевод, когнитивная наука, межкультурная коммуникация, обработка естественного языка, архитектуры ИИ, сравнительный анализ, нейролингвистика.Библиографические ссылки
Coenen, A., Reif, E., Yuan, A., Kim, B., Pearce, A., Viégas, F., & Wattenberg, M. (2019). Visualizing and measuring the geometry of bert. arXiv preprint arXiv:1906.02715.
Consonni, M., Cafiero, R., Marin, D., Tettamanti, M., Iadanza, A., Fabbro, F., & Perani, D. (2013). Neural convergence for language comprehension and grammatical class production in highly proficient bilinguals is independent of age of acquisition. Cortex, 49(5), 1252-1258.
He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770-778).
Holtzheimer, P., Fawaz, W., Wilson, C., & Avery, D. (2005). Repetitive transcranial magnetic stimulation may induce language switching in bilingual patients. Brain and Language, 94(3), 274-277.
Hovy, D., & Yang, D. (2021). The importance of modeling social factors of language: Theory and practice. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (pp. 588-602).
Johnson, M., Schuster, M., Le, Q. V., Krikun, M., Wu, Y., Chen, Z., ... & Dean, J. (2017). Google's multilingual neural machine translation system: Enabling zero-shot translation. Transactions of the Association for Computational Linguistics, 5, 339-351.
Liu, S., Cheng, R., Jia, Y., & Wu, H. (2021). Towards Faithful Neural Table-to-Text Generation with Content-Matching Constraints. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) (pp. 1072-1085).
Liu, Y., Gu, J., Goyal, N., Li, X., Edunov, S., Ghazvininejad, M., ... & Zettlemoyer, L. (2020). Multilingual denoising pre-training for neural machine translation. Transactions of the Association for Computational Linguistics, 8, 726-742.
Morford, J. P., Wilkinson, E., Villwock, A., Piñar, P., & Kroll, J. F. (2011). When deaf signers read English: Do written words activate their sign translations?. Cognition, 118(2), 286-292.
Mu, J., & Andreas, J. (2020). Compositional explanations of neurons. Advances in Neural Information Processing Systems, 33, 17153-17163.
Ruder, S., Peters, M. E., Swayamdipta, S., & Wolf, T. (2019). Transfer learning in natural language processing. In Proceedings of the 2019 conference of the north american chapter of the association for computational linguistics: Tutorials (pp. 15-18).
Stolk, A., Verhagen, L., & Toni, I. (2015). Conceptual alignment: How brains achieve mutual understanding. Trends in Cognitive Sciences, 20(3), 180-191.
Sutskever, I., Vinyals, O., & Le, Q. V. (2014). Sequence to sequence learning with neural networks. Advances in neural information processing systems, 27.
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... & Polosukhin, I. (2017). Attention is all you need. Advances in neural information processing systems, 30, 5998-6008.
Vig, J. (2019). Visualizing attention in transformer-based language models. arXiv preprint arXiv:1904.02679.
Xue, L., Constant, N., Roberts, A., Kale, M., Al-Rfou, R., Siddhant, A., ... & Raffel, C. (2021). mT5: A massively multilingual pre-trained text-to-text transformer. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (pp. 483-498).
Zhou, C., & Keung, P. (2020). Improving Transformer with a Novel Relative Attention and Bidirectional Recurrent Neural Network. arXiv preprint arXiv:2009.07726.
Zhou, W., Ge, T., Xu, K., Wei, F., & Zhou, M. (2021). Scheduled DropHead: A regularization method for transformer models. In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 (pp. 1971-1980).