IntelliCode Compose: Code Generation using Transformer (Video, ESEC/FSE 2020)
"IntelliCode Compose: Code Generation using Transformer (Video, ESEC/FSE 2020)
Alexey Svyatkovskiy, Shao Kun Deng, Shengyu Fu, and Neel Sundaresan
(Microsoft, USA; Microsoft, USA; Microsoft, USA; Microsoft, USA)
Abstract: In software development through integrated development environments (IDEs), code completion is one of the most widely used features. Nevertheless, majority of integrated development environments only support completion of methods and APIs, or arguments. In this paper, we introduce IntelliCode Compose – a general-purpose multilingual code completion tool which is capable of predicting sequences of code tokens of arbitrary types, generating up to entire lines of syntactically correct code. It leverages state-of-the-art generative transformer model trained on 1.2 billion lines of source code in Python, C#, JavaScript and TypeScript programming languages. IntelliCode Compose is deployed as a cloud-based web service. It makes use of client-side tree-based caching, efficient parallel implementation of the beam search decoder, and compute graph optimizations to meet edit-time completion suggestion requirements in the Visual Studio Code IDE and Azure Notebook. Our best model yields an average edit similarity of 86.7% and a perplexity of 1.82 for Python programming language.
Article: https://doi.org/10.1145/3368089.3417058
Submitted to the conference by Shao Kun Deng on 2020-10-31
Video Tags: Code completion, neural networks, naturalness of software, fse20ind-p75-p, DOI: 10.1145/3368089.3417058
Presentation at the ESEC/FSE 2020 conference, November 8–13, 2020, https://2020.esec-fse.org/
Sponsored by ACM SIGSOFT, https://www.sigsoft.org/
Twitter: / fseconf
Reddit: / esecfse "
ISSTA 2021: Panels Celebrating 30 editions of ISSTA (statements from panel in timeband 1)
ISSTA 2021: Panels Celebrating 30 editions of ISSTA (statements from panel in timeband 3)