• 1 min read
State of Deep Learning for Code Generation (DL4Code)
Machine learning models can now write decent code. Here are a list of key papers and models that address this task.
There have been a set of recent interesting results that apply large language models (e.g., GPT-3) to code generation (a.k.a program synthesis, program generation). The results so far have been competitive and some models have been integrated into developer productivity tools such as GitHub Copilot - an AI pair programming tool that supports programmers live as they write code (hint: it works quite well).
This post seeks to curate a running list of interesting papers, associated models and datasets that have been used to address this task.
Papers and Model Architectures
Several papers and models have been published.
Interested in more articles like this? Subscribe to get a monthly roundup of new posts and other interesting ideas at the intersection of Applied AI and HCI.
Read and Subscribe
Powered by Substack. Privacy Policy.
CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation | Paper Review
AlphaCode: Competition-Level Code Generation with Transformer Based Architectures | Paper Review
2023 Year in Review
Top 10 Machine Learning and Design Insights from Google IO 2021
Recent Breakthroughs in AI (Karpathy, Johnson et al, Feb 2021)
2018 Year in Review
2021 Year in Review