Blogs (9) >>
Sun 30 October - Fri 4 November 2016 Amsterdam, Netherlands
Thu 3 Nov 2016 16:05 - 16:30 at Matterhorn 1 - Program Modeling and Learning Chair(s): Ondřej Lhoták

In this paper we introduce a new approach for learning precise and general probabilistic models of code based on decision tree learning. Our approach directly benefits an emerging class of statistical programming tools which leverage probabilistic models of code learned over large codebases (e.g., GitHub) to make predictions about new programs (e.g., code completion, repair, etc).

The key idea is to phrase the problem of learning a probabilistic model of code as learning a decision tree in a domain specific language over abstract syntax trees (called TGen). This allows us to condition the prediction of a program element on a dynamically computed context. Further, our problem formulation enables us to easily instantiate known decision tree learning algorithms such as ID3, but also to obtain new variants we refer to as ID3+ and E13, not previously explored and ones that outperform ID3 in prediction accuracy.

Our approach is general and can be used to learn a probabilistic model of any programming language. We implemented our approach in a system called Deep3 and evaluated it for the challenging task of learning probabilistic models of JavaScript and Python. Our experimental results indicate that Deep3 predicts elements of JavaScript and Python code with precision above 82% and 69%, respectively. Further, Deep3 often significantly outperforms state-of-the-art approaches in overall prediction accuracy.

Thu 3 Nov

15:40 - 17:20: OOPSLA - Program Modeling and Learning at Matterhorn 1
Chair(s): Ondřej LhotákUniversity of Waterloo
splash-2016-oopsla147818400000015:40 - 16:05
Friedrich SteimannFernuniversität, Jörg HagemannFernuniversität in Hagen, Bastian UlkeFernuniversität in Hagen
DOI Media Attached
splash-2016-oopsla147818550000016:05 - 16:30
Veselin RaychevETH Zurich, Switzerland, Pavol Bielik, Martin VechevETH Zurich
splash-2016-oopsla147818700000016:30 - 16:55
Shaon BarmanUC Berkeley, Sarah ChasinsUniversity of California, Berkeley, Rastislav BodikUniversity of Washington, USA, Sumit GulwaniMicrosoft Research
DOI Media Attached
splash-2016-oopsla147818850000016:55 - 17:20
Konstantin WeitzUniversity of Washington, Doug WoosUniversity of Washington, Emina TorlakUniversity of Washington, Michael D. ErnstUniversity of Washington, Arvind KrishnamurthyUniversity of Washington, Zachary TatlockUniversity of Washington
DOI Media Attached