DevEx in Action: A study of its tangible impacts
Nicole Forsgren, Eirini Kalliamvakou, Abi Noda, Michaela Greiler, Brian Houck, Margaret-Anne Storey
ACM Queue | January 2024, Vol 21(6)
Developer Experience Lab
Publications
Publications
Publications by Year
-
-
The Best of Both Worlds: Unlocking the Potential of Hybrid Work for Software Engineers
Brian Houck, Henry Yelin, Jenna Butler, Nicole Forsgren, Alison McMartin
May 2023
Make Your Tools Sparkle with Trust: The PICSE Framework for Trust in Software Tools
Brittany Johnson, Christian Bird, Denae Ford, Nicole Forsgren, Tom Zimmermann
ICSE SEIP | May 2023
The Impact of AI on Developer Productivity: Evidence from GitHub Copilot
Sida Peng, Eirini Kalliamvakou, Peter Cihon, Mert Demirer
February 2023
Taking Flight with Copilot: Early insights and opportunities of AI-powered pair-programming tools
Christian Bird, Denae Ford, Tom Zimmermann, Nicole Forsgren, Eirini Kalliamvakou, Travis Lowdermilk, Idan Gazit
ACM Queue | January 2023
-
“It would work for me too”: How Online Communities Shape Software Developers’ Trust in AI-Powered Code Generation Tools
Ruijia Cheng, Ruotong Wang, Tom Zimmermann, Denae Ford
December 2022
Understanding Skills for OSS Communities on GitHub
Jenny T. Liang, Tom Zimmermann, Denae Ford
ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) | November 2022
Program-L: Online Help Seeking Behaviors by Blind and Low Vision Programmers
Jazette Johnson, Andrew Begel, Richard Ladner, Denae Ford
IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) | September 2022
ReBOC: Recommending Bespoke Open Source Software Projects to Contributors
Denae Ford, Nischal Shrestha, Tom Zimmermann
IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) | September 2022
Attracting and Retaining OSS contributors with a Maintainer Dashboard
Mariam Guizani, Tom Zimmermann, Anita Sarma, Denae Ford
ICSE 2022 | May 2022
DeepAnalyze: Learning to Localize Crashes at Scale
Manish Shetty, Chetan Bansal, Suman Nath, Sean Bowles, Henry Wang, Ozgur Arman, Siamak Ahari
ICSE 2022 | May 2022
Towards Mining OSS Skills from GitHub Activity
Jenny T. Liang , Tom Zimmermann, Denae Ford
ICSE 2022 | May 2022
-
Technical report
Chandra Maddila, Apoorva Agrawal, Thomas Zimmermann, Nicole Forsgren, Kim Herzig, Arie van Deursen
MSR-TR-2021-28 | October 2021
Published by Microsoft
Developers Who Vlog: Dismantling Stereotypes through Community and Identity
Souti Chattoadhyay, Denae Ford, Tom Zimmermann
ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW) | October 2021
MergeBERT: Program Merge Conflict Resolution via Neural Transformers
Alexey Svyatkovskiy, Todd Mytkowicz, Negar Ghorbani, Sarah Fakhoury, Elizabeth Dinella, Christian Bird, Neel Sundaresan, Shuvendu Lahiri
August 2021
Reel Life vs. Real Life: How Software Developers Share Their Daily Life through Vlogs
Souti Chattopadhyay, Tom Zimmermann, Denae Ford
ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) | August 2021
Leaving My Fingerprints: Motivations and Challenges of Contributing to OSS for Social Good
Yu Huang, Denae Ford, Tom Zimmermann
ICSE 2021 | May 2021
Please Turn Your Cameras On: Remote Onboarding of Software Developers during a Pandemic
Paige Rodeghero, Tom Zimmermann, Brian Houck, Denae Ford
ICSE SEIP | May 2021
Anomalicious: Automated Detection of Anomalous and Potentially Malicious Commits on GitHub
Danielle Gonzalez, Thomas Zimmermann, Patrice Godefroid, Max Schaefer
International Conference on Software Engineering (ICSE), Software Engineering in Practice (SEIP) track | May 2021
DeepMerge: Learning to Merge Programs
Elizabeth Dinella, Todd Mytkowicz, Alexey Svyatkovskiy, Christian Bird, Mayur Naik, Shuvendu Lahiri
May 2021
The SPACE of Developer Productivity: There’s more to it than you think
Nicole Forsgren, Margaret-Anne Storey, Chandra Maddila, Tom Zimmermann, Brian Houck, Jenna Butler
ACM Queue | February 2021, Vol 19(1): pp. 20-48
‘How Was Your Weekend?’ Software Development Teams Working From Home During COVID-19
Courtney Miller, Paige Rodeghero, Margaret-Anne Storey, Denae Ford, Tom Zimmermann
ICSE 2021 | January 2021
Distinguished Paper Award at ICSE 2021
-
Empowering healthy communities
Nicole Forsgren, Greg Ceccarelli, Derek Jedamski, Scot Kelly, Clair Sullivan
The State of the Octoverse | December 2020, Vol V: pp. 1-41
Finding balance between work and play
Nicole Forsgren, Greg Ceccarelli, Derek Jedamski, Scot Kelly, Clair Sullivan
The State of the Octoverse | December 2020, Vol V: pp. 1-41
Securing the world’s software
Nicole Forsgren, Bas Alberts, Grey Baker, Greg Cecarelli, Derek Jedamski, Scot Kelly, Clair Sullivan
The State of the Octoverse | December 2020, Vol V: pp. 1-30
The who, what, how of software engineering research: a socio-technical framework
Margaret-Anne D. Storey, Neil A. Ernst, Courtney Williams, Eirini Kalliamvakou
Empirical Software Engineering | August 2020, Vol 25(5): pp. 4097-4129
A Taxonomy of Software Delivery Performance Profiles: Investigating the Effects of DevOps Practices
Marcus A. Rothenberger, Jez Humble, Jason Bennett Thatcher, Dustin Smith, Nicole Forsgren
2020 (AMCIS) Americas Conference on Information Systems | August 2020
-
Towards a Theory of Software Developer Job Satisfaction and Perceived Productivity
Margaret-Anne Storey, Tom Zimmermann, Christian Bird, Jacek Czerwonka, Brendan Murphy, Eirini Kalliamvakou
IEEE Transactions on Software Engineering | September 2019
Moving from Closed to Open Source: Observations from Six Transitioned Projects to GitHub
Pavneet Singh Kochhar, Eirini Kalliamvakou, Nachi Nagappan, Thomas Zimmermann (tzimmer), Christian Bird
IEEE Transactions on Software Engineering | August 2019, pp. 1-1
Publications by Research Area
-
DevEx in Action: A study of its tangible impacts
Nicole Forsgren, Eirini Kalliamvakou, Abi Noda, Michaela Greiler, Brian Houck, Margaret-Anne Storey
ACM Queue | January 2024, Vol 21(6)
The Best of Both Worlds: Unlocking the Potential of Hybrid Work for Software Engineers
Brian Houck, Henry Yelin, Jenna Butler, Nicole Forsgren, Alison McMartin
May 2023
Make Your Tools Sparkle with Trust: The PICSE Framework for Trust in Software Tools
Brittany Johnson, Christian Bird, Denae Ford, Nicole Forsgren, Tom Zimmermann
ICSE SEIP | May 2023
Taking Flight with Copilot: Early insights and opportunities of AI-powered pair-programming tools
Christian Bird, Denae Ford, Tom Zimmermann, Nicole Forsgren, Eirini Kalliamvakou, Travis Lowdermilk, Idan Gazit
ACM Queue | January 2023
“It would work for me too”: How Online Communities Shape Software Developers’ Trust in AI-Powered Code Generation Tools
Ruijia Cheng, Ruotong Wang, Tom Zimmermann, Denae Ford
December 2022
Understanding Skills for OSS Communities on GitHub
Jenny T. Liang, Tom Zimmermann, Denae Ford
ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) | November 2022
Program-L: Online Help Seeking Behaviors by Blind and Low Vision Programmers
Jazette Johnson, Andrew Begel, Richard Ladner, Denae Ford
IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) | September 2022
ReBOC: Recommending Bespoke Open Source Software Projects to Contributors
Denae Ford, Nischal Shrestha, Tom Zimmermann
IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) | September 2022
Attracting and Retaining OSS contributors with a Maintainer Dashboard
Mariam Guizani, Tom Zimmermann, Anita Sarma, Denae Ford
ICSE 2022 | May 2022
Towards Mining OSS Skills from GitHub Activity
Jenny T. Liang , Tom Zimmermann, Denae Ford
ICSE 2022 | May 2022
DeepAnalyze: Learning to Localize Crashes at Scale
Manish Shetty, Chetan Bansal, Suman Nath, Sean Bowles, Henry Wang, Ozgur Arman, Siamak Ahari
ICSE 2022 | May 2022
Technical report
Chandra Maddila, Apoorva Agrawal, Thomas Zimmermann, Nicole Forsgren, Kim Herzig, Arie van Deursen
MSR-TR-2021-28 | October 2021
Published by Microsoft
Developers Who Vlog: Dismantling Stereotypes through Community and Identity
Souti Chattoadhyay, Denae Ford, Tom Zimmermann
ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW) | October 2021
MergeBERT: Program Merge Conflict Resolution via Neural Transformers
Alexey Svyatkovskiy, Todd Mytkowicz, Negar Ghorbani, Sarah Fakhoury, Elizabeth Dinella, Christian Bird, Neel Sundaresan, Shuvendu Lahiri
August 2021
Reel Life vs. Real Life: How Software Developers Share Their Daily Life through Vlogs
Souti Chattopadhyay, Tom Zimmermann, Denae Ford
ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) | August 2021
Leaving My Fingerprints: Motivations and Challenges of Contributing to OSS for Social Good
Yu Huang, Denae Ford, Tom Zimmermann
ICSE 2021 | May 2021
Please Turn Your Cameras On: Remote Onboarding of Software Developers during a Pandemic
Paige Rodeghero, Tom Zimmermann, Brian Houck, Denae Ford
ICSE SEIP | May 2021
DeepMerge: Learning to Merge Programs
Elizabeth Dinella, Todd Mytkowicz, Alexey Svyatkovskiy, Christian Bird, Mayur Naik, Shuvendu Lahiri
May 2021
Anomalicious: Automated Detection of Anomalous and Potentially Malicious Commits on GitHub
Danielle Gonzalez, Thomas Zimmermann, Patrice Godefroid, Max Schaefer
International Conference on Software Engineering (ICSE), Software Engineering in Practice (SEIP) track | May 2021
The SPACE of Developer Productivity: There’s more to it than you think
Nicole Forsgren, Margaret-Anne Storey, Chandra Maddila, Tom Zimmermann, Brian Houck, Jenna Butler
ACM Queue | February 2021, Vol 19(1): pp. 20-48
‘How Was Your Weekend?’ Software Development Teams Working From Home During COVID-19
Courtney Miller, Paige Rodeghero, Margaret-Anne Storey, Denae Ford, Tom Zimmermann
ICSE 2021 | January 2021
Distinguished Paper Award at ICSE 2021
Securing the world’s software
Nicole Forsgren, Bas Alberts, Grey Baker, Greg Cecarelli, Derek Jedamski, Scot Kelly, Clair Sullivan
The State of the Octoverse | December 2020, Vol V: pp. 1-30
Empowering healthy communities
Nicole Forsgren, Greg Ceccarelli, Derek Jedamski, Scot Kelly, Clair Sullivan
The State of the Octoverse | December 2020, Vol V: pp. 1-41
Finding balance between work and play
Nicole Forsgren, Greg Ceccarelli, Derek Jedamski, Scot Kelly, Clair Sullivan
The State of the Octoverse | December 2020, Vol V: pp. 1-41
The who, what, how of software engineering research: a socio-technical framework
Margaret-Anne D. Storey, Neil A. Ernst, Courtney Williams, Eirini Kalliamvakou
Empirical Software Engineering | August 2020, Vol 25(5): pp. 4097-4129
A Taxonomy of Software Delivery Performance Profiles: Investigating the Effects of DevOps Practices
Marcus A. Rothenberger, Jez Humble, Jason Bennett Thatcher, Dustin Smith, Nicole Forsgren
2020 (AMCIS) Americas Conference on Information Systems | August 2020
Towards a Theory of Software Developer Job Satisfaction and Perceived Productivity
Margaret-Anne Storey, Tom Zimmermann, Christian Bird, Jacek Czerwonka, Brendan Murphy, Eirini Kalliamvakou
IEEE Transactions on Software Engineering | September 2019
Moving from Closed to Open Source: Observations from Six Transitioned Projects to GitHub
Pavneet Singh Kochhar, Eirini Kalliamvakou, Nachi Nagappan, Thomas Zimmermann (tzimmer), Christian Bird
IEEE Transactions on Software Engineering | August 2019, pp. 1-1
-
The Impact of AI on Developer Productivity: Evidence from GitHub Copilot
Sida Peng, Eirini Kalliamvakou, Peter Cihon, Mert Demirer
February 2023
DeepAnalyze: Learning to Localize Crashes at Scale
Manish Shetty, Chetan Bansal, Suman Nath, Sean Bowles, Henry Wang, Ozgur Arman, Siamak Ahari
ICSE 2022 | May 2022
MergeBERT: Program Merge Conflict Resolution via Neural Transformers
Alexey Svyatkovskiy, Todd Mytkowicz, Negar Ghorbani, Sarah Fakhoury, Elizabeth Dinella, Christian Bird, Neel Sundaresan, Shuvendu Lahiri
August 2021
-
Make Your Tools Sparkle with Trust: The PICSE Framework for Trust in Software Tools
Brittany Johnson, Christian Bird, Denae Ford, Nicole Forsgren, Tom Zimmermann
ICSE SEIP | May 2023
Taking Flight with Copilot: Early insights and opportunities of AI-powered pair-programming tools
Christian Bird, Denae Ford, Tom Zimmermann, Nicole Forsgren, Eirini Kalliamvakou, Travis Lowdermilk, Idan Gazit
ACM Queue | January 2023
“It would work for me too”: How Online Communities Shape Software Developers’ Trust in AI-Powered Code Generation Tools
Ruijia Cheng, Ruotong Wang, Tom Zimmermann, Denae Ford
December 2022
Understanding Skills for OSS Communities on GitHub
Jenny T. Liang, Tom Zimmermann, Denae Ford
ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) | November 2022
Program-L: Online Help Seeking Behaviors by Blind and Low Vision Programmers
Jazette Johnson, Andrew Begel, Richard Ladner, Denae Ford
IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) | September 2022
ReBOC: Recommending Bespoke Open Source Software Projects to Contributors
Denae Ford, Nischal Shrestha, Tom Zimmermann
IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) | September 2022
Attracting and Retaining OSS contributors with a Maintainer Dashboard
Mariam Guizani, Tom Zimmermann, Anita Sarma, Denae Ford
ICSE 2022 | May 2022
Towards Mining OSS Skills from GitHub Activity
Jenny T. Liang , Tom Zimmermann, Denae Ford
ICSE 2022 | May 2022
Developers Who Vlog: Dismantling Stereotypes through Community and Identity
Souti Chattoadhyay, Denae Ford, Tom Zimmermann
ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW) | October 2021
Reel Life vs. Real Life: How Software Developers Share Their Daily Life through Vlogs
Souti Chattopadhyay, Tom Zimmermann, Denae Ford
ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) | August 2021
Leaving My Fingerprints: Motivations and Challenges of Contributing to OSS for Social Good
Yu Huang, Denae Ford, Tom Zimmermann
ICSE 2021 | May 2021
Please Turn Your Cameras On: Remote Onboarding of Software Developers during a Pandemic
Paige Rodeghero, Tom Zimmermann, Brian Houck, Denae Ford
ICSE SEIP | May 2021
-
DeepAnalyze: Learning to Localize Crashes at Scale
Manish Shetty, Chetan Bansal, Suman Nath, Sean Bowles, Henry Wang, Ozgur Arman, Siamak Ahari
ICSE 2022 | May 2022
-
Anomalicious: Automated Detection of Anomalous and Potentially Malicious Commits on GitHub
Danielle Gonzalez, Thomas Zimmermann, Patrice Godefroid, Max Schaefer
International Conference on Software Engineering (ICSE), Software Engineering in Practice (SEIP) track | May 2021
Publications by Type
-
DevEx in Action: A study of its tangible impacts
Nicole Forsgren, Eirini Kalliamvakou, Abi Noda, Michaela Greiler, Brian Houck, Margaret-Anne Storey
ACM Queue | January 2024, Vol 21(6)
Taking Flight with Copilot: Early insights and opportunities of AI-powered pair-programming tools
Christian Bird, Denae Ford, Tom Zimmermann, Nicole Forsgren, Eirini Kalliamvakou, Travis Lowdermilk, Idan Gazit
ACM Queue | January 2023
Developers Who Vlog: Dismantling Stereotypes through Community and Identity
Souti Chattoadhyay, Denae Ford, Tom Zimmermann
ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW) | October 2021
The SPACE of Developer Productivity: There’s more to it than you think
Nicole Forsgren, Margaret-Anne Storey, Chandra Maddila, Tom Zimmermann, Brian Houck, Jenna Butler
ACM Queue | February 2021, Vol 19(1): pp. 20-48
Securing the world’s software
Nicole Forsgren, Bas Alberts, Grey Baker, Greg Cecarelli, Derek Jedamski, Scot Kelly, Clair Sullivan
The State of the Octoverse | December 2020, Vol V: pp. 1-30
Empowering healthy communities
Nicole Forsgren, Greg Ceccarelli, Derek Jedamski, Scot Kelly, Clair Sullivan
The State of the Octoverse | December 2020, Vol V: pp. 1-41
Finding balance between work and play
Nicole Forsgren, Greg Ceccarelli, Derek Jedamski, Scot Kelly, Clair Sullivan
The State of the Octoverse | December 2020, Vol V: pp. 1-41
The who, what, how of software engineering research: a socio-technical framework
Margaret-Anne D. Storey, Neil A. Ernst, Courtney Williams, Eirini Kalliamvakou
Empirical Software Engineering | August 2020, Vol 25(5): pp. 4097-4129
Towards a Theory of Software Developer Job Satisfaction and Perceived Productivity
Margaret-Anne Storey, Tom Zimmermann, Christian Bird, Jacek Czerwonka, Brendan Murphy, Eirini Kalliamvakou
IEEE Transactions on Software Engineering | September 2019
Moving from Closed to Open Source: Observations from Six Transitioned Projects to GitHub
Pavneet Singh Kochhar, Eirini Kalliamvakou, Nachi Nagappan, Thomas Zimmermann (tzimmer), Christian Bird
IEEE Transactions on Software Engineering | August 2019, pp. 1-1
-
The Impact of AI on Developer Productivity: Evidence from GitHub Copilot
Sida Peng, Eirini Kalliamvakou, Peter Cihon, Mert Demirer
February 2023
“It would work for me too”: How Online Communities Shape Software Developers’ Trust in AI-Powered Code Generation Tools
Ruijia Cheng, Ruotong Wang, Tom Zimmermann, Denae Ford
December 2022
-
The Best of Both Worlds: Unlocking the Potential of Hybrid Work for Software Engineers
Brian Houck, Henry Yelin, Jenna Butler, Nicole Forsgren, Alison McMartin
May 2023
MergeBERT: Program Merge Conflict Resolution via Neural Transformers
Alexey Svyatkovskiy, Todd Mytkowicz, Negar Ghorbani, Sarah Fakhoury, Elizabeth Dinella, Christian Bird, Neel Sundaresan, Shuvendu Lahiri
August 2021
DeepMerge: Learning to Merge Programs
Elizabeth Dinella, Todd Mytkowicz, Alexey Svyatkovskiy, Christian Bird, Mayur Naik, Shuvendu Lahiri
May 2021
-
Make Your Tools Sparkle with Trust: The PICSE Framework for Trust in Software Tools
Brittany Johnson, Christian Bird, Denae Ford, Nicole Forsgren, Tom Zimmermann
ICSE SEIP | May 2023
Understanding Skills for OSS Communities on GitHub
Jenny T. Liang, Tom Zimmermann, Denae Ford
ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) | November 2022
Program-L: Online Help Seeking Behaviors by Blind and Low Vision Programmers
Jazette Johnson, Andrew Begel, Richard Ladner, Denae Ford
IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) | September 2022
ReBOC: Recommending Bespoke Open Source Software Projects to Contributors
Denae Ford, Nischal Shrestha, Tom Zimmermann
IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) | September 2022
Attracting and Retaining OSS contributors with a Maintainer Dashboard
Mariam Guizani, Tom Zimmermann, Anita Sarma, Denae Ford
ICSE 2022 | May 2022
Towards Mining OSS Skills from GitHub Activity
Jenny T. Liang , Tom Zimmermann, Denae Ford
ICSE 2022 | May 2022
DeepAnalyze: Learning to Localize Crashes at Scale
Manish Shetty, Chetan Bansal, Suman Nath, Sean Bowles, Henry Wang, Ozgur Arman, Siamak Ahari
ICSE 2022 | May 2022
Reel Life vs. Real Life: How Software Developers Share Their Daily Life through Vlogs
Souti Chattopadhyay, Tom Zimmermann, Denae Ford
ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) | August 2021
Leaving My Fingerprints: Motivations and Challenges of Contributing to OSS for Social Good
Yu Huang, Denae Ford, Tom Zimmermann
ICSE 2021 | May 2021
Please Turn Your Cameras On: Remote Onboarding of Software Developers during a Pandemic
Paige Rodeghero, Tom Zimmermann, Brian Houck, Denae Ford
ICSE SEIP | May 2021
Anomalicious: Automated Detection of Anomalous and Potentially Malicious Commits on GitHub
Danielle Gonzalez, Thomas Zimmermann, Patrice Godefroid, Max Schaefer
International Conference on Software Engineering (ICSE), Software Engineering in Practice (SEIP) track | May 2021
‘How Was Your Weekend?’ Software Development Teams Working From Home During COVID-19
Courtney Miller, Paige Rodeghero, Margaret-Anne Storey, Denae Ford, Tom Zimmermann
ICSE 2021 | January 2021
Distinguished Paper Award at ICSE 2021
A Taxonomy of Software Delivery Performance Profiles: Investigating the Effects of DevOps Practices
Marcus A. Rothenberger, Jez Humble, Jason Bennett Thatcher, Dustin Smith, Nicole Forsgren
2020 (AMCIS) Americas Conference on Information Systems | August 2020
-
Technical report
Chandra Maddila, Apoorva Agrawal, Thomas Zimmermann, Nicole Forsgren, Kim Herzig, Arie van Deursen
MSR-TR-2021-28 | October 2021
Published by Microsoft