Confidence Estimation for Deep Neural Networks

此演讲使用中文 (This will be presented in Chinese)

Jialin Jiao (Pony.ai)
14:0014:40 Thursday, June 20, 2019
模型与方法 (Models and Methods)
Location: 多功能厅6A+B (Function Room 6A+B)

必要预备知识 (Prerequisite Knowledge)

* Deep Learning basics * Bayesian Machine Learning basics * Probabilistic & Statistics basics

您将学到什么 (What you'll learn)

* Understand the concepts of confidence/uncertainty in deep neural networks, as well as the risk of overconfident errors to AI safety * Learn how to estimate confidence of deep neural network with available tools/methods

描述 (Description)

Deep learning has been in the center of AI since its revival a few years ago and has achieved tremendous success in many applications. However, while deep neural networks has achieved unprecedentedly great performance, their predictions of usually do not come with a reliable and well-calibrated confidence score. Wrong but confident predictions place great threads to critical real-life applications, e.g. self-driving car. On the other hand, a good confidence estimation is also very useful in implementing effective active learning.

This talk is a tutorial of confidence estimation for deep neural networks and recent advances, and comparison of different methods with focus on the following:

  • Uncertainty(confidence) in Deep Learning and AI safety;
  • Why the common way of confidence evaluation such as using softmax is not reliable;
  • Different approaches people are taking to estimate confidence of deep neural networks, including but not limited to: Bayesian based methods (such as MC-dropout etc.), Entropy based confidence score with Adversarial Training, Confidence score based on data embedding, Density Modeling Approach,.. etc.
Photo of Jialin Jiao

Jialin Jiao


Jialin Jiao, an experienced technical veteran in HD maps, autonomous driving, machine learning, search, software engineering, specializes in research and development in the fields of Location-Based Service (LBS), HD maps, big data, machine learning, artificial intelligence and search. He had worked in Uber (US headquarter), Microsoft search engine Bing, IBM TJ Watson Research. He is currently working for Pony.ai, a startup building autonomous driving car. He holds a bachelor’s degree in computer science from Sun Yat-sen University, a master’s degree in computer science from Shanghai Jiao Tong University, and a master’s degree in electronic engineering from the University of Michigan – Dearborn.
Mr. Jiao is an IEEE member, as well as a founding member of IEEE Computer Society’s Special Technical Community in Autonomous Driving (https://stc.computer.org/autonomousdriving/leadership/).

Leave a Comment or Question

Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?

Join the conversation here (requires login)