Building reinforcement learning models and AI applications with Ray

This will be presented in English.

Richard Liaw (UC Berkeley RISELab), Siyuan Zhuang (UC Berkeley RISELab)
13:3017:00 Wednesday, June 19, 2019
英文讲话 (Presented in English)
Location: 多功能厅8A+B(Function Room 8A+B)

必要预备知识 (Prerequisite Knowledge)

  • Familiarity with Python, basic machine learning concepts, and reinforcement learning

您将学到什么 (What you'll learn)

  • Learn how to develop simple reinforcement learning (RL) applications at scale with Ray and manage Ray on clusters

描述 (Description)

Building end-to-end AI applications is challenging, and building the next generation of AI applications, such as online learning and RL is even more challenging. That’s because these applications exhibit a large variety of computational patterns (e.g., data processing, simulations, model training, and model serving), and none of the existing frameworks can efficiently support all these patterns at scale.

Richard Liaw illustrates how Ray can seamlessly and efficiently support these computational patterns and hence provides an ideal platform for building AI applications. You’ll take a deep dive into Ray, learn its API, and implement several state-of-the-art AI applications, including an end-to-end application that involves training an RL model and serving predictions from it.

Photo of Richard Liaw

Richard Liaw

UC Berkeley RISELab

Richard Liaw is a PhD student in the Berkeley Artificial Intelligence Research (BAIR) Lab and RISELab at UC Berkeley working with Joseph Gonzalez, Ion Stoica, and Ken Goldberg. He’s worked on a variety of different areas, ranging from robotics to reinforcement learning to distributed systems. He’s working on Ray, a distributed execution engine for AI applications; RLlib, a scalable reinforcement learning library; and Tune, a distributed framework for model training.

Siyuan Zhuang

UC Berkeley RISELab

Siyuan Zhuang is a PhD student in RISELab at UC Berkeley. He is interested in the intersection of AI and systems.