Analytics Zoo:基于Apache Spark的分布式TensorFlow和Keras(Analytics Zoo: Distributed TensorFlow and Keras on Apache Spark)

此演讲使用中文 (This will be presented in Chinese)

Zhichao Li (Intel), Kai Huang (Intel), Yang Wang (Intel)
09:0012:30 Wednesday, June 19, 2019
实施人工智能 (Implementing AI)
Location: 多功能厅5C(Function Room 5C)

必要预备知识 (Prerequisite Knowledge)

  • A basic understanding of Python, Spark, TensorFlow, and Analytics Zoo

您将学到什么 (What you'll learn)

  • Learn distributed TensorFlow and Keras on Apache Spark
  • Learn how to build and productionize deep learning applications for big data using Analytics Zoo

描述 (Description)

Analytics Zoo provides a unified analytics plus AI platform that seamlessly unites Spark, TensorFlow, Keras, and BigDL programs into an integrated pipeline; the entire pipeline can then transparently scale out to a large Hadoop/Spark cluster for distributed training or inference.

Zhichao Li, Kai Huang, and Yang Wang demonstrate how to build and productionize deep learning applications for big data (e.g., transfer learning-based image classification, sequence-to-sequence prediction for precipitation nowcasting, neural collaborative filtering for recommendations, unsupervised time-series anomaly detection, etc.) using Analytics Zoo, illustrated through real-world use cases from JD.com, MLSListings, the World Bank, UnionPay, and Midea/KUKA.

Analytics Zoo 提供了一个统一的“分析+人工智能”平台。它无缝地把Spark、TensorFlow、Keras和BigDL统一进一个集成的管道。整个管道可以透明地扩展到大型Hadoop和Spark集群上,以进行分布式的训练和推断。

在本次辅导课中我们将通过使用来自Analytics Zoo的真实案例(如京东、MLSListings、世界银行、银联、midea / KUKA等),展示如何面向大数据构建和生产化部署深度学习应用,例如,基于迁移学习的图像分类、使用序列到序列模型进行降水预报、基于神经协同过滤的推荐、无监督时间序列异常检测等。

Photo of Zhichao Li

Zhichao Li


Zhichao Li is a senior software engineer at Intel focused on distributed machine learning, especially large-scale analytical applications and infrastructure on Spark. He’s also an active contributor to Spark. Previously, Zhichao worked in Morgan Stanley’s FX Department.

Zhichao Li是英特尔的高级软件工程师,专注于分布式机器学习,尤其是Spark上的大规模分析应用和基础架构。他也是一名Spark项目的积极贡献者。 在加入英特尔之前,Zhichao曾在摩根士丹利的外汇部工作。

Photo of Kai Huang

Kai Huang


Kai Huang is a software engineer at Intel. His work mainly focuses on developing deep learning frameworks on Apache Spark and helping customers work out end to end deep learning solutions on big data platforms. He is a main contributor to Analytics Zoo and BigDL.

Kai Huang是英特尔软件工程师。 他的工作主要集中在开发Apache Spark深度学习框架,并帮助客户在大数据平台上制定端到端深度学习解决方案。他是Analytics Zoo和BigDL的主要贡献者之一。

Photo of Yang Wang

Yang Wang


Yang Wang is a machine learning engineer on the data analytics team at Intel, focusing on deep learning infrastructure, algorithms, and applications. He’s one of the core contributors of Analytics Zoo and BigDL.

Yang Wang是英特尔数据分析团队的机器学习工程师,专注于深度学习基础架构、算法和应用。他是Analytics Zoo和BigDL的核心贡献者之一。

Leave a Comment or Question

Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?

Join the conversation here (requires login)