Loading…
This event has ended. View the official site or create your own event → Check it out
This event has ended. Create your own
View analytic
Friday, November 11 • 11:40am - 12:20pm
Scio - A Scala API for Google Cloud Dataflow

Sign up or log in to save this to your schedule and see who's attending!

We will present Scio, a Scala API for Google Cloud Dataflow (incubated as Apache Beam). Apache Beam offers a simple, unified programming model for both batch and streaming data processing while Scio brings it much closer to other high level APIs many data engineers are familiar with, e.g. Spark and Scalding. We will cover design and implementation of the framework, including features like type safe BigQuery macros, REPL and serialization. There will also be a live coding demo.

Speakers
avatar for Neville Li

Neville Li

Software Engineer, Spotify
Neville is a software engineer at Spotify who works mainly on data infrastructure and tools for machine learning and advanced analytics. In the past few years he has been driving the adoption of Scala and new data tools for music recommendation, including Scalding, Spark, Storm a... Read More →


Friday November 11, 2016 11:40am - 12:20pm
Off by One

Attendees (27)