Loading…
This event has ended. View the official site or create your own event → Check it out
This event has ended. Create your own
View analytic
Sunday, November 13 • 11:40am - 12:20pm
Building a Machine Learning Orchestration Framework in Scala

Sign up or log in to save this to your schedule and see who's attending!

A scaleable and adaptable machine learning platform is essential for an organization to harness the full potential of their data. This talk introduces Meson, a General Purpose Workflow Orchestration and Scheduling framework. Meson is a Scala application that manages heterogeneous workloads integrating Spark, Python, R, Docker and other toolkits. We will demonstrate how a simple user interface and a DSL allows data scientists to design and run machine learning pipelines that seamlessly exchange data and artifacts between disparate jobs. We are working on open sourcing Meson and by this talk it may very well be open sourced.

Speakers
KS

Kedar Sadekar

Sr. Software Engineer, Netflix Inc
I am a Senior software engineer on the Personalization Infrastructure team at Netflix that builds scalable, distributed computing systems for the algorithmic engineers that help improve member personalization. | | Interested in speaking about ML infrastructure challenges and solutions. Also happy to talk about Meson: our general purpose workflow orchestration and scheduling framework that we built to manage ML pipelines that execute... Read More →
avatar for Davis Shepherd

Davis Shepherd

Senior Software Engineer, Netflix
I started working with Scala when I was writing applications on top of Apache Spark. I spent 4 years building re-enforcement learning systems with these tools. I now work at Netflix, developing their next generation of ML workflow management software all in Scala


Sunday November 13, 2016 11:40am - 12:20pm
Off by One