DeveloperWeek 2019 has ended
Welcome to DEVELOPERWEEK 2019.  Build the future.
Back To Schedule
Thursday, February 21 • 9:00am - 9:25am
PRO TALK: OS for AI: Microservices & Serverless Computing Enable the Next Gen of Machine Intelligence

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
You've trained machine learning models on your data, but how do you put them into production? When you have thousands of model versions, each written in any mix of frameworks (R/Java/Ruby/SciKit/Caffe/Tensorflow on GPUs etc), how do you efficiently deploy them as elastic, scalable, secure APIs with 10ms of latency? ML has been advancing rapidly, but only a few contributors are focusing on the infrastructure and scaling challenges that come with it. We've built, deployed, and scaled thousands of algorithms and machine learning models, using every kind of framework. We've seen many of the challenges faced in this area, and in this talk I'll share some insights into the problems you’re likely to face, and how to approach solving them. In brief, we’ll examine the need for, and implementations of, a complete Operating System for AI: a common interface for different algorithms to be used and combined, and a general architecture for serverless machine learning which is discoverable, versioned, scalable and sharable.

avatar for Jon Peck

Jon Peck

Developer & Advocate, Algorithmia
A full-stack developer with two decades of industry experience, Jon Peck now focuses on bringing scalable, discoverable, and secure machine-learning microservices to developers across a wide variety of platforms via Algorithmia.com--------Speaker at: DeveloperWeek 2018+19, SeattleJS... Read More →

Thursday February 21, 2019 9:00am - 9:25am PST
Grand Ballroom - Stage B