Applying serverless architecture pattern to distributed data processing

Serverless architectures refer to applications that significantly depend on "cloud" services (knows as Backend as a Service) or on custom code that's run in ephemeral runtime (Function as a Service or "FaaS").

To application developers "serverless" mean app where some certain logic of it is still written by the developer but unlike traditional architectures or microservices is run in stateless compute runtime that are event-triggered, may only last for one invocation, and fully managed by a cloud. Serverless helps developers to transfer responsibility of keeping their apps up and running as well as scaling out their workload capacity without involving devops/ops as we got used to.

In this talk we will go through whole "serverless" thing: from decomposing app and its logic to microservices and further to smaller bits, i.e. functions to defining data flow through functions and building their fault-tolerant pipeline.

Moreover, we will go through demo that highlight key takeaways:

  • what is functions, what it could and could not be
  • how design scalable architecture without getting into troubles by hitting concrete bottlenecks
  • how combine multiple programming languages into a single app
  • why Python is one of the best programming languages designed exactly for serverless

Day 1 (4th November) 10:10 AM - 10:40 AM
AC1 Lecture Hall LT-16
English (English Slides)
At least basic background in OpenCV and TensorFlow, Python object serialization, Golang


Photo of Denis Makogon

Denis Makogon Denis Makogon

Developer and starting software architect in cloud environments, mainly focused on developing and designing platform and software as a service applications for clouds. He's principal software developer in Oracle, concentrating on product development along with bringing well-designed and production ready integration with clouds solutions, contributor to various open source projects, cloud-related technologies along having fun with IoT devices.

Denis is a regular attendee and speaker at OpenStack summits (Atlanta, Austin, Paris, Barcelona, Boston) and PyCon Hong Kong 2017. co-author of OpenStack Application development, OpenStack Trove Essentials.

Nationality: Ukraine