Skip to content
Menu
PyCon Hong Kong
  • Schedule
  • Sponsors
    • Supporting Organizations
    • Organizers
  • Volunteers
  • Code of Conduct
  • Ticket
  • About
    • PyCon HK
    • 2021
      • Privacy Policy Statement 2021
    • 2020 Fall
    • 2020 Spring
    • 2018
    • 2017
      • Photos
      • Videos
    • 2016
      • Photos
      • Videos
    • 2015
      • Photos
PyCon Hong Kong

Heterogeneous Job processing with Apache Kafka

Posted on October 28, 2018November 7, 2020

Apache Kafka is widely used in large scale message processing applications. However, build a (job|task|work) processing system with Kafka is not straightforward. The talk will share experience on building a heterogeneous Job processing with Kafka and Python. The mentioned job processing mechanism can be made use of to several scenarios, e.g., cloud resource provisioning, tiering storage system and so on.

Buzzwords: cloud, open source software development
Level: Intermediate: Target audiences with intermediate experience in python programming
Requirements to Audiences: Nil
Language: Mandarin

Speaker: Chu, Hua-Rong (Taiwan)

Speaker Bio: A (storage|backend|python|java) research engineer in Taiwan. He is passionate about improve people’s life by coding. He has been involved to various open source projects and communities over ten years.

GitHub: https://github.com/hrchu
LinkedIn: https://www.linkedin.com/in/hua-chu-a2235779/
Twitter: https://twitter.com/okwapA700
Website/Blog: https://medium.com/@petertc

Gold Sponsors

Silver Sponsors

Categories

  • 2022
  • 2021
  • 2020 Fall
  • 2020 Spring
  • 2018
  • Conference Highlights

Archives

©2022 PyCon Hong Kong | Powered by WordPress and Superb Themes!
← Deploying Machine Learning Models in Python ← Developments of Super Resolution