Skip to content
Menu
PyCon HK
  • Schedule
    • 2023
    • 2022
    • 2021
    • 2020 Fall
    • 2020 Spring
    • 2018
    • 2017
    • 2016
    • 2015
  • Sponsors
    • 2023
    • 2022
    • 2021
    • 2020 Fall
    • 2018
    • 2017
    • 2016
    • 2015
  • Organizers
    • Organizers
    • Volunteers
    • Booths
  • Supporting Organizations
  • Code of Conduct
    • Procedures for Reporting Incidents
    • Enforcement Procedures
  • About
    • PyCon HK
    • Conference Highlights
    • 2023
    • 2022
    • 2021
    • 2020 Fall
    • 2020 Spring
    • 2018
    • 2017
      • Photos
      • Videos
    • 2016
      • Photos
      • Videos
    • 2015
      • Photos
PyCon HK

Heterogeneous Job processing with Apache Kafka

Posted on October 28, 2018September 18, 2024

Apache Kafka is widely used in large scale message processing applications. However, build a (job|task|work) processing system with Kafka is not straightforward. The talk will share experience on building a heterogeneous Job processing with Kafka and Python. The mentioned job processing mechanism can be made use of to several scenarios, e.g., cloud resource provisioning, tiering storage system and so on.

Buzzwords: cloud, open source software development
Level: Intermediate: Target audiences with intermediate experience in python programming
Requirements to Audiences: Nil
Language: Mandarin

Speaker: Chu, Hua-Rong (Taiwan)

Speaker Bio: A (storage|backend|python|java) research engineer in Taiwan. He is passionate about improve people’s life by coding. He has been involved to various open source projects and communities over ten years.

GitHub: https://github.com/hrchu
LinkedIn: https://www.linkedin.com/in/hua-chu-a2235779/
Twitter: https://twitter.com/okwapA700
Website/Blog: https://medium.com/@petertc

  • Instagram
  • LinkedIn
  • Facebook
  • Twitter
  • YouTube

Archives

©2025 PyCon HK | Powered by SuperbThemes!
← Deploying Machine Learning Models in Python ← Developments of Super Resolution