Data Engineer (Python, Hadoop, Big Data)
VINBRAIN
Ha Noi, Ha Noi, Vietnam
7 giờ trước

VinBrain is a company funded by Vingroup, the largest conglomerate in Vietnam by market capitalization. Our mission is to perform cutting-edge research and development of AI, Machine Learning, and Deep Learning technologies and products that will lead to improve healthcare system and quality of life.

At VinBrain, we believe the greatest promise of Big Data lies in healthcare. We believe that by solving unique and challenging problems at the intersection of (medical) Big Data, AI, IoT, and IoP (Internet of People), we can improve the outcomes for patients around the globe.

We have assembled seasoned researchers, engineers, and entrepreneurs from world-class companies such as Microsoft, Amazon, Adobe and Google to build the platform and services to achieve this.

If you are motivated to be part of something special and to be a catalyst for improving lives and healthier communities, we want to talk to you.

We are looking for an individual to support our team in managing develop, operate and drive scalable and resilient data platform based on Hadoop ecosystem to address the business requirements :

Responsibilities

  • Ensure industry best practices around data pipelines, metadata management, data quality, data governance and data privacy
  • Design and implement business-specific large-scale data processing pipelines
  • Work with complex data structures, manipulate, cleanse data, and perform transformations to make insights from data.
  • Responsible to ingest data from files, streams, and databases. Process the data with PySpark, Kafka
  • Develop efficient software code for multiple use cases leveraging Spark and Big Data Technologies for various use cases built on the platform
  • Provide high operational excellence guaranteeing high availability and platform stability. Acts as liaison with various teams across the workplace.
  • Báo cáo công việc này
    checkmark

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    Nộp đơn
    Email của tôi
    Bằng cách nhấp vào "Tiếp tục", tôi đồng ý với neuvoo để xử lý dữ liệu của tôi và gửi cho tôi thông báo qua email, như được nêu chi tiết trong Chính sách bảo mật của neuvoo. Tôi có thể rút lại sự đồng ý của tôi hoặc hủy đăng ký bất cứ lúc nào.
    Tiếp tục
    Mẫu đăng ký