BIG DATA ENGINEER - ALL LEVELS
Trusting Social
Ho Chi Minh City, Vietnam
6 ngày trước
source : Tech in Asia

What you will do

  • Works on the data pipeline infrastructure that is veritably the backbone of our business
  • Writing elegant functional SCALA code to crunch TBs of data on Hadoop clusters, mostly using Spark
  • Be owning a data pipeline deployment to clusters : on-prem or on-cloud (AWS or GCP or more).
  • Be managing Hadoop clusters right from security to reliability to HA.
  • Building a pluggable, unified data lake from scratch.
  • Automating and scaling tasks for the Data Science team.
  • Constantly look to improve framework and pipelines, hence learning on the job is sort of a given.
  • Our expertise and requirements include but are not limited to Spark, Scala, HDFS, Yarn, Hive, Kafka, Distributed Systems, Python, Datastore (Relational and NoSql) and Airflow.
  • What you need to have

  • Experienced with Java / Scala (Python is a plus) .
  • Experienced with Big Data stacks : Hadoop, Spark (Must have) .
  • Knowledge of various ETL techniques and frameworks, such as Spark, Yarn, Airflow, Oozie, etc.
  • Understanding of distributed computing principles
  • Experience with NoSQL databases.
  • Experience with various messaging systems, such as Kafka or RabbitMQ
  • What you will get

  • Top market rate pay
  • Offers state-of-the-art Macbook, offices, and facilities.
  • Exceptional career growth
  • Best and brightest colleagues
  • Comprehensive health insurance package for parents, spouses, and children
  • Free Food at the office - All Day
  • Free Grab for work
  • Amazing company retreats
  • About us

    We are an AI Fintech company specialized in assessing credit profiles of consumers in emerging markets combining pioneering AI with large alternative data sources.

    In 2020 we reached our ambitious milestone of credit profiling 1 billion consumers spanning 4 countries - Vietnam, Indonesia, India & the Philippines - and building a platform for the wider industry and the financial services industry, in particular, to provide the "un & under" served access to credit.

    At the core of this initiative has been our strict and unwavering adherence to the norms of consumer data privacy and consumer data rights.

    But we're not satisfied as we embark on the next leg of our journey to deliver 100 million credit lines to consumers in the markets where we operate.

    Although this goal is ambitious, we truly believe that by harnessing the power of AI & Big Data we can deliver financial access at an unprecedented scale.

    As a firm, we're audacious problem-solvers motivated by our impact on society. We deeply espouse the values of ownership - of our actions and initiatives, integrity in all we do, and agility in execution.

    We place great importance on doing what is right, what is best, and what is innovative. If you are smart, driven, and want to make a difference in the world with the most advanced and fascinating technology, come join our team.

    We can satisfy your desire to explore new territory and give you the runway to really make an impact.

    This video shows our office and people :

    Required skills

    Hadoop Scala Spark Amazon Web Services (AWS) Distributed Systems Python NoSQL Airflow

    Báo cáo công việc này
    checkmark

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    Nộp đơn
    Email của tôi
    Bằng cách nhấp vào "Tiếp tục", tôi đồng ý với neuvoo để xử lý dữ liệu của tôi và gửi cho tôi thông báo qua email, như được nêu chi tiết trong Chính sách bảo mật của neuvoo. Tôi có thể rút lại sự đồng ý của tôi hoặc hủy đăng ký bất cứ lúc nào.
    Tiếp tục
    Mẫu đăng ký