The Azure Data Engineer is responsible for building, implementing and supporting Azure Microsoft BI solutions to meet market and / or client requirements.
They apply knowledge of technologies, applications, methodologies, processes and tools to support a client, project or entity.
Besides, as a Sr. Azure Data Engineer, the candidate is expected to manage a team up to 5 members under his / her responsibility.
About the job
Create and maintain optimal data pipeline architecture,
Assemble large, complex data sets that meet functional / non-functional business requirements.
Identify, design, and implement internal process improvements : automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS big data’ technologies.
Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.
Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry
Work with data and analytics experts to strive for greater functionality in our data systems.
About you
University degree in Computer Science, Engineering and / or a technically oriented field.
4+ years of experience in a Data Engineer role.
Hand-on experience with software / tools : Experience with big data tools : Hadoop, Spark,Experience with Azure tools : Azure SQL Database, Azure Data Lake, Azure Data Factory, Azure SQL Data Warehouse, Azure Service Bus, etc.
Experience with relational SQL databases.Experience with AWS cloud services : EC2, RDS, Redshift, Lambda, Athena is a plus.
Experience with object-oriented / object function scripting languages : Python, Bash, etc.
Good English is mandatory.
Able to support with time zone difference.
Able to work under high pressure.