Data Engineering

Responsibilities:

• Advise clients about current state data architecture and data sources and create an appropriate transition path to cloud-based platform
• Work with customer stakeholders in order to understand the implementation of database requirements, analyze performance, and troubleshoot any existent issues
• Coordinate customer stakeholders to gather and consolidate business/technical requirements for designing, developing and delivering the data solutions to business as the expected target
• Design and build large-scale enterprise data solutions and applications using one or more AZURE data and analytics services in combination with 3rd parties
• Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala
• Design and implement data engineering, ingestion, and curation functions on AZURE cloud using AZURE native or custom programming
• Development, maintenance, improvement, cleaning, and manipulation of data in the business’s operational and large-scale processing systems architectures

Qualifications:

We are looking for a motivated, technical minded individual with a track record of using modern technology stack to build data pipeline automation. A successful candidate should solid background in.

• Degree in Computer Engineering and Computer Science or equivalent experience
• Minimum 3 years of experience in full-life cycle development/implementation of enterprise data applications, big data technology, data analysis and system development
• 5-7 years of performing data exploration and feature engineering
• Experience (intermediate) as practitioner in Cloud Platform; AZURE (preferrable), AWS and GCP
• Experience in selecting and integrating any Big Data tools and frameworks to meet required capabilities
• Experience in building cloud data pipelines from ingestion to consumption
• Experience in Python, R, Tableau, Hadoop, SQL
• Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
• Experience with design and implementation of ETL/ELT framework for complex warehouses/marts
• Strong internal team and external client stakeholder management with a collaborative, diplomatic, and flexible style, able to work effectively in a matrixed organization
• Excellent presentation skills, including strong oral and written capabilities in English
• Self-motivated, results-oriented individual with the ability to progress multiple priorities concurrently