Responsibilities:
- Advise clients about current state data architecture and data sources and create an appropriate transition path to cloud-based platform
- Work with customer stakeholders in order to understand the implementation of database requirements, analyze performance, and troubleshoot any existent issues
- Coordinate customer stakeholders to gather and consolidate business/technical requirements for designing, developing and delivering the data solutions to business as the expected target
- Design and build large-scale enterprise data solutions and applications using one or more AZURE data and analytics services in combination with 3rd parties
- Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala
- Design and implement data engineering, ingestion, and curation functions on AZURE cloud using AZURE native or custom programming
- Development, maintenance, improvement, cleaning, and manipulation of data in the business’s operational and large-scale processing systems architectures
Qualifications:
We are looking for a motivated, technical minded individual with a track record of using modern technology stack to build data pipeline automation. A successful candidate should solid background in.
- Degree in Computer Engineering and Computer Science or equivalent experience
- Minimum 3 years of experience in full-life cycle development/implementation of enterprise data applications, big data technology, data analysis and system development
- 5-7 years of performing data exploration and feature engineering
- Experience (intermediate) as practitioner in Cloud Platform; AZURE (preferrable), AWS and GCP
- Experience in selecting and integrating any Big Data tools and frameworks to meet required capabilities
- Experience in building cloud data pipelines from ingestion to consumption
- Experience in Python, R, Tableau, Hadoop, SQL
- Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
- Experience with design and implementation of ETL/ELT framework for complex warehouses/marts
- Strong internal team and external client stakeholder management with a collaborative, diplomatic, and flexible style, able to work effectively in a matrixed organization
- Excellent presentation skills, including strong oral and written capabilities in English
- Self-motivated, results-oriented individual with the ability to progress multiple priorities concurrently