Responsibilities :

• Work closely with data scientists, data analyst to create robust data architectures and pipelines.

• Collaborate with Data Analyst and Data Scientists to provide analyst data for analytics or model training

• Engagement in discussions with Data Analyst and Data Scientists to determine the preferred data format

• Develop and maintain data pipeline in both of batch and real-time

• Ensure data quality and consistency through data cleaning, transformation, and validation processes.

• Evaluating and improving model performance through statistical analysis and experimentation

• Develop and maintain an automate deployment (CI/CD) from Git Repository to Platform

• Take an ownership with assigned data domain

• Drive Agile (Scrum/Kanban) development methodologies.

Qualifications :

• 3+ years of data engineering experience

• Experience with data modeling, warehousing and building ETL pipelines

• Experience with one or more query language (e.g., SQL, PL/SQL, DDL, SparkSQL, Scala)

• Experience with one or more scripting language (e.g., Python, Scala)

• Experience with one or more framework (Spark, Pandas)

• Experience with AWS and GCP technologies

• Sense of ownership

• Good command in English