Data Engineer (Supervisor)

Job Scope:

• Design and implement scalable data pipelines to collect, process, and store large volumes of data from various sources.
• Develop and maintain ETL (Extract, Transform, Load) processes to ensure data accuracy and consistency.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
• Optimize data workflows and systems for performance and scalability.
• Ensure data security and compliance with relevant regulations and policies.
• Monitor and troubleshoot data pipeline issues to ensure data availability and reliability.
• Document data engineering processes and best practices.

Qualifications:

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer or in a similar role.
• Proficiency in programming languages such as Python, Java, or Scala.
• Experience with big data technologies such as Hadoop, Spark, or Kafka.
• Strong knowledge of SQL and experience with relational databases (e.g., MySQL, PostgreSQL).
• Familiarity with cloud platforms (e.g., AWS, Google Cloud, Azure) and their data services.
• Understanding of data warehousing concepts and experience with tools like Redshift, BigQuery, or Snowflake and databrick.
• Excellent problem-solving skills and attention to detail.
• Strong communication and teamwork abilities.
• Experience with real-time data processing and streaming.
• Knowledge of data governance and data quality best practices.
• Certification in relevant technologies or platforms is a plus.
• Required good command of English with native Thai speaking to communicate with Thai colleagues and business users.