Lead Data Engineer

What you will do:

• Design and develop large and high performance data processing systems to drive LINE MAN Wongnai business growth and improve the product experience.
• Lead and oversee data engineering projects to ensure pipelines are reliable, efficient, testable, & maintainable.
• Improve data quality to management and governance.
• Evangelize high quality software engineering practices towards building data pipelines and platforms at scale.
• Contribute to shared engineering tooling & standards to improve the productivity and quality of output for engineers across the company

What you will need:

• At least 5-7 years of practical or hands-on experience in Data Engineering or relevant industry
• Excellent problem-solving skills and attention to detail
• Effective communication and collaboration skills
• Knowledge and experience with data quality frameworks (e.g., Great Expectations)
• Working knowledge with both relational and non-relational databases (e.g., MongoDB, MySQL, PostgreSQL)
• Strong proficiency in SQL, Python, and other programming languages commonly used in data engineering
• Extensive hands-on experience with Apache Spark Batch/Real Time and performance tuning
• Proven hands-on experience with Hadoop and familiarity with open table formats
• Experience with Polars and DuckDB (Preferable)