In this role, you will get to:
- Design and construct scalable data processing systems.
- Develop high-performance algorithms, predictive models, and prototypes for data ingestion and processing.
- Collaborate with enterprise architects, data scientists, and IT team members to integrate systems and ensure consistent data lifecycle management.
- Conduct advanced data analysis and complex designs for big data and data streaming platforms.
- Troubleshoot data-related issues and refine system performance to ensure optimal data flow and processing efficiency.
- Ensure compliance with data governance and data security requirements, maintaining data privacy and adhering to company policies and external regulations.
- Provide guidance and mentorship to junior data engineers and team members (for senior levels).
- Lead the integration of new data management technologies into existing structures (for senior levels)
You'll be successful if you have:
- At least 3 years of experience in a data engineering role for junior levels, with hands-on experience in managing large-scale database systems.
- For senior levels, a minimum of 7 years in data engineering roles with a proven track record of successful project delivery, including experience in leading DWH projects.
- Proficiency in ETL processes, data modeling, SQL, Python, Java, and big data technologies such as Hadoop, Spark, and Kafka.
- Familiarity with cloud services (AWS, Azure, GCP) and Unix/Linux environments.
- Understanding of data warehousing solutions and knowledge of cloud platforms
