- As a Middle Data Engineer, you will be at the forefront of developing and maintaining our advanced data infrastructure
- This role requires a deep technical skill set, a passion for data-driven decision-making, and a commitment to leading complex data projects from conception to execution - Architect and build high-performance, scalable data pipelines using a variety of big data technologies and frameworks
- Implement batch and real-time data processing solutions, optimizing for speed and efficiency
- Design and administer sophisticated database solutions, both SQL (e.g., PostgreSQL, MySQL) and NoSQL (e.g., MongoDB, Cassandra)
- Optimize data storage and retrieval mechanisms, and implement data lifecycle management strategies
- Develop and maintain complex ETL processes with a focus on efficiency, reliability, and automation
- Utilize advanced ETL tools and orchestration solutions like Apache Airflow or similar technologies
- Lead data modeling initiatives to support advanced analytics and business intelligence
- Design and implement data warehousing solutions, ensuring scalability and accessibility of data
- Provide technical guidance and mentorship to junior data engineers
- Lead code reviews, establish best practices, and promote a culture of continuous learning and improvement
- Evaluate and integrate the latest big data technologies and software to keep the data infrastructure ahead of industry standards
- Drive innovation by exploring new methodologies and technologies for data processing and analytics
- Proficient in multiple programming languages, especially Python, Java, and Scala
- Expertise in big data technologies such as Hadoop, Spark, Kafka, and Flink
- Strong experience with cloud-based data solutions on platforms like AWS (e.g., S3, Redshift, EMR), Azure, or GCP
- In-depth knowledge of SQL and NoSQL databases, including performance tuning and query optimization
- Experience with data integration tools and frameworks (e.g., Apache NiFi, Talend)
- Familiarity with machine learning algorithms and data science methodologies
Solid understanding of data security and compliance best practices
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
- Minimum of 3 years of experience in data engineering
- Demonstrated leadership in managing large-scale data projects Interested candidates are requested to submit CV to e-mail with subject “Middle Data Engineer”