Senior Data Engineer (325074)
Information
Information Technology | |
Mid Career (2-6 years) | |
Not specified |
Company
Not specified | |
Financial Services | |
Mohandseen, Giza, Egypt Sheikh Zayed City, Giza, Egypt |
Description
- Collaborate with cross-functional teams, including data scientists, data analysts, and software engineers, to design, develop, and maintain data engineering solutions using Scala and Python.
- Drive the exploration and implementation of new data engineering technologies, frameworks, and tools to enhance performance, scalability, and efficiency.
- Work closely with infrastructure and operations teams to understand and optimize hardware and resource consumption in data engineering projects.
- Develop a deep understanding of the underlying hardware infrastructure, including servers, clusters, and distributed systems, to ensure optimal data processing and storage.
- Participate in the design and architecture of data pipelines, ensuring high performance, fault tolerance, and scalability.
- Conduct research and stay up-to-date with the latest advancements in data engineering, hardware technologies, and distributed computing paradigms.
- Mentor and guide junior team members, fostering a culture of continuous learning and skill development.
- Collaborate with stakeholders to gather requirements, propose technical solutions, and deliver high-quality data engineering projects.
Requirements
- Bachelor’s degree from a reputable university.
- Minimum 4 years of relevant experience as a Software Engineer, Preferably Minimum 2 years of experience in Data Engineering.
- Excellent proficiency in Spark, Scala, Python, MongoDB, and hands-on experience building robust and scalable applications.
- Solid understanding of data structures, algorithms, and object-oriented programming principles.
- Experience with distributed data processing frameworks such as Apache Spark is highly desirable.
- Strong interest in gaining knowledge of hardware infrastructure, resource consumption optimization, and project development in data engineering.
- Experience with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra) is beneficial.
- Excellent ability to work in an Agile development environment and manage multiple priorities effectively.
- Familiarity with Apache Hive, Hadoop HDFS, and other relevant data engineering technologies is a plus.
- Excellent problem-solving and analytical thinking skills.
- Excellent communication and collaboration skills, with the ability to work effectively in a team setting.
- Proficiency in Arabic and English languages, both written and verbal is a must.
Created on | 03 Nov 2024 |
Last updated on | 20 Nov 2024 |