Senior Data Engineer (325074)

  Information

Information Technology
Mid Career (2-6 years)
Not specified

  Company

Not specified
Financial Services
Mohandseen, Giza, Egypt
Sheikh Zayed City, Giza, Egypt

  Description

  • Collaborate with cross-functional teams, including data scientists, data analysts, and software engineers, to design, develop, and maintain data engineering solutions using Scala and Python.
  • Drive the exploration and implementation of new data engineering technologies, frameworks, and tools to enhance performance, scalability, and efficiency.
  • Work closely with infrastructure and operations teams to understand and optimize hardware and resource consumption in data engineering projects.
  • Develop a deep understanding of the underlying hardware infrastructure, including servers, clusters, and distributed systems, to ensure optimal data processing and storage.
  • Participate in the design and architecture of data pipelines, ensuring high performance, fault tolerance, and scalability.
  • Conduct research and stay up-to-date with the latest advancements in data engineering, hardware technologies, and distributed computing paradigms.
  • Mentor and guide junior team members, fostering a culture of continuous learning and skill development.
  • Collaborate with stakeholders to gather requirements, propose technical solutions, and deliver high-quality data engineering projects.

  Requirements

  • Bachelor’s degree from a reputable university.
  • Minimum 4 years of relevant experience as a Software Engineer, followed by 2 years in Data Engineering.
  • Excellent proficiency in Spark, Scala, Python, MongoDB, and hands-on experience building robust and scalable applications.
  • Solid understanding of data structures, algorithms, and object-oriented programming principles.
  • Experience with distributed data processing frameworks such as Apache Spark is highly desirable.
  • Strong interest in gaining knowledge of hardware infrastructure, resource consumption optimization, and project development in data engineering.
  • Experience with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra) is beneficial.
  • Excellent ability to work in an Agile development environment and manage multiple priorities effectively.
  • Familiarity with Apache Hive, Hadoop HDFS, and other relevant data engineering technologies is a plus.
  • Excellent problem-solving and analytical thinking skills.
  • Excellent communication and collaboration skills, with the ability to work effectively in a team setting.
  • Proficiency in Arabic and English languages, both written and verbal is a must.
Created on03 Nov 2024
Last updated on03 Nov 2024
You applied on
  Apply Now