Description
- Placing a focus upon exceeding client expectations and delivering against our continuous improvement goals, taking a client problem, and turning it into a technical solution
- Design, implement, and manage data ingestion pipelines to collect and ingest data from various sources into the cloud data platform. This might involve using tools like Apache Kafka, AWS Kinesis, or Azure Event Hubs.
- Develop and maintain data transformation processes to clean, enrich, and structure data for analytics and reporting purposes. This often involves using ETL (Extract, Transform, Load) tools or scripting languages like Python.
- Integrate different data sources and systems to ensure data consistency and accessibility. This may involve setting up data connectors or APIs.
- Implement and enforce data security measures, including encryption, access controls, and compliance with data privacy regulations such as GDPR or HIPAA.
- Monitor and optimize the performance of the cloud data platform to ensure efficient data processing and query performance. This may involve adjusting configurations, indexing, and caching.
- Create and maintain automation scripts and workflows to manage data pipelines, backups, and routine tasks. Infrastructure as Code (IAC) tools like Terraform or AWS CloudFormation may be used.
- Set up monitoring and alerting systems to proactively identify and address issues with data pipelines, platform health, and data quality. Tools like Prometheus, Grafana, or cloud-native monitoring solutions can be employed.
- Document data platform architecture, processes, and best practices. Collaborate with data engineers, data scientists, and other stakeholders to understand their requirements and ensure the data platform meets their needs.
Requirements
- Bachelor's degree in engineering from a reputable university.
- Minimum 3 - 8 years of relevant experience.
- Good command of English written and spoken.
- Extensive experience with public clouds, preferably in cloud platforms like AWS, Azure, or Google Cloud.
- Expertise in cloud infrastructure provisioning and management.
- Knowledge of cloud security best practices.
- Familiarity with networking and virtualization concepts.
- Experience with cloud migration and hybrid cloud solutions.
- Scripting and automation skills (e.g., using AWS CLI, PowerShell, or Terraform).
- Strong problem-solving abilities.
- Certifications: Cloud-specific certifications such as AWS Certified Solutions Architect, Microsoft Certified: Azure Solutions Architect Expert, or Google Cloud Professional Cloud Architect are highly regarded.
- Excellent analytical and problem-solving skills
- Excellent communication (written and oral) and interpersonal skills
- Demonstrated teamwork and collaboration in a professional setting
- Flexible and willingness to work on different projects and programming
| Created on | 15 Jan 2024 |
| Last updated on | 19 Nov 2024 |
| You applied on | |
Apply Now 