Senior Data Platforms Engineer

Vakansiyanın detalları

Design and implement scalable data architecture solutions across hybrid environments
Automate and streamline data delivery pipelines for agility and reliability
Enable CI/CD for data pipelines and improve data reliability and security
Create automated testing frameworks for data pipelines and schemas
Implement data security controls and access management
Optimize performance of data platforms and infrastructure
Monitor data systems health and resolve infrastructure issues
Design and implement solutions that optimize cost and performance across hybrid environments
Implement RBAC/ABAC data access controls that work consistently across all platforms
Troubleshooting complex distributed systems and performance bottlenecks

Strong experience building CI/CD pipelines for data infrastructure and applications
Experience with cloud platforms (AWS, Azure, GCP)
Experience with implementing and maintaining Data Lakes, Data Warehouses, and Lakehouse platforms
Knowledge of modern data processing frameworks (Spark, Trino, etc.)
Experience with implementing real-time/near real-time pipelines (Kafka, Flink, Spark streaming etc.) and replication (CDC)
Experience with infrastructure-as-code and automation tools (Terraform, Ansible, etc)
Knowledge of containerization technologies (E.g. Docker, Kubernetes) and orchestration (e.g. Airflow)
Experience with data storage technologies and database management systems (e.g. relational, noSQL, graph, etc)
Understanding of network architecture and security principles
Familiarity with monitoring tools and observability concepts (Prometheus, Grafana, Kibana etc)
Experience with Terraform for Infrastructure as Code in cloud environments
Experience with API management and integration patterns
Familiarity with telecommunications industry data structures
Experience with distributed systems and high-availability data architectures