AI SummaryVerified by Aipplify AI
The vacancy is detailed but lacks compensation information, affecting overall quality.
AI quality score6.3 / 10
Check Match โ Just drop your CV
See your fit for Lead DevOps Engineer Hadoop in seconds.
Overview
Alfa-Bank is looking for a Lead DevOps Engineer to manage and develop their Hadoop cluster, ensuring service availability and performance optimization.
Responsibilities
- โขAdministration and development of the Hadoop cluster (HDFS, YARN, Hive, Spark)
- โขEnsuring service fault tolerance and availability
- โขMonitoring, alerting, and incident analysis
- โขPerformance optimization of the cluster and services
- โขAutomation of routine operations (Ansible, scripts)
- โขInteraction with development and analytics teams
- โขDocumentation maintenance (runbooks, instructions)
Requirements
- โขExperience in Linux administration (systemd, networks, disks, RAID/LVM)
- โขPractical experience with Hadoop (HDFS, YARN, Hive, Spark)
- โขUnderstanding of HA (Active/Standby, Zookeeper quorum)
- โขExperience in configuring Kerberos and TLS
- โขDiagnostic skills (top, iostat, vmstat, tcpdump)
- โขExperience with monitoring (Prometheus/Grafana or similar)
- โขBash/Python, Ansible S3 / Object Storage
- โขExperience with S3-compatible storage (MinIO, AWS S3)
- โขIntegration of Hadoop/Spark with S3 (s3a)
- โขUnderstanding the differences between HDFS and Object Storage
- โขOptimization of S3 usage (multipart upload, tuning)
Loading similar jobs...