Alfa-Bank

Lead DevOps Engineer Hadoop

6.0/10
Alfa-Bank
Not specified
Remote
mid
about 5 hours ago
AI SummaryVerified by Aipplify AI

The vacancy is detailed but lacks compensation information, affecting overall quality.

AI quality score6.3 / 10

Check Match โ€” Just drop your CV

See your fit for Lead DevOps Engineer Hadoop in seconds.

Overview

Alfa-Bank is looking for a Lead DevOps Engineer to manage and develop their Hadoop cluster, ensuring service availability and performance optimization.

Responsibilities

  • โ€ขAdministration and development of the Hadoop cluster (HDFS, YARN, Hive, Spark)
  • โ€ขEnsuring service fault tolerance and availability
  • โ€ขMonitoring, alerting, and incident analysis
  • โ€ขPerformance optimization of the cluster and services
  • โ€ขAutomation of routine operations (Ansible, scripts)
  • โ€ขInteraction with development and analytics teams
  • โ€ขDocumentation maintenance (runbooks, instructions)

Requirements

  • โ€ขExperience in Linux administration (systemd, networks, disks, RAID/LVM)
  • โ€ขPractical experience with Hadoop (HDFS, YARN, Hive, Spark)
  • โ€ขUnderstanding of HA (Active/Standby, Zookeeper quorum)
  • โ€ขExperience in configuring Kerberos and TLS
  • โ€ขDiagnostic skills (top, iostat, vmstat, tcpdump)
  • โ€ขExperience with monitoring (Prometheus/Grafana or similar)
  • โ€ขBash/Python, Ansible S3 / Object Storage
  • โ€ขExperience with S3-compatible storage (MinIO, AWS S3)
  • โ€ขIntegration of Hadoop/Spark with S3 (s3a)
  • โ€ขUnderstanding the differences between HDFS and Object Storage
  • โ€ขOptimization of S3 usage (multipart upload, tuning)
Loading similar jobs...