Aipplify
JobsCompaniesBlogFor Recruiters
Sign InCreate Account
Sber

Data Engineer (Premium Solutions)

6.0/10

Sber

Not specified
Hybrid
mid
about 4 hours ago
datadevtechfintechaiHadoopGreenplumSQLApache SparkHiveImpalaApache Airflow

AI Summary

The vacancy is strong in task clarity and requirements but lacks compensation details.

Check Match — Just drop your CV

See your fit for Data Engineer (Premium Solutions) in seconds.

Description

What you'll do

  • •Development, optimization, and maintenance of large-scale ETL/ELT pipeline processes on Hadoop and Greenplum for big data processing;
  • •Integration and consolidation of data from multiple internal and external sources, including data streams (Kafka), into a unified storage (Hadoop);
  • •Design and development of corporate data warehouse based on Greenplum and Hadoop: creating data marts for analytics and reporting, optimizing existing tables and queries;
  • •Automation and orchestration of data processing processes;
  • •Ensuring reliability, fault tolerance, and data quality in operational environments: performance monitoring, identifying bottlenecks and resolving them;
  • •Interaction with business and IT teams to clarify data requirements and collaboratively implement projects.

Requirements

  • •At least 2 years of experience as a Data Engineer (or similar role);
  • •Proficient in SQL: writing complex queries, performance optimization, understanding database design principles and data warehouse organization;
  • •Practical application of Big Data technologies: Hadoop (HDFS, YARN), Apache Spark (writing and running jobs), as well as storage/processing systems like Hive, Impala, or Greenplum;
  • •Experience using orchestration systems and task schedulers (Apache Airflow, Oozie, or similar) for building ETL/ELT processes;
  • •Knowledge of containerization and cloud orchestration tools (Docker, Kubernetes) and experience with streaming data (Kafka or similar platforms);
  • •Understanding of distributed computing principles, high-load systems, and processing large volumes of data;
  • •English language proficiency sufficient for reading technical literature and documentation.
Loading similar jobs...