Middle Data Engineer
6.0/10
2ГИС
Not specified
Remote
mid
12 days ago
datadevtechSQLApache SparkKafkaClickHouseScalaPython
AI Summary
The vacancy is well-defined but lacks compensation details, affecting overall attractiveness.
Check Match — Just drop your CV
See your fit for Middle Data Engineer in seconds.
Description
What You Will Do
- •Expand existing data formats;
- •Develop and maintain ETL/ELT processes;
- •Automate batch calculations;
- •Connect new data sources;
- •Participate in migrating pipelines from Hadoop/HDFS to a new architecture (S3, Kafka, Spark, ClickHouse);
- •Work with large volumes of data and high-load Kafka topics.
Requirements
What Is Required
- •Experience with data — from junior+ to confident middle;
- •Understanding of ETL/ELT processes;
- •Ability to write SQL and read report logic comfortably;
- •Familiarity with Apache Spark, Kafka, ClickHouse is a plus;
- •Proficiency in one of the programming languages (e.g., Scala or Python);
- •Desire to develop in the direction of building data infrastructure.
Loading similar jobs...