Data Engineer

CINIMEX is looking for a Senior Data Engineer to develop ETL pipelines and optimize data processes using Apache Spark, ClickHouse, and more. Flexible work format in Moscow, Nizhny Novgorod, or St. Petersburg.

• •Development of ETL pipelines (Apache Spark on Java, HDFS (parquets), ClickHouse, Hive, Greenplum);
• •Development of data marts in Greenplum and ClickHouse;
• •Orchestration of ETL processes;
• •Optimization of ETL processes (batching, retries, SLA control);
• •Interaction with BI developers and DevOps for timely data delivery to Superset.

• •Work in an accredited IT company;
• •Work format: office/hybrid (Moscow/Nizhny Novgorod/Saint Petersburg);
• •Flexible start time: from 08:00 to 11:00 (MSK);
• •Health insurance including dental, telemedicine, and travel insurance;
• •Ability to take sick leave without a sick note: 7 days a year;
• •Gradual adaptation from HR and line manager;
• •Review and development: we evaluate results, discuss career goals, and build an individual development plan;
• •IT conferences, courses, training, and certifications funded by the company;
• •Corporate English;
• •Personal brand development: preparing speakers for conference presentations, assisting in article writing;
• •Internal meetups, online/offline activities (quizzes, board game nights, sports events).

• •Deep expert experience with Apache Spark for 4-5 years (job optimization, working with wide and narrow dependencies, memory and shuffle operations tuning);
• •Experience with ClickHouse;
• •Experience with Hadoop (HDFS, Hive);
• •Experience in designing and developing data streams, loading and processing algorithms;
• •Experience in optimizing ETL pipelines and SQL code;
• •Advanced SQL knowledge;
• •Willingness to learn Java for Spark usage.