Data Engineer
6.0/10
Wildberries
Not specified
Remote
mid
7 days ago
analyticsdevtechAirflowHadoopSparkYarnHdfsGreenplumTrino
AI Summary
The vacancy is detailed in responsibilities and tech stack but lacks compensation clarity and broader company context.
Check Match — Just drop your CV
See your fit for Data Engineer in seconds.
Description
Responsibilities
- •Support pipelines on Greenplum;
- •Maintain and optimize existing ETL/ELT processes: monitoring, diagnosing degradations, partitioning, working with the catalog;
- •Integrate new sources;
- •Connect new product teams and external sources: technical research, design integration schemes, data contracts.
- •Interact with source owners on technical requirements;
- •Participate in migration: redesign layers for Iceberg (partitioning, schema evolution, snapshot management), understand MPP vs object storage trade-offs.
Requirements
Requirements
- •Experience with Airflow as an orchestrator;
- •Experience with Hadoop (Spark/Yarn/Hdfs);
- •Experience with Greenplum or other MPP systems;
- •Worked with Trino as a query engine.
Loading similar jobs...