AI SummaryVerified by Aipplify AI
The vacancy is well-defined but lacks compensation details, affecting overall attractiveness.
AI quality score6.3 / 10
Check Match — Just drop your CV
See your fit for Data Engineer in seconds.
Overview
Wildberries is looking for a Data Engineer to ensure the stable and secure operation of their Data Platform using Trino, Spark, S3, and Apache Iceberg.
Responsibilities
- •Ensure stable, productive, and secure operation of the Data Platform based on Trino, Spark, S3, and Apache Iceberg, including administration and management of the access role model, documenting changes in the project.
- •Configure, update, monitor, and tune Trino clusters.
- •Set up connectors (Iceberg, S3).
- •Optimize query performance (resource groups, query analysis).
- •Optimize Iceberg performance (partitioning, clustering, metadata management).
- •Develop and implement centralized role models for data and resource access on the platform.
Requirements
- •Understanding of the interaction between Spark, Iceberg, and S3.
- •Experience in operating Apache Iceberg (administration of Iceberg format tables, configuration and use of Hive Metastore).
- •Understanding and application of: compaction, expiration snapshots, time travel, schema evolution.
- •Skills in Linux, Bash, Python for automation.
- •Experience managing access policies and permissions through Ranger in S3 and Iceberg.
- •Experience in developing and implementing a centralized role model for data and resource access on the platform.
- •Experience in administering Greenplum or ClickHouse (installation, configuration, optimization, integration with S3/Iceberg).
Loading similar jobs...