AI SummaryVerified by Aipplify AI
The vacancy is well-defined in tasks and requirements but lacks compensation details and company information.
AI quality score5.9 / 10
Check Match — Just drop your CV
See your fit for Data Engineer in seconds.
Overview
We are looking for a Data Engineer to design and develop data pipelines for cybersecurity event processing and optimize data storage solutions.
Responsibilities
- •Design and develop data pipelines for processing cybersecurity events;
- •Normalize and enrich security events;
- •Design and optimize analytical data warehouses (ClickHouse / StarRocks / analogs);
- •Prepare data marts for fast queries and analytics;
- •Operate data services in Kubernetes: deployment, resources, fault tolerance, scaling;
- •Ensure observability and data quality (metrics, alerts, replay/backfill);
- •Participate in incident analysis and performance optimization of the data platform.
Requirements
- •Experience in building and operating data pipelines (ETL, ELT, and/or streaming) in a production environment;
- •Proficient in SQL, including query optimization and performance analysis;
- •Experience with OLAP databases (ClickHouse/StarRocks/Druid/Pinot or analogs);
- •Understanding of data streaming principles (idempotency, deduplication, error handling);
- •Experience in designing and optimizing data marts and storage schemas;
- •Strong knowledge of Kubernetes and experience operating services in a production environment;
- •Understanding of reliability, scalability, and observability principles of data systems.
Loading similar jobs...