Software Engineer, Data Platform
7.0/10
World
Not specified
Office / on-site
mid
about 2 months ago
aidevtechPythonDockerKubernetesAWSTerraformSnowflakeMongoDBSQLNoSQL
AI Summary
The vacancy is well-detailed in tasks, tech stack, and company profile but lacks compensation clarity.
Check Match — Just drop your CV
See your fit for Software Engineer, Data Platform in seconds.
Description
What you'll do
- •Design and operate automated data quality pipelines with human-in-the-loop review stages.
- •Develop and refine transformation processes to deliver clean, well-structured datasets.
- •Instrument systems with metrics, alerts, and recovery mechanisms.
- •Build APIs and backend services that provide secure, performant access to large datasets.
- •Raise engineering standards by improving CI/CD pipelines, integration tests, and dependency management.
- •Own the lifecycle of critical data assets, including lineage tracking, access control, and schema enforcement.
Requirements
- •5+ years of proficiency in Python, with experience building production services.
- •Strong system design fundamentals.
- •Experience designing and building APIs with security and performance requirements.
- •Comfortable with containerization and orchestration tools like Docker and Kubernetes.
- •Experienced with AWS services (S3, KMS, IAM) and Terraform for infrastructure as code.
- •Skilled in designing and operating data ingestion and transformation workflows.
- •Familiar with CI/CD pipelines and version control practices.
- •Committed to building systems that are secure, observable, and follow strong data governance principles.
- •Experience with structured logging, metrics instrumentation, and alerting.
- •Strong fundamentals in data modeling, schema design, and backward-compatible schema evolution.
- •Comfortable working with NoSQL systems like MongoDB.
- •Knowledge of data partitioning strategies and large-scale dataset optimization for analytics and ML.
- •Experience with event-driven data pipelines using SQS, SNS, Lambda, or Step Functions.
Loading similar jobs...