Senior Data Engineer
7.0/10
Ethena Labs
Not specified
Remote
senior
about 2 months ago
cryptodevfintechweb3PythonSQLTerraformAWSGCPTimescaleDBClickHouseWebSocket
AI Summary
The vacancy is well-detailed in tasks and tech stack but lacks compensation clarity and direct company links.
Check Match β Just drop your CV
See your fit for Senior Data Engineer in seconds.
Description
What you'll do
- β’Rapidly spin up the cloud environment.
- β’Deliver working historical backfill pipelines from Tardis.dev into a queryable database.
- β’Deliver a real-time Tardis WebSocket pipeline, ensuring data is normalized, cached for live consumption, accurate, replayable, and queryable by Day 60.
- β’Ensure all pipelines are idempotent, retryable, and use exactly-once semantics.
- β’Implement full CI/CD, Terraform, automated testing, and secrets management.
- β’Implement proper observability (structured logs, metrics, dashboards, alerting) from day one.
- β’Provide immediate self-service access to the MVP database for Trading and BI teams via tools like Tableau/Metabase, and through simple internal REST APIs.
- β’Develop specialized timeseries data, including USDe backing-asset and a full opportunity-surface timeseries for Delta-neutral/lending/borrow opportunities.
- β’Ingest data from additional sources (Kaiko, CoinAPI, on-chain via TheGraph/Dune).
- β’Plan for 10x+ data growth via schema evolution, partitioning, and performance tuning.
- β’Establish enterprise-grade governance, including a data quality framework, RBAC, audit logs, and a semantic layer.
- β’Create full architecture documentation, runbooks, and a data dictionary.
- β’Onboard and mentor future junior staff.
Conditions
- β’Work alongside a passionate and innovative team that values collaboration and creativity.
- β’Enjoy a flexible, remote-friendly work environment with established opportunities for personal growth and learning.
Requirements
- β’Proven track record of delivering working, production data in weeks, not months, with the ability to ruthlessly cut scope to hit a 60-day MVP while managing technical debt.
- β’Have built Tardis historical and real-time pipelines before (or equivalent high-quality crypto market data feeds), understanding specific quirks, rate limits, and WebSocket structures.
- β’Expert in large-scale, reliable ETL/ELT for financial or market data.
- β’Fluent in provisioning full environments with Terraform in days and expert in AWS/GCP serverless technologies.
- β’Expert Python and SQL skills and proficiency with time-series databases like TimescaleDB or ClickHouse, ensuring fast queries from day one.
- β’Advanced knowledge of WebSocket clients, message queues, and low-latency streaming, GitOps, automated testing/deploy and observability practices.
- β’Significant understanding of stablecoins, lending protocols, and opportunity surface concepts, or a proven ability to ramp up extremely quickly.
Loading similar jobs...