
Data Engineer/Junior–Middle
8.0/10
Data Never Lies
$20 – $30 USD
Remote
junior
about 4 hours ago
analyticsdatatechPythonSQLREST APIsdata pipelinesETLGit
AI Summary
The vacancy is well-structured with clear responsibilities and requirements, but lacks some details on compensation and company profile.
Check Match — Just drop your CV
See your fit for Data Engineer/Junior–Middle in seconds.
Description
Main Responsibilities
- •Connect to various data sources, extracting data via REST APIs, databases, files, and third-party platforms.
- •Process data and load it into a data warehouse for further analytics and BI reporting.
- •Ensure data pipeline stability with logging, error handling, retries, monitoring, and data quality checks.
Benefits
- •A variety of projects: trust us, you won’t be bored.
- •A sane schedule: we focus on tasks, not hours—but showing up at noon every day isn’t exactly smiled upon.
- •A team that values expertise and humor: yes, we occasionally crack jokes about SQL—don’t worry if you don’t laugh right away.
- •Choose your adventure: Dive deep into a single, large-scale project or opt for a “discovery” mode, collaborating with multiple global clients across different domains.
Requirements
Required Skills & Experience
- •Strong knowledge of Python and practical experience using it in data engineering tasks.
- •Experience building data pipelines for loading, processing, and transforming data.
- •Experience working with various data sources: REST APIs, databases, CSV/Excel/JSON files, cloud storage, and third-party platforms.
- •Hands-on experience integrating with REST APIs: authentication, pagination, rate limits, retries, timeout handling, and error handling.
- •Understanding of how to build fault-tolerant pipelines.
- •Experience setting up incremental data loading and handling partial loads.
- •Ability to work with JSON and semi-structured data.
- •Strong SQL knowledge: JOINs, CTEs, aggregates, and window functions.
- •Experience loading data into databases or data warehouses such as PostgreSQL, BigQuery, Snowflake, Redshift, MS SQL, or similar systems.
- •Understanding of ETL/ELT approaches.
- •Experience with logging, monitoring, and basic troubleshooting of pipelines.
- •Experience working with Git.
Loading similar jobs...