V.

Lead Data Engineer
Location: RemoteRate: €50 / hour

Professional Summary

Lead data engineer with 10 years across ETL, analytics and data architecture. Strong in Python and SQL with deep RDBMS and NoSQL knowledge, cloud data platforms (Azure, GCP, AWS) and modern tooling (Databricks, dbt, Great Expectations). Track record of building high-load pipelines, optimizing very large databases (1.5B+ rows), leading migrations to Databricks-based architectures, and delivering analytics integrated with Power BI — plus requirements gathering and direct client communication.

Core Skills

Languages
SQL / T-SQL / PL-SQL, Python, R, PowerShell / Bash
Cloud
Azure (ADF, Databricks, Synapse, DevOps), GCP (BigQuery, BigTable, Dataflow, Dataproc), AWS (Redshift, Kinesis, Athena, SageMaker)
Databases
MS SQL, MySQL, PostgreSQL; MongoDB, Redis, Elasticsearch, Cosmos DB, DynamoDB
Data and ML
dbt, Great Expectations, Pandas, NumPy, SciPy; TensorFlow, Keras, PyTorch
Tooling
Docker, Django / Flask, Airflow, Git; Agile / Scrum

Professional Experience

E-commerce Data Solution — Retail — Data Engineer / Data Scientist / Team Lead
US client
High-load online sales platform with intense ETL and built-in analytics.
  • ETL processes, database structuring and maintenance for a high-availability platform.
  • Optimized very large databases (1.5B+ row tables); built classification models; led the team.
Tools: AWS, GCP, PostgreSQL, Python, TensorFlow, PyTorch, Flask/Django
E-commerce Data Solution — Finance — Senior / Lead Data Engineer
UK client
Banking system with heavy data processing on SQL Server, Databricks and Azure.
  • ETL/ELT, cloud data organization and architectural DB solutions.
  • Analytical tooling and Power BI reporting; migration from legacy SQL to a Databricks-based architecture.
Tools: SQL Server, Azure Data Factory, Databricks, Synapse, Azure DevOps, Python, PySpark, dbt, Great Expectations, Power BI
Global Consumer Data Platform — Lead Data Engineer / Data Architect
US client
  • Data migration, ETL, performance optimization and analytical tooling.
  • Led a 20+ member program with a 4–5 person dev team.
Tools: Azure Databricks, MS SQL Server, Azure DevOps, Azure Cloud, Python

Education & Certifications

Google Cloud Professional Data Engineer · AWS Certified Data Analytics – Specialty · Azure Data Engineer Associate · Databricks Platform Architect · TensorFlow Developer

Like this profile? Tell us about your project and we’ll set up an interview.

Interview this engineer →
Presented by Datarob — data engineers, on demand · datarob.com