From API to S3 Data Lake: ETL Solutions in AWS read
Published technical article walking through an end to end AWS data pipeline: event-driven ingestion, Python-based processing, S3 storage architecture, and querying with Athena.
About
A closer look
I am a cloud data engineer at Woodmark Consulting in Berlin, where I own production AWS environments end to end. My work spans Terraform-provisioned infrastructure, event-driven pipelines for recurring workloads, large-scale data migrations from legacy stacks to AWS-native architectures, and being the person who fixes things when they break.
Three cloud certifications across AWS and Databricks, one published article on AWS ETL patterns, and a computer science degree with a 1.0 thesis on machine learning for energy efficiency.
Career
2025 · present
Consultant · Cloud Data Engineer
Woodmark Consulting GmbH · Berlin
Sole operational owner of multiple production AWS environments in a consulting setting. Terraform-provisioned infrastructure, event-driven pipelines on Lambda and Step Functions, and Bedrock agents integrated into a live analytics platform.
2024 · 2025
Associate Consultant · Cloud Data Engineer
Woodmark Consulting AG · Berlin
Operated a portfolio of AWS production processing workflows across multiple environments, with additional work on Azure Data Factory pipelines and PySpark jobs in Databricks.
2022 · 2023
Working Student · Data Analyst / Data Scientist
Airbus Operations GmbH · Bremen
Automated recurring data preparation workflows in Python for a research department, with early exposure to GCP.
Education
2020 · 2023
BSc Computer Science · Thesis grade 1.0
Constructor University (formerly Jacobs University) · Bremen
Merit-based scholarship. BSc thesis on machine learning and XAI for energy efficiency graded 1.0, the highest distinction in the German grading system. Organised jacobsHack! 2021 sponsors and led technical coordination for TEDxJacobsUniversity 2022.
Projects
Thesis: AI and XAI for Energy Efficiency
Predictive modeling on device-level electrical load in office buildings, benchmarking LSTM networks against ensemble methods on large-scale IoT sensor data. Final grade 1.0, the highest distinction in the German university grading system.
Skills
aws · 3+ yrs prod
Lambda, S3, Step Functions, EventBridge, Glue, Athena, ECR/ECS, Bedrock, QuickSight, CloudWatch
infra & automation
Terraform (IaC), Docker, Git/GitHub, CI/CD workflows, Python scripting
operations
Event-driven distributed systems, production ownership and incident response, high-availability workloads, containerised deployments
other cloud
Azure (Data Factory, ADLS Gen2, Synapse, Azure DevOps), GCP
programming
Python (PySpark, pandas, numpy, Polars), SQL, Bash, Apache Spark, Databricks
languages
English C2 · German B2 / C1 · French A2 · Nepali C2
Activity
Most of my current work lives in private and internal repositories, so it is not fully reflected here.