Technologies & Cloud Services

Data Engineering

• Apache Spark
• Apache Kafka
• Apache Airflow
• dbt (data build tool)
• Pandas
• SQL
• Python

Cloud Services

• AWS (Amazon Web Services)
• S3, EC2, RDS, Lambda, Glue
• Google Cloud Platform
• BigQuery, Cloud Storage, Dataflow
• Microsoft Azure
• Data Lake Storage, Synapse Analytics, Cosmos DB

Technologies

• Docker & Kubernetes
• Git & Version Control
• CI/CD Pipelines
• Monitoring & Logging Tools
• APIs & REST Services