PySpark Data Manipulation
Collection of PySpark applications covering data cleaning, aggregations, joins, and transformation pipelines for downstream ML workflows.
- PySpark
- Big Data
- Python
Projects
Data Engineering
Big data manipulation, distributed computing, and database querying — building the pipelines that make data science possible at scale.
Energy Prediction with Spark on Databricks
End-to-end ML pipeline on Databricks using PySpark for feature engineering on a high-dimensional dataset, followed by energy consumption prediction with multiple algorithms compared for production suitability.
- PySpark
- Databricks
- Machine Learning
- Feature Engineering
MongoDB Querying
Practical MongoDB queries covering aggregation pipelines, filtering, projection, sorting, and document manipulation — demonstrating NoSQL patterns for semi-structured data.
- MongoDB
- NoSQL
- Aggregation