Objective:
Challages
Solution
Extracted raw data from SQL Server databases, including patient, test, client, and organisational data.
Utilised Spark and Hive for transforming raw data, cleansing, filtering, and structuring datasets.
Loaded transformed data into HDFS or S3 in CSV format for accessibility and further analysis.
Utilised tools like Power BI and Tableau for reporting and visualisation.
Tools Used