Bhagya Isuru Warnakulasooriya

Company Overview: DataLearnHub empower learners through expertly designed data engineering courses on Udemy. My Udemy courses, focused on cloud data solutions like Azure and big data tools, combine theory with practical labs to give you real-world skills and certifications that matter. DataLearnHub is specialized in crafting Udemy courses for both beginners and professionals. Worked from Singapore.

• Website: https://datalearnhub.org/

• Course Titles:

Azure Data Engineer Essentials: DP-203 Framework and Beyond

Master Azure Data Engineering - BEGINNER to ADVANCED Training with Real-World Labs and Career- Focused Skills

https://www.udemy.com/course/dp203-azure-data-engineer-associate-exam-preparation/?couponCode=ST17MT31325G1

Azure Synapse Analytics: Beginner to Expert

Master ALL Dedicated, Serverless and Spark pools of Azure Synapse from Beginner to Advanced through this course

https://www.udemy.com/course/master-azure-synapse-analytics-beginner-to-pro-in-2-days/?couponCode=ST17MT31325G1

DP-900: Master Azure Data Fundamentals in Just 3.5 Hours!

DP-900 Certification - FULL Coverage of the LATEST Syllabus with Practical Labs with Beginner-Friendly Content!

https://www.udemy.com/course/dp-900-azure-data-fundamentals-certification-preparation/?couponCode=ST17MT31325G1

• Company Overview: Worked for a US Client -Cushman and WakeField, USA
• 100% remote working
• Development and maintenance of Azure Data Factory (ADF) pipelines to implement ETL/ELT architectures, ensuring smooth data integration across various structured and unstructured sources
• Designed and implemented complex SQL solutions, including Stored Procedures, Functions, Views, Common Table Expressions (CTEs), and Window Functions, to efficiently transform and aggregate data per business requirements
• Developed and optimized Dynamic SQL for parameterized queries, reducing redundant code and improving maintainability
• Implemented Performance Tuning in SQL queries and stored procedures using indexing strategies, query rewriting, execution plan analysis, and table partitioning to enhance database performance
• Designed error-handling frameworks within stored procedures, incorporating TRY...CATCH, custom error messages, and logging mechanisms for better troubleshooting
• Implementation of full and incremental loads into Delta Lake through PySpark/Spark SQL development in Azure Databricks and prepare data for Machine Learning
• Implementing techniques to improve the performance of Delta Tables
• CI/CD with Azure DevOps
• Working experience on Azure Purview
• Successfully conducted training sessions on Azure Synapse Analytics
• SQL query Optimization
• Configured Lifecycle Management Policies in Azure Data Lake to optimize storage, automate retention policies, and ensure cost-effective data management
• Implementing security measures such as role-based access control (RBAC), encryption, and threat detection
• Led initiatives to enhance internal security posture, including conducting security audits, penetration testing, and threat modeling
• Troubleshoot Power BI report-related issues
• Performed DAX queries and functions in Power BI
• Brought the data needed for the report/dashboards into views using stored procedures
• Influx DB and Grafana dashboard development for Internal Proof of Concept project (presales stage project for a new Chinese client)
• Work with the client directly to support the scope and objectives and suggested solutions to meet the business requirements
• Provided support to the business when they come up with change requests and troubleshoot issues
• Recommended business-critical solutions that deliver value to stakeholders
• Presented delivery status of new requests/change requests/Bug fixes/data validations/ QA releases/ PROD Releases in the bi-weekly Scrum meetings

• SQL Development
• Build ETL(SSIS) Pipelines
• Maintain ETL pipelines and troubleshoot ETL related issues
• Performance optimization of databases and SQL queries
• Technical requirement analysis on Migrating from Onpromise to Azure
• SQL server migrations (Prepared the migration guide on migrating 2008 SQL Server to 2019 SQL server that was used by Tech Ops and Management)
• Power BI report development

• SQL development for a large number of complex data extraction requirements from the database involving multiple tables and views
• Managed tracking effective KPIs related to the website traffic to ensure the performance of the pages
• Prepared, analyzed, and summarized various weekly, monthly, and periodic operational results
• Development of reports, visual dashboards, and come up with useful insights and suggestions for improvement
• (Used Technologies: Data Warehouse - MaxCompute, Visualization tool - Quick BI)

• Collaborated with development teams to secure RESTful APIs, implementing OAuth, token-based authentication, and rate-limiting strategies
• Developed and integrated APIs across multiple platforms to streamline processes, ensure scalability, and secure data exchange
• Developed ETL pipelines using Azure Data Factory (ADF) and SQL Server Integration Services (SSIS) to cleanse, integrate, and transform geological datasets, enhancing data accuracy and consistency
• Designed SSIS packages for data extraction, transformation, and loading (ETL), implementing logging, checkpoints, and error handling for robust data processing
• Optimized Azure SQL Database with indexed data models to support complex geology-specific queries and analysis
• Developed SQL-based transformations, including Stored Procedures, Functions, and Views, to implement ETL logic while ensuring business requirements are met
• CI/CD
• Implemented performance tuning techniques in stored procedures, including query optimization and indexing strategies
• Configured Error Handling & Logging in both ADF pipelines and SSIS packages to improve monitoring and fault tolerance
• Designed and implemented Row-Level Security (RLS) and Dynamic Data Masking (DDM) in Azure SQL DB to enforce data access policies
• Maintained and troubleshot Azure Data Factory and SSIS ETL workflows, ensuring data integrity and job reliability
• Expertise in utilizing Microsoft 365 services such as Teams, SharePoint, OneDrive, and Exchange, implementing security policies across the environment