Home

Harsha - Azure Data Engineer

[email protected]

Location: Atlanta, Georgia, USA

Relocation: yes

Visa: h1b

Harsha Vardhan Ramagiri [email protected] 248-823-8786 PROFESSIONAL SUMMARY Around 7.5 years of experienced professional, and certified Azure Data Engineer. Design and implement ETL using ADF data pipelines to move and transform data from various sources into Azure Data Lake, Azure SQL Database, Data Bricks. Proficient Xin Azure Data Factory, Integration Run Time, File System Data Ingestion and Relational Data Ingestion. Design and implementation of Azure SQL Datawarehouse solutions Adapt in data query, data migration, data analysis and implementation with extensive use of SQL, Python, Pyspark. Extraction of data from various data sources SQL Server, Oracle legacy databases using ADF and transformed the data using Databricks. Experienced in Azure Services like Azure Synapse, ADF, Azure Databricks, Power BI, azuregen2 lake. Experience in complete project life cycle activities, Analysis, Design, Testing and Implementation. Good knowledge in Azure infrastructure Excellent communication and presentation skills WORK EXPERIENCE Accentiqa Systems Senior Cloud Data Engineer and Analyst - Feb 2023 to Present Cloud Data Engineer - Nov 2018 to Jan 2023 Production Support / Operations Engineer - Apr 2017 to Oct 2018 EDUCATION B.S from Sri Chandrasekarendra Saraswathi Viswa Maha Vidyalaya [SCSVMV], Kanchipuram, Tamil Nadu, India, in 2017. TECHNICAL SKILLS Azure Services Azure Synapse, ADF, Azure Databricks, Power BI Azure Keyvault, azuregen2 lake, Azure DevOps, Azure SQL Database Programming Languages Python, PL/SQL, Shell scripting, Spark Databases Azure SQL, SQL Server, Oracle, MySQL, Snowflake Platforms & O/S Azure, Windows, Linux, Unix Source Code Management GitHub, Code commit, Docker Ticketing Tools Jira, iSupport, Azure Boards ETL Tools Talend, Azure Data Factory TRAININGS Azure Bootcamp Training ITIL v3 Service Management Unix, SQL, Talend WORK EXPERIENCE Project # 1 Dealer connectivity and Integration Duration Feb 2023 to till date Client Caterpillar Inc. is the world s leading manufacturer of construction and mining equipment, diesel and natural gas engines, industrial turbines and diesel-electric locomotives. Technologies Azure Synapse, ADF, Azure Databricks, Power BI, Azure Keyvault, azuregen2 lake, Pyspark, Azure SQL Database, Snowflake, Azure DevOps, GitHub Role Senior Cloud Data Engineer and Analyst Responsibilities & Key Tasks Collaborated with various business teams to understand the logic for different dealers. Collaborated with various stakeholders to provide input and guidance to the team as a temporary team leader. Manages data from multiple dealers and domains, including invoices, customers, and equipment. Develops error-free pipelines for various dealers through ADF for integration. Connects with various databases, including AS400, Azure, and Snowflake, to retrieve source data for analysis and processing. Used Databricks to dynamically create scripts for performing transformations and validations on source data. Worked on a dedicated project to resolve a major issue with XML files using shell scripting to automate data processing Developed a Python script to efficiently chunk XML files for improved data processing and management. Executes CI/CD pipelines using Azure DevOps to deploy code across different environments, ensuring efficient and reliable releases. Designed and developed interactive Power BI dashboards to visualize key performance indicators (KPIs) such as part sales performance, inventory levels, and dealer-specific retail trends for Caterpillar s heavy machinery equipment. Project # 2 Market Zone Black Duration Nov 2018 to Jan 2023 Client Aetna Inc. an American managed health care company that sells traditional and consumer directed health care insurance and related services. Technologies Azure Synapse, ADF, Azure Databricks, Power BI, Azure Keyvault, azuregen2 lake, Pyspark, Talend, SQL, Unix Role Cloud Data Engineer and Analyst Responsibilities & Key Tasks Designed, developed, and maintained Azure Data Factory (ADF) pipelines for data integration, ETL, and data transformation. Implemented data connectors and activities within ADF to ingest data from various sources, both on-premises and in the cloud. Collaborated with data scientists to create and optimize data processing tasks in Azure Databricks notebooks and create Reports in Power BI as per client s requirements. Built and managed Databricks clusters for scalable data processing and analytics. Developed data models and optimized query performance in Azure SQL Data Warehouse and Azure Synapse Analytics. Automated data pipelines and workflows, reducing manual intervention and improving efficiency. Conducted performance tuning and optimization for large datasets, improving data processing speed and query performance. Project # 3 Technical Operations Center Duration Apr 2017 to Oct 2018 Clients Data-Axle, formerly Infogroup, is a provider of data, technology and marketing services for salespeople, marketers, and professionals Technologies Prometheus, Grafana, Zabbix, ACS, iSupport, Jira, SharePoint, Atlassian, Putty, Ringcentral, Unix Shell Scripting, SQL Role Production & Technical Support Engineer Responsibilities & Key Tasks Work on ticketing-based system according to ITIL process; wherein we get requests for Change Management, Incident Management, problem management and Standard Service requests. Monitor Autosys jobs, escalated job failures and long running jobs. Worked on around 500+ Linux and windows servers: including production, development & testing servers. Performance Monitoring, Issue resolutions at Server, N/W, VM, & Cloud Infra. Handling users queries and infra issues, restoring services for business continuity. Writing SQL queries for data extraction and reports for business users requests Creating technical solution documents (Standard Operations Procedure) for repeated issues Performing the daily, weekly, and monthly health checks to prevent the business slow down/shut down. Collaboration with the requester/users for complex issues resolution Collaboration with the team for seamless operations and rotation of the support activities Status reporting to the management, participation in the daily and weekly status meetings with the clients Keywords: continuous integration continuous deployment business intelligence procedural language