| Data Architect | Georgia | Locals only at Remote, Remote, USA |
| Email: [email protected] |
|
From: Charan, Anveta [email protected] Reply to: [email protected] Role: Data Architect (Microsoft Fabric & Azure Databricks) Location: Atlanta, Georgia 30334 (Hybrid) Note: Only Locals Duration: 6+ Months Job Description Required Qualifications: Education: Bachelors degree in computer science or related field. Experience: 6+ years of experience in data architecture and engineering. 2+ years hands-on experience with Azure Databricks and Spark. Recent experience with Microsoft Fabric platform. Technical Skills: Microsoft Fabric Expertise: Data Integration: Combining and cleansing data from various sources. Data Pipeline Management: Creating, orchestrating, and troubleshooting data pipelines. Analytics Reporting: Building and delivering detailed reports and dashboards to derive meaningful insights from large datasets. Data Visualization Techniques: Representing data graphically in impactful and informative ways. Optimization and Security: Optimizing queries, improving performance, and securing data Azure Databricks Experience: Apache Spark Proficiency: Utilizing Spark for large-scale data processing and analytics. Data Engineering: Building and managing data pipelines, including ETL (Extract, Transform, Load) processes. Delta Lake: Implementing Delta Lake for data versioning, ACID transactions, and schema enforcement. Data Analysis and Visualization: Using Databricks notebooks for exploratory data analysis (EDA) and creating visualizations. Cluster Management: Configuring and managing Databricks clusters for optimized performance. (Ex: autoscaling and automatic termination) Integration with Azure Services: Integrating Databricks with other Azure services like Azure Data Lake, Azure SQL Database, and Azure Synapse Analytics. Machine Learning: Developing and deploying machine learning models using Databricks MLflow and other tools. Data Governance: Implementing data governance practices using Unity Catalog and Microsoft Purview Programming & Query Languages: SQL: Proficiency in SQL for querying and managing databases, including skills in SELECT statements, JOINs, subqueries, and window functions12. Python: Using Python for data manipulation, analysis, and scripting, including libraries like Pandas, NumPy, and PySpark Data Modeling: Dimensional modeling Real-time data modeling patterns Soft Skills: Strong analytical and problem-solving abilities Excellent communication skills for technical and non-technical audiences Experience working with government stakeholders Preferred Experience: Azure DevOps Infrastructure as Code (Terraform) CI/CD for data pipelines Data mesh architecture Certifications (preferred): Microsoft Azure Data Engineer Associate Databricks Data Engineer Professional Microsoft Fabric certifications (as they become available) Project-Specific Requirements: Experience designing data architectures for grant management systems Knowledge of federal/state compliance requirements for data handling Understanding of financial data processing requirements Experience with real-time integration patterns This position requires strong expertise in modern data architecture with specific focus on Microsoft's data platform. The successful candidate will play a crucial role in designing and implementing scalable data solutions that enable efficient data processing and analytics for state-level grant management and reporting systems. Thanks & Regards Charan Anveta, Inc. 1333 Corporate Drive, Suite #108 Irving, TX 75038 [email protected] https://www.linkedin.com/in/charan-reddy-ba6450236/ Keywords: continuous integration continuous deployment Texas Data Architect | Georgia | Locals only [email protected] |
| [email protected] View All |
| 02:07 AM 03-Dec-24 |