| Sr. Data Engineer--- Remote at Remote, Remote, USA |
| Email: [email protected] |
|
From: Shivam Pachauri, Tek inspirations LLC [email protected] Reply to: [email protected] Job Description - Role:: Sr. Data Engineer Duration:: 6+ month contract Location:: Remote East Coast Candidates ONLY They are looking for a Data Engineer that comes from a networking background and are considering candidates that have a completed OR partially completed CCIE (Cisco Certified Internetwork Expert) Key words that need to be present include: Databricks, and Data Stage (also known as IBM InfoSphere) RESPONSIBILITIES Utilize approved tools, adopt key performance indicators (KPIs), increase technology component reuse, and consolidate platforms, environments, and products with the goal of reducing overall IT costs. Able to easily convert/deploy all the Data Platform Services into code-based artifacts using ARM templates or BICEP along with security and compliance. Proven solution design skills being able to script and automate a solution end-to-end (infrastructure and application layers). ETL in Azure Data Factory and Databricks Provide support and advice to operational infrastructure teams to enable efficient operation and problem resolution of teams infrastructures. Supporting the planning and implementation of data design services, providing sizing and configuration assistance, and performing needs assessments. Monitoring progress, managing risk, and ensuring key stakeholders are kept informed about progress and expected outcomes. Working experience with Visual Studio, Power Scripting, and ARM templates. Ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flows. Security (Best Practices, Containers, Linux Hardening) Provisioning resources as per the security standards Good understanding of AZ Networking mainly VNet, Subnet, Service endpoints, Private endpoints, NSG & AZ Firewall. Helping projects teams to ensure that all the AZ Resources are communicating with managed identities, service principal & RBAC Role Understanding all data sources connectivity as a part of data ingestion from multiple sources QUALIFICATIONS Proven track record with at least 4 years of experience in DevOps data platform development Strong understanding of DevOps concepts (Azure DevOps framework and tools preferred) Solid scripting skills in languages such as Python, Bash, Javascript, or similar Solid understanding of monitoring / observability concepts and tooling Extensive experience and strong understanding of cloud and infrastructure components Strong problem-solving and analytical skills, with the ability to troubleshoot complex DevOps platform issues and provide effective solutions. Knowledge of developer tooling across the software development life cycle (task management, source code, building, deployment, operations, real-time communication) Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams and stakeholders. 4+ years of professional infrastructure and/or software development experience 3+ years of experience with AWS, GCP, Azure, or another cloud service (Azure preferred) Technology: Azure Databricks, Azure Data Factory, Microsoft SQL, Azure RBAC, Azure CICD DevOps, Azure Kubernetes. Language: Python, C#/C++/Power, Bash, YAML Thanks & Regards, Shivam Pachauri Technical Recruiter TEK Inspirations LLC | 13573 Tabasco Cat Trail, Frisco, TX 75035 E: [email protected] Linkedin: linkedin.com/in/shivam-pachauri-97b754296 Keywords: cplusplus csharp information technology Arizona Texas |
| [email protected] View All |
| 08:37 PM 07-Feb-24 |