| PRINCIPAL DATA PLATFORM ENGINEER - REMOTE - USC, GC Only at Remote, Remote, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=457812&uid= From: Chandrika, Absolute IT [email protected] Reply to: [email protected] Title- Principal Data Platform Engineer 100% remote Feedback from Manager: Applicant as of yet DO NOT have strong working knowledge/hands on Databricks experience - this is what he is looking for. Most have just done a POC or similar. This is an exciting opportunity for an experienced senior developer of large scale data solutions. You will join a team delivering a transformative next-gen cloud big data platform. The ideal candidate will have a proven track record in designing & implementing real-time event data streaming, SQL & NoSQL data stores and transformation pipelines for large scale organizations. We are seeking someone with deep technical skills and fully hands on in a variety of technologies to play an important role in developing and delivering early proofs of concept and production implementation. The successful candidate will have hands-on experience in a multitude of data domains; including, but not limited to; 24 x 7 x 365 enterprise and cloud database infrastructure design and management, security, database design, database development, database tuning, service delivery, incident tracking, and change management. Responsibilities Executes design sessions to gather requirements, review, approve, and communicate design artifacts with stakeholders Designing and implementing performant streaming and batch data movement pipelines using Databricks / ADF Architecting and managing various data model associated with NoSQL DBs (Azure Cosmos, Cassandra, etc) and Relational DBs (MS SQL Server, PostgreSQL etc) Ensures database features and capabilities are incorporated into data model designs to optimize performance, resiliency and scalability. Establishes database management systems, standards, guidelines and quality assurance for database deliverables, such as conceptual design, logical database, capacity planning, external data interface specification, data loading plan, data maintenance plan and security policy. Documents and communicates database design. Codes complex programs and derives logical processes on technical platforms. Delivering and presenting proofs of concept to of key technology components to project stakeholders and internal technology leaders Developing scalable and re-usable frameworks for ingestion of structured and semi-structured data Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times Working with other members of the project team to support delivery of additional project components associated with cloud data platform Perform problem-solving of application issues and production errors, including high level critical production issues that require immediate attention Perform other duties as assigned Qualifications Bachelors degree in Computer Science or Engineering required. Masters degree preferred. 7+ years of overall software development and/or database engineering experience required 3+ years of hands-on development experience with Databricks & Python 3+ years of hands-on development experience with ADF 2+ years of hands-on development experience with event based streaming technologies (Apache Kafka / Azure Event Hub or similar) 2+ years of hands-on development experience with NoSQL DBs (Cassandra / Azure Cosmos DB or similar) Strong knowledge and experience in coding Databricks python notebooks and dlt pipelines Strong knowledge and experience in data modeling & design with relational and NoSQL DBs Demonstrated expertise in performance tuning in various DB environments Experience building and scaling distributed, highly available systems in cloud env (Azure / AWS) Expertise in understanding complex business needs, analyzing, designing, and developing solutions Communication and professional skills and the ability to establish relationships across business units Experience working in a Dev/Ops environment with tools such as Microsoft Visual Studio Team Services, Chef, Puppet or Terraform Keywords: database information technology microsoft http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=457812&uid= |
| [email protected] View All |
| 01:17 AM 28-Jul-23 |