| Looking for Sr. Data Reliability Engineer - San Antonio, TX or Irvine, CA (Hybrid - 3 days onsite) - Contract at Irvine, Kentucky, USA |
| Email: [email protected] |
|
From: Monika, Innovyt [email protected] Reply to: [email protected] Hi, I hope you are doing well. We have an opportunity for Sr. Data Reliability Engineer with one of our clients for San Antonio, TX or Irvine, CA (Hybrid - 3 days onsite) Please see the job details below and let me know if you would be interested in this role. If interested, please send me a copy of your resume, contact details, availability, and a good time to connect with you. Job Title: - Sr. Data Reliability Engineer Location: - San Antonio, CA or Irvine, TX (Hybrid - 3 days onsite) Terms: - Contract Experience : minimum 13 years of candidate Job Details: We are currently seeking a highly skilled Data Reliability Engineer to join our team. This role requires a blend of expertise in data pipeline technologies and Site Reliability Engineering (SRE) principles to ensure the highest standards of data reliability and system performance. Qualifications: Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related field. Proven experience as a Data Engineer, Data Reliability Engineer, or in a similar role in an SRE environment. Demonstrable experience with end-to-end monitoring of data pipelines and implementing reliability in data systems. Responsibilities: Design, build, and maintain the infrastructure and data pipelines to support data transformation, data structures, metadata, dependency, and workload management. Develop and maintain scalable, reliable, and cost-effective data solutions using AWS technologies and big data tools like Databricks, Airflow, and Dremio. Implement robust monitoring and alerting systems using tools such as Datadog to ensure proactive management of the production environments. Work closely with data scientists and analytics teams to engineer and optimize data models using DBT (Data Build Tool) and ensure seamless data flow across all segments. Enhance data validation and data quality metrics integration within data pipelines to ensure accuracy and reliability of data. Automate manual processes, optimize data delivery, and re-design infrastructure for greater scalability. Handle the deployment of additional AWS services such as Lambda functions and manage data storage solutions. Collaborate with IT and DevOps teams to enhance system performance and reliability through AWS solutions such as SNS, SQS, and Elastic Load Balancer. Engage in continuous improvement efforts to enhance performance and provide increased functionality across data platforms. Provide support and mentorship to offshore teams, ensuring best practices in coding, testing, and deployment are followed. Troubleshoot complex issues across multiple databases and work with various stakeholders to ensure robust architecture and operational standards are maintained. Mandatory Skills: Strong proficiency in Apache Airflow, Python programming, and AWS cloud services. Experience with real-time monitoring tools such as Datadog. Expertise in data transformation tools like DBT and Dremio. Strong experience with Databricks and AWS Lambda. Excellent verbal and written communication skills, capable of working with cross-functional teams and managing relationships with business stakeholders. Nice to Have Skills: Familiarity with AWS services such as SNS, SQS, Elastic Load Balancer, CodeBuild, CodePipeline, ECR, and EKS. Experience with both Linux and Windows operating systems. Knowledge of Microsoft Azure Data Lake, Synapse, and additional Python scripting. Thanks Monika (Recruitment Specialist) Email: [email protected] LinkedIn- https://www.linkedin.com/in/monika-singh-7b34b5265 4417 Northdale Blvd, Tampa, FL 33624, United States Website: - http://www.innovyt.com Keywords: information technology California Florida Texas Looking for Sr. Data Reliability Engineer - San Antonio, TX or Irvine, CA (Hybrid - 3 days onsite) - Contract [email protected] |
| [email protected] View All |
| 10:21 PM 19-Sep-24 |