| OpenShift and Spark Engineer :: Charlotte, NC - Hybrid - Local at Charlotte, North Carolina, USA |
| Email: manisha.yadav@infotechspectrum.com |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2330994&uid= From: manisha, infotechspectrum manisha.yadav@infotechspectrum.com Reply to: manisha.yadav@infotechspectrum.com Hi, Job Title: OpenShift/Spark Engineer Location: Charlotte, NC- Hybrid: 3 days onsite 2 days remote Duration: 12 Months with possible extension USC or H4EAD Charlotte, NC Local with DL proof Notes Apache Spark Openshift Administration ....How does Openshift clusture works Grafana /Splunk Job description: Seeking a skilled Engineer to join our team, with expertise in RedHat OpenShift and Apache Spark. This role focuses on designing, deploying and managing scalable data processing solutions in a cloud-native environment. You will work closely with data scientists, software engineers, and DevOps team to ensure robust, high-performance data pipelines and analytics platforms. Responsibilities: Platform Management: Deploy, configure, and maintain OpenShift clusters to support containerized Spark Applications Data Pipeline Development: Design and implement large-scale data processing workflows using Apache Spark Optimization: Tune Spark jobs for performance, leveraging OpenShift's resource management capabilities(e.g., Kubernetes orchestration, auto-scaling). Integration: Integrate spark with other data sources (e.g., Kafka, s3, cloud storage) and sinks (e.g., databases, data lakes) CI/CD Implementation: Build and maintain CI/CD pipelines for deploying Spark application in OpenShift using tools like GitHub actions, Sonar, Harness. Monitoring & Troubleshooting: Monitor cluster health, Spark job performance, and resource utilization using OpenShift tools(e.g., Prometheus, Grafana) and resolve issues proactively Security: Ensure compliance with security standards, Implementing role-based access control(RBAC) and encryption for data in transit and at rest. Collaboration: Work with cross-functional teams to define requirements, Architect solutions, and support production deployments. Qualifications: Experience: 5+ years working on Apache Spark for big data processing. 3+ years of Django development experience. 2+ years of creating and maintaining conda environments. 4+ years managing containerized environments with OpenShift or Kubernetes Technical Skills: Proficiency in Spark frameworks(Python/PySpark, Scala, or Java) Hands-on experience with OpenShift administration (e.g., cluster setup, networking, storage) Proficiency in creating and maintaining conda environments and dependencies Familiarity with Docker and Kubernetes concerts(e.g., pods, deployments, services and images) Knowledge of distributed systems, cloud platforms(AWS, GCP, Azure), and data storage solutions (e.g., S3, HDFS) Programing: Strong coding skills in Python, Scala, or Java; experience with scripting is a plus. Tools: Experience with Git Actions, Helm, Harness, and CI/CD tools. Problem-Solving: Ability to debug complex issues across distributed systems and optimize resource usage. Education: Bachelor's degree in Computer Science, Engineering or related filed. Thanks & Best Regards Manisha Yadav InfoTech Spectrum Inc 2060, Walsh Ave, #120, Santa Clara, CA 95050 Email : manisha.yadav@infotechspectrum.com Web: w ww.infotechspectrum.com Keywords: continuous integration continuous deployment sthree California North Carolina OpenShift and Spark Engineer :: Charlotte, NC - Hybrid - Local manisha.yadav@infotechspectrum.com http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2330994&uid= |
| manisha.yadav@infotechspectrum.com View All |
| 03:51 AM 10-Apr-25 |