| Spark Data Engineer,Non locals are fine but need to relocate from day 1 of Joining (No H4 and L2 in case of relocation) 3 Days onsite Hybrid at Charlotte, North Carolina, USA |
| Email: mainsh.gupta@tekinspirations.com |
|
https://shorturl.at/zCvmO https://jobs.nvoids.com/job_details.jsp?id=2266150&uid= From: Mainsh gupta, Tek Inspirastions LLC mainsh.gupta@tekinspirations.com Reply to: mainsh.gupta@tekinspirations.com Job Description - Role: Spark Data Engineer Location: Charlotte, NC Non locals are fine but need to relocate from day 1 of Joining (No H4 and L2 in case of relocation) 3 Days onsite Hybrid LinkedIn id is must (Should not been created recently, at least 6 Years old in case of senior candidates) Job Description: We are seeking an experienced Senior Spark Data Engineer with over 10 years of experience in big data technologies and data engineering. The ideal candidate will have a deep understanding of Apache Spark and its ecosystem, along with strong skills in data modeling, ETL processes, and data warehousing. You will work closely with data scientists, analysts, and other stakeholders to design, build, and maintain scalable data pipelines that support our data-driven decision-making processes. Requirements: Bachelors or Masters degree in Computer Science, Information Technology, or a related field. 10+ years of experience in data engineering, with a strong focus on Apache Spark and big data technologies. Proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL). Experience with NoSQL databases (e.g., MongoDB, Cassandra) is a plus. Strong programming skills in languages such as Scala, Java, or Python. Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and related services (e.g., AWS EMR, Azure Databricks). Experience with data warehousing solutions (e.g., Snowflake, Redshift) is preferred. Knowledge of data visualization tools (e.g., Tableau, Power BI) is a plus. Strong analytical and problem-solving skills. Excellent communication and collaboration abilities. Responsibilities: Design and implement efficient data pipelines using Apache Spark for processing large volumes of data. Collaborate with data architects and data scientists to understand data requirements and translate them into technical specifications. Develop and optimize ETL processes to ensure data quality and reliability. Perform data modeling and design data architectures that meet business needs. Maintain and enhance existing data processing systems and frameworks. Monitor and troubleshoot data pipeline performance and implement necessary optimizations. Ensure data governance and compliance with industry standards and regulations. Document processes, architectures, and data flows for better collaboration and knowledge sharing. Mentor junior data engineers and contribute to team skill development. It would be great if you also had: Experience with data streaming technologies (e.g., Apache Kafka, Apache Flink). Familiarity with containerization technologies (Docker, Kubernetes) and orchestration tools. Understanding of machine learning concepts and frameworks (e.g., MLlib). Knowledge of Agile methodologies and experience with Agile project management tools. Keywords: business intelligence information technology Idaho North Carolina Spark Data Engineer,Non locals are fine but need to relocate from day 1 of Joining (No H4 and L2 in case of relocation) 3 Days onsite Hybrid mainsh.gupta@tekinspirations.com https://shorturl.at/zCvmO https://jobs.nvoids.com/job_details.jsp?id=2266150&uid= |
| mainsh.gupta@tekinspirations.com View All |
| 01:07 AM 19-Mar-25 |