| Data Engineer Location: Sunnyvale, CA - Hybrid Experience : 11+ at Sunnyvale, California, USA |
| Email: [email protected] |
|
Job Title: Data Engineer Location: Sunnyvale, CA - Hybrid Experience: 11+ Job Description: We are seeking a skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have extensive experience with Hadoop, Spark, and Hive, and a strong background in data processing and analytics. As a Data Engineer, you will be responsible for designing, developing, and maintaining our big data infrastructure, ensuring efficient data processing and analysis. Responsibilities: - Design and develop scalable and robust data pipelines using Hadoop, Spark, and Hive. - Optimize and maintain existing data workflows and processes. - Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions. - Implement data ingestion, transformation, and storage solutions. - Ensure data quality and integrity through rigorous testing and validation. - Monitor and troubleshoot data processing systems to ensure high availability and performance. - Stay up-to-date with the latest industry trends and technologies in big data and analytics. Requirements: - Bachelors degree in Computer Science, Information Technology, or a related field. - 3+ years of experience in data engineering or a similar role. - Proficiency in Hadoop ecosystem technologies (HDFS, MapReduce, YARN). - Strong experience with Apache Spark for data processing. - Expertise in Hive, including HiveQL and performance optimization. - Solid understanding of data modeling, ETL processes, and data warehousing concepts. - Experience with scripting languages such as Python or Scala. - Familiarity with cloud platforms (AWS, Azure, or Google Cloud) is a plus. - Excellent problem-solving skills and attention to detail. - Strong communication and collaboration skills. Preferred Qualifications: - Masters degree in Computer Science, Data Engineering, or a related -- Keywords: information technology California Data Engineer Location: Sunnyvale, CA - Hybrid Experience : 11+ [email protected] |
| [email protected] View All |
| 01:29 AM 13-Jun-24 |