Home

Spark Software Engineer- San Francisco CA Onsite- USA at San Francisco, California, USA
Email: [email protected]
From:
James Smith,
Yochana Solutions
[email protected]
Reply to:   [email protected]

Job Title- Spark Software Engineer  

Location San Francisco CA Onsite- USA

Duration Long Term Contract    

We are a deeply data-driven company with data driving not only business decisions but also product features and directions. Our team is responsible for supporting one of the biggest in-house Hadoop/Spark infrastructure in Silicon Valley. We build infrastructure and tools to power thousands of AI engineers, data analytics, and software engineers within the company. We are also committed to being an early adopter and contributor to open source big data technologies, including Hadoop, Spark, and TensorFlow. We are looking for a data engineer with a focus on Hadoop and Spark to develop our Spark infrastructure and grow our Spark user groups. Your work will impact thousands of Spark users inside and outside the company.

Responsibilities:

        Prepare training material and hold technical training sessions for internal Spark users.

        Developing Spark infrastructure, Spark user libraries and tooling to make direct impact to users.

        Interact with multiple groups on a daily basis to design data solutions and promote the best Spark practices among users.

        Solve production issues related to user Spark applications.

 Basic Qualifications

        BS/MS in Computer Science or related technical discipline.

        1+ years of relevant work experience in Spark and Hadoop.

        Excellent communication and presentation skills.

        Good understanding of Spark, Hadoop, HDFS, YARN, Hive technologies.

        Good understanding of distributed storage and computing systems.

        Good understanding of programming language like Java and Scala.

        Good understanding of scripting language like and Python.

Preferred qualifications

        Good understanding in Spark Core and Spark SQL engine.

        Experience in building large scale applications with Spark SQL.

        Experience in writing, analyzing, and debugging SQL queries using Hive and Spark SQL.

        Experience with tuning large scale Spark jobs.

        Experience in working with a data format on Hadoop/Spark like Avro, Orc, and Parquet.

        Experience with Interactive Spark Notebooks (Jupyter Notebooks).

Thanks and Regards,

James Smith

Team Lead

Yochana Solutions INC

23000 Commerce Dr, Farmington hills, MI-48335

Direct No: 949-201-1313

[email protected]  || www.yochana.com

Note: This is not an unsolicited mail. If you are not interested in receiving our e-mails then please reply with subject line Remove

Keywords: artificial intelligence
[email protected]
View All
02:28 AM 18-Nov-22


To remove this job post send "job_kill 152933" as subject from [email protected] to [email protected]. Do not write anything extra in the subject line as this is a automatic system which will not work otherwise.


Your reply to [email protected] -
To       

Subject   
Message -

Your email id:

Captcha Image:
Captcha Code:


Pages not loading, taking too much time to load, server timeout or unavailable, or any other issues please contact admin at [email protected]


Time Taken: 8

Location: San Francisco, California