Home

Data Engineer | Hybrid at TX or CA | Need Local only at Pleasanton, California, USA
Email: [email protected]
http://bit.ly/4ey8w48
https://jobs.nvoids.com/job_details.jsp?id=1174917&uid=

From:

Akash Mandal,

trooBell Technologies LLC.

[email protected]

Reply to: [email protected]

Hello,

Hope you are doing well,

We have an immediate opening for the below role, kindly please share best match profiles according to the role.

Role: Data Engineer

Location: Pleasanton CA or Dallas TX (2 days onsite) Locals only

Duration: 6-12 Months

Interview: Video/ Phone (One and done interview)

Need LinkedIn profile link

Notes:

Scala, big query

Familiar with Spark framework, Databricks

GCP

Marketing experience is a plus

Job Description:

We are seeking a highly skilled Senior Data Engineer to lead the migration of our data infrastructure from Snowflake to Google Cloud Platform (GCP). The ideal candidate will have extensive experience with Python or Scala, as well as a strong background in big cloud platform services, particularly GCP. Additionally, the candidate should be proficient in open-source distributed streaming platforms such as Spark and Databricks.

Responsibilities:

Work on migration of our data infrastructure from Snowflake to Google Cloud Platform (GCP)

Collaborate with cross-functional teams to assess current data architecture, identify migration requirements, and develop migration plans.

Design, develop, and implement data pipelines and ETL processes to ensure seamless data migration and integration into the GCP environment.

Utilize Python or Scala for scripting and automation tasks related to data migration and processing.

Leverage big cloud platform services offered by GCP to optimize data storage, processing, and analysis.

Develop and maintain software solutions using CI/CD practices to ensure reliability, scalability, and efficiency of data workflows.

Implement data quality checks and monitoring to ensure data accuracy and integrity..

Requirements:

Bachelor's degree in Computer Science, Engineering, or related field.

8+ years of experience in data engineering roles, with a focus on data migration and cloud platforms (is a plus)

Proficiency in Python or Scala for scripting and automation tasks.

Extensive experience with big cloud platform services, particularly Google Cloud Platform (GCP).

Strong knowledge of open-source distributed streaming platforms such as Spark and Databricks.

Experience in developing software solutions using CI/CD practices and automation tools.

Familiarity with data warehousing solutions such as Snowflake or BigQuery is a plus.

Nice to have experience in marketing data analysis and related tools or platforms.

Thanks, and Regards

Akash Mandal | Technical Recruiter

Email |
LinkedIn

trooBell Technologies LLC.

Address: 9420, River Lake Drive, Roswell, GA, 30075

Keywords: continuous integration continuous deployment California Georgia Texas
http://bit.ly/4ey8w48
https://jobs.nvoids.com/job_details.jsp?id=1174917&uid=
[email protected]
View All
08:51 PM 01-Mar-24


To remove this job post send "job_kill 1174917" as subject from [email protected] to [email protected]. Do not write anything extra in the subject line as this is a automatic system which will not work otherwise.

Pages not loading, taking too much time to load, server timeout or unavailable, or any other issues please contact admin at [email protected]


Time Taken: 18

Location: Pleasanton, California