| Local to AZ: - Bigdata Engineer with GCP at Phoenix, Arizona, USA |
| Email: [email protected] |
|
Hi, Good Morning Hope you all are doing well !!! Please share your interest and resume at [email protected]. Hope you not submitted your resume to IMPETUS Client. Visa :: OPT EAD , H1B, H4EAD , USC Only Not workable :: GC and GC EAD Candidate. Rate for Genuine exp and Visa Candidates only Junior $50/hr 7-9 Years Senior $55-58/hr for 11+ years Role :: Bigdata Engineer with GCP Location :: Phoenix, AZ. Only Locals Long :: term contract Job Description: We are looking for a Big Data Engineer with expertise in Google Cloud Platform (GCP) to design, develop, and optimize large-scale data processing systems. The ideal candidate will have experience working with GCP data services, big data frameworks, and data pipeline orchestration to drive scalable and efficient data solutions. Key Responsibilities: Design, develop, and maintain end-to-end data pipelines on GCP. Work with BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, and other GCP services for data processing. Optimize data storage, retrieval, and transformation processes for scalability and performance. Develop and maintain ETL/ELT pipelines using Apache Spark, Apache Beam, or Cloud Data Fusion. Ensure data quality, governance, and security within the cloud environment. Collaborate with data scientists, analysts, and application teams to deliver data-driven solutions. Automate data workflows and orchestration using Cloud Composer (Apache Airflow). Implement real-time data streaming solutions using Pub/Sub, Kafka, or similar tools. Monitor and troubleshoot data pipelines to ensure reliability and performance. Work with Terraform, CloudFormation, or Infrastructure as Code (IaC) for environment setup and automation. Required Skills & Qualifications: 10+ years of experience in Big Data Engineering with a focus on GCP. Hands-on experience with Google Cloud BigQuery, Dataflow, Dataproc, Cloud Composer (Airflow), and Pub/Sub. Strong programming skills in Python, Java, or Scala. Experience with SQL, NoSQL databases, and data warehousing concepts. Expertise in Apache Spark, Apache Beam, or Hadoop ecosystems. Familiarity with real-time data processing and streaming technologies. Knowledge of CI/CD, DevOps practices, and Infrastructure as Code (IaC). Strong understanding of data governance, security, and compliance best practices. Experience with Terraform, Kubernetes, or Docker is a plus. GCP certification (e.g., Professional Data Engineer) is a plus. Preferred Qualifications: Experience working with multi-cloud or hybrid cloud environments. Familiarity with machine learning workflows and MLOps. Experience integrating GCP services with third-party tools and API -- Keywords: continuous integration continuous deployment information technology green card Arizona Local to AZ: - Bigdata Engineer with GCP [email protected] |
| [email protected] View All |
| 10:37 PM 07-Feb-25 |