| Job for---Big Data Engineer with GCP Cloud ----Phoenix, AZ- Onsite at Phoenix, Arizona, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=3350992&uid=9dbe5a52bbf847908cefeddd0f6b28d3 Your Email Title JD: BigData ,Python and Py Spark , GCP Big Data /Hadoop , Hive , Python , Spark, PySpark, SQL "Develop and maintain data pipelines using BigData processes Focus on ingesting, storing, processing, and analyzing large datasets Required skills and qualifications: Design, develop, and maintain scalable ETL/ELT pipelines using PySpark, Airflow, and GCP-native tools. Build and optimize data warehouses and analytics solutions in BigQuery. Implement and manage workflow orchestration with Airflow/Cloud Composer. Write complex SQL queries for data transformations, analytics, and performance optimization. Ensure data reliability, security, and governance across pipelines. Conduct performance tuning and cost optimization of BigQuery and PySpark workloads. Collaborate with analysts and product teams to deliver reliable data solutions. Troubleshoot, debug, and resolve production issues in large-scale data pipelines. Contribute to best practices, reusable frameworks, and automation for data engineering.5+ years of experience within Data Engineering/ Data Warehousing using Big Data technologies will be a addon Expert on Distributed ecosystem Hands-on experience with programming using Python Expert on Hadoop and Spark Architecture and its working principle Hands-on experience on writing and understanding complex SQL(Hive/PySpark-dataframes), optimizing joins while processing huge amount of data Experience in UNIX scripting Ability to design and develop optimized Data pipelines for batch and real time data processing Should have experience in analysis, design, development, testing, and implementation of system applications Demonstrated ability to develop and document technical and functional specifications and analyze software and system processing flows." Role Descriptions: Develop and maintain data pipelines using BigData processesFocus on ingesting| storing| processing| and analyzing large datasetsRequired skills and qualificationsDesign| develop| and maintain scalable ETLELT pipelines using PySpark| Airflow| and GCP-native tools.Build and optimize data warehouses and analytics solutions in BigQuery.Implement and manage workflow orchestration with AirflowCloud Composer.Write complex SQL queries for data transformations| analytics| and performance optimization.Ensure data reliability| security| and governance across pipelines.Conduct performance tuning and cost optimization of BigQuery and PySpark workloads.Collaborate with analysts and product teams to deliver reliable data solutions.Troubleshoot| debug| and resolve production issues in large-scale data pipelines.Contribute to best practices| reusable frameworks| and automation for data engineering.5 years of experience within Data Engineering Data Warehousing using Big Data technologies will be a addon Expert on Distributed ecosystem Hands-on experience with programming using PythonExpert on Hadoop and Spark Architecture and its working principle Hands-on experience on writing and understanding complex SQL(HivePySpark-dataframes)|optimizing joins while processing huge amount of data Experience in UNIX scripting Ability to design and develop optimized Data pipelines for batch and real time data processing Should have experience in analysis| design| development| testing| and implementation of system applicationsDemonstrated ability to develop and document technical and functional specifications and analyze software and system processing flows. Essential Skills: Develop and maintain data pipelines using BigData processesFocus on ingesting| storing| processing| and analyzing large datasetsRequired skills and qualificationsDesign| develop| and maintain scalable ETLELT pipelines using PySpark| Airflow| and GCP-native tools.Build and optimize data warehouses and analytics solutions in BigQuery.Implement and manage workflow orchestration with AirflowCloud Composer.Write complex SQL queries for data transformations| analytics| and performance optimization.Ensure data reliability| security| and governance across pipelines.Conduct performance tuning and cost optimization of BigQuery and PySpark workloads.Collaborate with analysts and product teams to deliver reliable data solutions.Troubleshoot| debug| and resolve production issues in large-scale data pipelines.Contribute to best practices| reusable frameworks| and automation for data engineering.5 years of experience within Data Engineering Data Warehousing using Big Data technologies will be a addon Expert on Distributed ecosystem Hands-on experience with programming using PythonExpert on Hadoop and Spark Architecture and its working principle Hands-on experience on writing and understanding complex SQL(HivePySpark-dataframes)|optimizing joins while processing huge amount of data Experience in UNIX scripting Ability to design and develop optimized Data pipelines for batch and real time data processing Should have experience in analysis| design| development| testing| and implementation of system applicationsDemonstrated ability to develop and document technical and functional specifications and analyze software and system processing flows. Desirable Skills: Keyword: Skills: Digital : BigData and Hadoop Ecosystems Experience Required: Rama Kant Tiwari Account Manager Email: [email protected] Note: This email and any attachments are confidential and may contain privileged information intended solely for the use of the individual or entity to which they are addressed. If you have received this email in error, please notify the sender immediately, delete the email and any attachments from your system, and take appropriate measures to ensure the confidentiality of the sensitive information contained herein. Any disclosure, copying, or distribution of this message or taking any action based on it by you is strictly prohibited. Keywords: information technology Job for---Big Data Engineer with GCP Cloud ----Phoenix, AZ- Onsite [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=3350992&uid=9dbe5a52bbf847908cefeddd0f6b28d3 |
| [email protected] View All |
| 11:29 AM 06-May-26 |