HCL - GOOGLE BIG QUERY DATA ENGINEER - Remote CA at Remote, Remote, USA |
Email: [email protected] |
Auto req ID 1499635BR SR Number DBS-/DBS-/2024/2549522 No. of Positions 1 Skill (Primary) Data Fabric-GCP-Google BigQuery Buy Rate Vendor $68 C2C Other Requirement PLEASE SUBMIT 1 RESUME PER VENDOR ONLY POSITION: GOOGLE BIG QUERY DATA ENGINEER LOCATION: REMOTE, US Professional experience in Data Engineering using Google Big Query (GBQ) and Google Cloud Platform (GCP) data sets and building data pipelines. Hands on and deep experience working with Google Data Products (e.g. BigQuery, Dataflow, Dataproc, Dataprep, Cloud Composer, Airflow, DAG etc.). Python Programming Expert PySpark, Pandas Experience in Airflow (Create DAG, Configure the variables in Airflow, Scheduling) Big Data technologies and solutions (Spark, Hadoop, Hive, MapReduce) and multiple scripting and languages (YAML, Python). Experience in DBT to create the lineage in GCP. Optional Worked in Dev-Sec-Ops (CICD) environment. Design and develop the ETL ELT framework using BigQuery, Expertise in Big Query concepts like Nested Queries, Clustering, Partitioning, etc. Experience in Data Integration, Data Transformation, Data Quality and Data Lineage tools. Should be able to automate the data load from Big Query using APIs or scripting language. E2E Data Engineering and Lifecycle (including non-functional requirements and operations) management. E2E Solution Design skills Prototyping, Usability testing and data visualization literacy. Experience with SQL and NoSQL modern data stores. Thanks and Regards, Ankush Verma | Lead Recruiter Office: 732 485 0000 - 9086 Direct: 209-260-5752 Email: ankush@ cygnuspro.com Cygnus Professional Inc. https://www.linkedin.com/in/ankush-verma-7a1818b2/ Keywords: Idaho HCL - GOOGLE BIG QUERY DATA ENGINEER - Remote CA [email protected] |
[email protected] View All |
03:13 AM 04-Dec-24 |