| Urgent Hiring || Big Data Engineer || Minneapolis, MN(Hybrid) || Local only at Minneapolis, Minnesota, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2010563&uid= Hi, Hope you are doing well. Job Title: Big Data Engineer Location: Minneapolis, MN(Hybrid) LOCALS ONLY Role Overview Big Data Engineer, Senior to join the Enterprise Big Data Ingestion Team within the Information Technology group. This role involves designing, developing, and supporting cloud-based data ingestion pipelines to enable robust analytics and business intelligence. The ideal candidate will have extensive experience with cloud data platforms, SQL, Python, orchestration/scheduling tools, and monitoring/observability tools. The role requires excellent communication skills, strong analytical and problem-solving abilities, and the capability to work collaboratively in a fast-paced, team-oriented environment. Responsibilities Cloud Data Platforms: Leverage Snowflake and AWS to optimize the performance, security, and scalability of data pipelines. Python Development: Develop, maintain, and optimize data processing scripts to support big data ingestion tasks, adhering to programming deadlines and improving team workflows. ELT Process Management: Assist in architecting and implementing Extract-Load-Transform (ELT) processes using tools like Fivetran HVR and AWS Lambda for efficient and accurate data integration. Data Transformation: Use Snowflake features such as tasks, streams, stored procedures, and dbt (data build tool) to model raw data into a usable format for engineers, analysts, and scientists. Business Integration: Collaborate with CHS business units to understand data needs, processes, and strategies. Documentation & Standards: Produce and maintain high-quality documentation for data ingestion pipelines to ensure clarity and transparency. Monitoring & Observability: Monitor and enhance data ingestion flows, track job statuses, and enable insights development through observability tools. Team Leadership: Mentor team members, provide guidance on best practices, and advise on data ingestion for various data formats (structured, semi-structured, unstructured). Team Culture: Foster a culture of collaboration, continuous learning, and problem-solving. Minimum Qualifications Bachelors or Graduate degree in Business Management, Information Management, Computer Science, or a related STEM field. 5+ years of experience in relevant data engineering roles. Preferred Qualifications Strong knowledge of modern, cloud-based data architectures, including Lakehouse concepts. Hands-on experience with version control systems (e.g., Git) and CI/CD workflows. Experience with ELT/ETL tools such as Fivetran HVR, AWS Glue, AWS Lambda, and Apache Airflow. Proficiency in data observability tools like Dynatrace, Datadog, Splunk, Monte Carlo, and AWS CloudWatch. Proven leadership skills, including mentoring team members and setting technical standards. Ability to work independently and thrive in a dynamic, fast-paced environment. Commitment to data and code quality, with strong analytical and problem-solving abilities. -- Thanks & Regards Uma Adhikari( US IT Recruiter) Mamsys World Email: [email protected] Disclaimer: - The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and destroy all copies of this message and any attachments. The views expressed in this E-mail message (including the enclosure/(s) or attachment/(s) if any) are those of the individual sender, except where the sender expressly, and with authority, states them to be the views of Global Application Solutions. Before opening any mail and attachments please check them for viruses. Global Application Solutions does not accept any liability for virus infected mails. -- Keywords: continuous integration continuous deployment information technology California Minnesota Urgent Hiring || Big Data Engineer || Minneapolis, MN(Hybrid) || Local only [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2010563&uid= |
| [email protected] View All |
| 02:55 AM 13-Dec-24 |