| Big Data Engineer (10+ Years) at Phoenix, Arizona, USA |
| Email: [email protected] |
|
Job Title: Big Data Engineer (10+ Years) Location: Phoenix,AZ (Locals ONLY) Duration: Long Term Job Description: We are looking for an experienced Data Engineer with 10+ years of hands-on experience to join our dynamic team. The ideal candidate will have a strong foundation in Python, SQL, and Big Data technologies, with a particular emphasis on Apache Airflow. This is an exciting opportunity to work with cutting-edge technologies and build robust data pipelines, optimize workflows, and support scalable data infrastructure. Key Responsibilities: Design, develop, and maintain scalable and efficient data pipelines to support large-scale data processing. Collaborate with cross-functional teams to understand data requirements and develop solutions that ensure the accuracy and integrity of data. Build, manage, and optimize workflows using Apache Airflow for automating data pipelines. Develop and maintain ETL processes for data ingestion, transformation, and loading. Write and optimize SQL queries for querying and manipulating large datasets. Work with Big Data technologies and platforms (e.g., Hadoop, Spark, Kafka, etc.) to process and manage data at scale. Ensure high data quality, performance, and reliability in data processes. Troubleshoot and resolve issues related to data systems and workflows. Maintain and optimize cloud infrastructure for data storage, processing, and analysis. Stay up-to-date with industry trends and technologies to propose new solutions and improvements. Preferred Skills: Experience with data warehousing solutions (e.g., Redshift, Snowflake, BigQuery). Familiarity with data modeling and data lakes. Experience with containerization technologies like Docker and Kubernetes. Please share resumes at [email protected] Keywords: Arizona |
| [email protected] View All |
| 08:31 PM 03-Mar-25 |