| AWS Data Engineer with Databricks II Jersey City,NJ/Houston,TX(Local Only) at Remote, Remote, USA |
| Email: [email protected] |
|
Passport Number is Mandatory Hi, Greetings From Ampstek !! We are a Global staffing firm and we are Tier 1 vendor for all requirements and we can close positions immediately. Please review our job opening below and kindly send us the updated resume ASAP along with the details of consultants; Please add [email protected] in your distribution list Role :: AWS Data Engineer with Databricks Location :: Jersey City,NJ/Houston,TX(Local Only) Type :: Contract Responsibilities: Design, develop, and maintain efficient and scalable data pipelines on AWS using services like S3, Lambda, Glue, Redshift, and EMR. Build and optimize ETL workflows using Databricks for processing large-scale data sets. Implement data lake architectures and manage data storage for structured and unstructured data. Collaborate with data scientists, analysts, and other engineers to integrate data solutions into broader business use cases. Ensure data integrity, performance, and security across all pipelines and databases. Leverage Spark on Databricks for batch and real-time data processing. Automate data workflows and implement orchestration tools like Apache Airflow. Implement monitoring, logging, and alerting for data pipelines to ensure reliability and scalability. Troubleshoot and resolve issues related to data quality, performance, and security. Document processes, data flows, and architecture for future maintenance and scalability. Requirements: 3+ years of experience as a Data Engineer, working with AWS cloud infrastructure. Hands-on experience with Databricks for building scalable data pipelines. Proficiency in Python or Scala for data processing and pipeline development. Strong understanding of Apache Spark and distributed data processing. Experience with AWS services such as S3, Redshift, Glue, Lambda, and IAM. Familiarity with SQL/NoSQL databases and data modeling. Experience with orchestration tools like Apache Airflow or AWS Step Functions. Solid understanding of data security, privacy, and compliance best practices. Familiarity with data warehousing concepts and dimensional modeling. Excellent communication skills and the ability to work collaboratively in a team-oriented environment. Thanks, and Regards Aatmesh Kumar | Technical Recruiter Email: [email protected] Desk: +1 6093602638 Organization Name | 103 Carnegie Center Drive, Suite 300, | Princeton, NJ 08540 US Update Profile | Constant Contact Data Notice Keywords: sthree New Jersey Texas AWS Data Engineer with Databricks II Jersey City,NJ/Houston,TX(Local Only) [email protected] |
| [email protected] View All |
| 11:14 PM 03-Oct-24 |