| AWS DATA Engineer with Python, PySpark :: Location: TCS - Pittsburgh, PA, Erie, PA at Erie, Pennsylvania, USA |
| Email: [email protected] |
|
Only H1B Candidates! Role name: AWS DATA Engineer with Python, PySpark Role Description: Extensive experience with AWS services: EMR, S3, Redshift, Glue, Lambda, Step Functions, DynamoDB, RDS, Athena, EventBridge, API Gateway, and SNS. Expert in ETL concepts, with a strong background in AWS Glue and data pipeline orchestration. Strong experience with PySpark and Kafka for building data streams and batch processing systems. In-depth knowledge of data partitioning and Parquet files for efficient data storage and querying. Strong experience with SQL, including writing complex queries, and working with databases like Redshift and Snowflake. Proficiency in DevOps concepts, with hands-on experience in CI/CD pipelines, Docker, and Terraform. Excellent understanding of data lake, data warehouse, and data lake house concepts. Proven experience leading teams, mentoring engineers, and managing end-to-end technical implementations. Experience working with Redshift Spectrum and Athena for querying large-scale data. Understanding of security best practices for cloud data solutions, including IAM roles and policies. Familiarity with data governance, compliance, and data quality frameworks Competencies:Agile Way of Working, Digital : Python, Digital : Amazon Web Service(AWS) Cloud Computing, Digital : PySpark Experience (Years):10 & Above Essential Skills:AWS services: EMR, S3, Redshift, Glue, Lambda, Step Functions, DynamoDB, RDS, Athena, EventBridge, API Gateway, and SNS, data pipeline, Python, PySpark, Kafka, CI/CD pipelines, Docker, Terraform. Desirable Skills:AWS services: EMR, S3, Redshift, Glue, Lambda, Step Functions, DynamoDB, RDS, Athena, EventBridge, API Gateway, and SNS, data pipeline, Python, PySpark, Kafka, CI/CD pipelines, Docker, Terraform. Country:United States Branch | City | Location:TCS - Pittsburgh, PA, Erie, PA -- Ashutosh Mishra | Executive Talent Acquisition linkedin.com/in/ashutosh-mishra-allahabadi Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd 2838 E. Long Lake Road Suite 210, Troy, MI 48085 D : +1 2143909326, ashutosh.m @twsol.com www.teamwaresolutions.net Disclaimer This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to which they are addressed. If you have received this email in error please notify the system manager. This message contains confidential information and is intended only for the individual named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited. -- Keywords: continuous integration continuous deployment sthree information technology Michigan Pennsylvania AWS DATA Engineer with Python, PySpark :: Location: TCS - Pittsburgh, PA, Erie, PA [email protected] |
| [email protected] View All |
| 06:47 PM 27-Feb-25 |