Big Data Engineer - AWS Python, Malvern PA at Malvern, Alabama, USA |
Email: [email protected] |
From: vishal, sibitalent [email protected] Reply to: [email protected] Big Data Engineer - AWS/Python Location: Hybrid/onsite in Malvern PA Duration: 1 year Interview Mode: 1 teams interview Response Requirements: Linkedin Profile Contact Information Mobile # not google voice number and no marketing email Job Description: Must haves: * Proficiency in Python programming * Strong expertise in SQL, Presto, HIVE, and Spark * Knowledge of trading and investment data * Experience in big data technologies such as Spark and developing distributed computing applications using PySpark * Experience with libraries for data manipulation and analysis, such as Pandas, Polars and NumPy Understanding of data pipelines, ETL processes, and data warehousing concepts * Strong experience in building and orchestrating data pipelines * Experience in building APIs Write, maintain, and execute automated unit tests using Python * Follow Test-Driven Development (TDD) practices in all stages of software development * Extensive experience with key AWS services/components including EMR, Lambda, Glue ETL, Step * Functions, S3, ECS, Kinesis, IAM, RDS PostgreSQL, Dynamodb, Timeseries database, CloudWatch Events/Event Bridge, Athena, SNS, SQS, and VPC Keywords: sthree Pennsylvania Big Data Engineer - AWS Python, Malvern PA [email protected] |
[email protected] View All |
09:36 PM 17-Jan-25 |