| Lead Data Engineer// Malvern PA// NO NO CPT at Malvern, Alabama, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2303376&uid= Job Title: Lead Data Engineer Location (Hybrid/ Onsite/ Remote): Malvern, PA (Hybrid - 3 days a week onsite Duration: Contract-to-Hire (C2H) Interview Mode: Video Role Type: Contract-to-Hire Number of Submissions Required: 1 What Needed for Submission: Candidate resume (4-5 pages long) LinkedIn profile Specify if the candidate is currently on your companys W2 or not Responsibilities: Provide expert-level data solutions by using software to process, store, and serve data to others. Test data quality and optimize data availability. Ensure that data pipelines are scalable, repeatable, and secure. Required Skills: At least 11+ years of relevant experience at a lead level. Proficiency in Python programming. Strong expertise in SQL, Presto, HIVE, and Spark. Knowledge of trading and investment data. Experience in big data technologies such as Spark and developing distributed computing applications using PySpark. Experience with libraries for data manipulation and analysis, such as Pandas, Polars, and NumPy. Understanding of data pipelines, ETL processes, and data warehousing concepts. Strong experience in building and orchestrating data pipelines. Experience in building APIs, writing, maintaining, and executing automated unit tests using Python. Follow Test-Driven Development (TDD) practices in all stages of software development. Extensive experience with key AWS services/components including EMR, Lambda, Glue ETL, Step Functions, S3, ECS, Kinesis, IAM, RDS PostgreSQL, DynamoDB, Timeseries database, CloudWatch Events/Event Bridge, Athena, SNS, SQS, and VPC. Proficiency in developing serverless architectures using AWS services. Experience with both relational and NoSQL databases. Skills in designing and implementing data models, including normalization, denormalization, and schema design. Knowledge of data warehousing solutions like Amazon Redshift. Strong analytical skills with the ability to troubleshoot data issues. Good understanding of source control, unit testing, test-driven development, and CI/CD. Ability to write clean, maintainable code and comprehend code written by others. Strong communication skills. Proficiency in data visualization tools and ability to create visual representations of data, particularly using Tableau. -- Mike Lead Technical Recruiter [email protected] Max IT Consulting LLC A : 25 Oak Tavern Cir Branchburg, New Jersey - 08876 -- Keywords: continuous integration continuous deployment sthree information technology wtwo Pennsylvania Lead Data Engineer// Malvern PA// NO NO CPT [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2303376&uid= |
| [email protected] View All |
| 06:55 PM 01-Apr-25 |