| Sr. Data Engineer -local to South carolina candidate at Fort Mill, South Carolina, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2963924&uid=147f0490f0b04bb595a8bfef5fb08ef8 From: varsha rawat, KEY INFOTEK [email protected] Reply to: [email protected] Role - Sr. Data Engineer Location -Fort Mill, SC (Onsite Monday to Friday) #localCandidates Visa -H1b only Key Responsibilities Analyze legacy ETL (Sqoop, Scala/PySpark) and understand extraction, transformation, and load logic. Develop and optimize PySpark ETL pipelines using AWS Glue, Glue workflows, triggers, and crawlers. Handle schema evolution, metadata management, and performance tuning in Glue/Spark. Implement data transformations (joins, filters, aggregations, cleansing) and Protegrity-based masking/tokenization. Execute data migrations, including S3-to-S3 using AWS DataSync. Contribute to CI/CD pipeline integration, Terraform IaC, and AWS services (IAM, S3, CloudWatch, Lambda, Step Functions). Document system architecture, data flows, and support pipelines in production. Required Skills Strong understanding of ETL/ELT concepts, Sqoop, Spark architecture (DAGs, RDDs, DataFrames). Hands-on experience with PySpark, AWS Glue ETL, and data catalog management. Good knowledge of SQL, RDBMS, database design, and data modeling. Experience with Git/SVN and working in Agile environments. Keywords: continuous integration continuous deployment sthree South Carolina Sr. Data Engineer -local to South carolina candidate [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2963924&uid=147f0490f0b04bb595a8bfef5fb08ef8 |
| [email protected] View All |
| 11:51 PM 02-Dec-25 |