| ETL / Spark Developer at Remote, Remote, USA |
| Email: [email protected] |
|
Processing description: http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=1147393&uid= Hello, Hope you are doing well...!!! My name is Nikhil and I represent Virtual Networx Inc., a staff augmentation firm providing a wide-range of talent on-demand and Contingent workforce solutions. We have excellent domain expertise in all verticals. Repositioning professionals is what we do, and we do it very well. We have an immediate job opportunity with our premier client. Below is the job description and if you feel you are suitable for this role, please share you updated profile to ( [email protected]) Share Profiles to [email protected] Role : ETL / Spark Developer Location : McLean, VA (Onsite / Hybrid) Duration : Full-Time / Contract Experience : 10+ Job Description: Your expertise in Python, Pyspark, ETL processes, CI/CD (Jenkins or GitHub), and experience with both streaming and batch workflows will be essential in ensuring the efficient flow and processing of data to support our clients. Collaborate with cross-functional teams to understand data requirements and design robust data architecture solutions. Implement ETL processes to extract, transform, and load data from various sources. Ensure data quality, integrity, and consistency throughout the ETL pipeline. Utilize your expertise in Python and Pyspark to develop efficient data processing and analysis scripts. Optimize code for performance and scalability, keeping up to date with the latest industry best practices. Integrate data from different systems and sources to provide a unified view for analytical purposes. Collaborate with data analysts to implement solutions that meet their data integration needs. Design and implement streaming workflows using Pyspark Streaming or other relevant technologies. Develop batch processing workflows for large-scale data processing and analysis. Keywords: continuous integration continuous deployment information technology Virginia http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=1147393&uid= |
| [email protected] View All |
| 10:27 PM 22-Feb-24 |