| Need of Data Engineer (Python & UNIX) at Hartford, CT - Need locals at Hartford, Connecticut, USA |
| Email: [email protected] |
|
From: Lokesh, Siri Info Solutions Inc [email protected] Reply to: [email protected] Hello , My Name is Lokesh . I am reaching out to you today because we have your resume in our database and wanted to check if you are currently available in the market actively looking for an opportunity. Please see the below mentioned requirement and I believe you would be a good match for the role. I would appreciate if you could respond with your updated resume along with the good time to speak so we can move forward with the process. Job title: Data Engineer (Python & UNIX) location: Hartford, CT Need locals (day one onsite) Key Responsibilities: Design, implement, and maintain scalable data pipelines to collect, process, and store data from various sources. Develop and optimize Python scripts for data extraction, transformation, and loading (ETL). Collaborate with data scientists, analysts, and other stakeholders to ensure data is accessible and in the proper format for analysis and reporting. Work with large datasets, ensuring their integrity, consistency, and availability. Leverage UNIX/Linux tools and scripting (e.g., , Bash) for data processing and automation tasks. Create and maintain efficient database architectures and data storage solutions (SQL and NoSQL). Monitor, troubleshoot, and optimize data pipeline performance to ensure data availability and quality. Perform data validation, ensure the accuracy of datasets, and implement data cleaning processes. Develop and implement data models for reporting and analytics purposes. Build and maintain APIs for data access, both internally and externally. Ensure the security and compliance of data handling processes. Automate repetitive tasks using Python and scripting to streamline operations and improve efficiency. Collaborate with cross-functional teams to support business intelligence (BI), reporting, and analytics needs. Participate in code reviews, and ensure adherence to best practices and data governance standards. Required Skills and Qualifications: Bachelor s degree in Computer Science, Engineering, Mathematics, or a related field (or equivalent experience). Proven experience in data engineering, working with large-scale data processing and ETL pipelines. Strong proficiency in Python for data engineering tasks, including libraries such as Pandas, NumPy, and PySpark. Experience with UNIX/Linux systems and scripting (Bash, , etc.). Familiarity with relational databases (e.g., MySQL, PostgreSQL, SQL Server) and NoSQL databases (e.g., MongoDB, Cassandra). Strong knowledge of data transformation, data integration, and cleaning techniques. Experience with big data tools and frameworks (e.g., Apache Hadoop, Apache Spark) is a plus. Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and services like S3, Redshift, or BigQuery. Knowledge of data warehousing concepts and tools. Experience with version control systems (e.g., Git). Strong problem-solving skills with the ability to work with complex datasets and resolve data-related issues. Good communication skills, with the ability to collaborate with cross-functional teams. BEST REGARDS LOKESH Technical Recruiter Siri InfoSolutions Inc., MWBE Certified E-Mail [email protected] Keywords: access management business intelligence sthree Connecticut Need of Data Engineer (Python & UNIX) at Hartford, CT - Need locals [email protected] |
| [email protected] View All |
| 12:49 AM 06-Dec-24 |