| HCL - Senior Technical Lead - Data Engineer (Python) - Remote at Remote, Remote, USA |
| Email: [email protected] |
|
Auto req ID | 1532817BR | SR Number | DBS-/DBS-/2025/2601290 | Experience | 11-15 Years | Skill (Primary) | Technical Skills (ERS)-VLSI-Verification Languages-PYTHON | Buy Rate Vendor | $52/hr. C2C | Other Requirement | Position Details | SR Number | DBS-/DBS-/2025/2601290 | Job Location/Client Location (with City & State) | Minnesota, USA | Remote ok (Yes / No) | Yes | Project Duration | 6+ months | Project Start date | Asap | Buy Rate | $52/hr. C2C | Exclusive to HCLTech(Y/N) | Y | Mode (TP/FTE) | TP | No of openings/positions | 1 | Job Title/Role | Data Engineer | Mandatory Skills | Python, Pyspark and SQL | No | Job Description | Develop, optimize, and maintain ETL/ELT pipelines using PySpark and SQL. Work with structured and unstructured data to build scalable data solutions. Write efficient and scalable PySpark scripts for data transformation and processing. Optimize SQL queries, stored procedures, and indexing strategies to enhance performance. Design and implement data models, schemas, and partitioning strategies for large-scale datasets. Collaborate with Data Scientists, Analysts, and other Engineers to integrate data workflows. Ensure data quality, validation, and consistency in data pipelines. Implement error handling, logging, and monitoring for data pipelines. Work with cloud platforms (AWS, Azure, or GCP) for data processing and storage. Optimize data pipelines for cost efficiency and performance. Technical Skills Required: Strong experience in Python for data engineering tasks. Proficiency in PySpark for large-scale data processing. Deep understanding of SQL (Joins, Window Functions, CTEs, Query Optimization). Experience in ETL/ELT development using Spark and SQL. Experience with cloud data services (AWS Glue, Databricks, Azure Synapse, GCP BigQuery). Familiarity with orchestration tools (Airflow, Apache Oozie). Experience with data warehousing (Snowflake, Redshift, BigQuery). Understanding of performance tuning in PySpark and SQL. Familiarity with version control (Git) and CI/CD pipelines. | Senior Technical Lead - Python Development Job Summary As a Senior Technical Lead specializing in Python development, you will play a key role in managing complex projects and providing technical direction to a team of developers. Your expertise will be instrumental in enhancing the team's capabilities, ensuring the successful delivery of high-quality solutions, and optimizing performance through best practices. (1.) Key Responsibilities 1. Provide Technical Guidance In Python Development And Automation Frameworks, Enhancing Team Capabilities And Driving Productivity Through Mentorship And Knowledge Sharing. 2. Conduct Comprehensive Code Reviews And Implement Performance Optimization Techniques Using Python Flask And Pytest, Ensuring Adherence To Quality Assurance Processes And Coding Standards For Successful Project Delivery. 3. Ensure Process Compliance Within The Assigned Module By Participating In Technical Discussions And Reviews As A Consultant, Supporting Feasibility Studies, Evaluating Technical Alternatives, And Identifying Technical Risks. 4. Collaborate With Stakeholders To Define Project Scope, Objectives, And Deliverables, And Prepare And Submit Status Reports To Minimize Risks And Facilitate Prompt Resolution Of Escalations. Skill Requirements 1. Expert Proficiency In Python, With A Strong Understanding Of Python Flask For Web Application Development And Python Pytest For Automated Testing. 2. Solid Expertise In Sap Automation And Associated Testing Tools, Ensuring Efficient Test Automation Processes. 3. Strong Understanding Of Quality Assurance Methodologies And Best Practices In Software Development. 4. Excellent Communication Skills For Effective Collaboration With Stakeholders And Team Members. Certification 1. Relevant Certifications In Python Development And Testing Tools Are Optional But Valuable, Such As Certified Python Developer Or Istqb Certification In Software Testing. About Cygnus Professionals, Inc. Cygnus is a Princeton, NJ-headquartered global Business IT consulting and software Services firm with offices in the USA and Asia. Cygnus offers and enables innovation and helps our clients accelerate time to market & grow their business. Over 15 years, we have taken great pride in continuing our deep relationships with our clients. For further information about CYGNUS, please visit our website www.cygnuspro.com Cygnus Belief We believe in our commitment to diversity & inclusion. Equal Employment Opportunity Statement Cygnus is an Equal Opportunity Employer. We ensure that no one should be discriminated against because of their differences, such as age, disability, ethnicity, gender, gender identity and expression, religion, or sexual orientation. All our employment decisions are taken without looking into age, race, creed, color, religion, sex, nationality, disability status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status, or any other aspects of employment protected by federal, state, or local law. Applicants for employment in the US must have work authorization & Cygnus does not offer any sponsorship of a visa for employment authorization in the United States. Thanks and Regards, Ankush Verma | Lead Recruiter Email: ankush@ cygnuspro.com Cygnus Professional Inc. https://www.linkedin.com/in/ankush-verma-7a1818b2/ Keywords: continuous integration continuous deployment information technology Idaho New Jersey HCL - Senior Technical Lead - Data Engineer (Python) - Remote [email protected] |
| [email protected] View All |
| 08:41 PM 04-Mar-25 |