| Data Engineer at Remote, Remote, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=537214&uid= From: Randhir kumar, Global Applications Solution [email protected] Reply to: [email protected] Job Description: Job Title: Data Engineer Job Type: Contract Duration: 09 Months Location: USA (Remote) Responsibilities: Job Description: The Data Engineer is a critical role responsible for designing, developing, and maintaining data pipelines and infrastructure that enable efficient data processing, storage, and retrieval. This role involves working with large volumes of data from various sources, ensuring data quality, and creating scalable solutions to support data-driven decision-making within the organization. The Data Engineer collaborates with cross-functional teams to understand data needs and implement solutions that enable data analysis and reporting. Responsibilities: Data Pipeline Development: Design and implement data pipelines to extract, transform, and load (ETL) data from various sources into data warehouses or data lakes. Develop efficient and scalable ETL processes to ensure data quality, consistency, and accuracy. Data Modeling and Architecture: Design and implement data models that support the organization's analytical and reporting requirements. Work with data architects to ensure proper data structure and architecture for optimal performance. Data Integration: Integrate data from different sources, including databases, APIs, and external systems. Collaborate with application developers to embed data integration processes into applications. Data Storage and Management: Implement and manage data storage solutions, such as relational databases, NoSQL databases, and data lakes. Optimize data storage for performance, scalability, and cost-effectiveness. Data Transformation: Develop data transformation processes to cleanse, enrich, and transform raw data into usable formats. Utilize scripting and programming languages (e.g., Python, Java, Scala) to perform data transformations. Data Quality and Governance: Implement data quality checks and validation to ensure the accuracy and integrity of data. Contribute to data governance initiatives by adhering to data security and privacy standards. Performance Optimization: Monitor and optimize data processing and query performance to ensure fast and efficient data retrieval. Identify and address bottlenecks in data pipelines to improve overall system performance. Collaboration and Communication: Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions. Communicate technical concepts and solutions to non-technical stakeholders effectively. Version Control and Documentation: Maintain version control for data pipelines and codebase. Document data engineering processes, workflows, and data lineage. Qualifications: Bachelor's or Master's degree in Computer Science, Software Engineering, Information Technology, or a related field. Strong proficiency in programming languages such as Python, Java, Scala, or similar. Experience with data processing frameworks like Apache Spark, Apache Kafka, or similar. Proficiency in SQL for querying and manipulation of data. Knowledge of data modeling concepts and techniques. Experience with ETL tools and data integration techniques. Familiarity with data storage technologies such as relational databases (e.g., PostgreSQL, MySQL), NoSQL databases (e.g., MongoDB, Cassandra), and data lakes (e.g., AWS S3, Hadoop HDFS). Understanding of cloud platforms (e.g., AWS, Azure, GCP) and related data services. Strong problem-solving skills and attention to detail. Ability to work in a collaborative team environment. Excellent communication skills to work with technical and non-technical stakeholders. The Data Engineer role involves designing, developing, and maintaining the data infrastructure necessary for effective data processing, integration, and storage, playing a key role in enabling data-driven decision-making within the organization. Thanks, and Regards, Randhir kumar Business Unit Head Global Applications Solution LLC(USA) Email : [email protected] LinkedIn - https://www.linkedin.com/in/randhir-kumar-4001b78b/ Keywords: sthree http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=537214&uid= |
| [email protected] View All |
| 02:39 AM 17-Aug-23 |