Position: Sr. Data Engineer, Location: Remote, only 10+ years profiles at Remote, Remote, USA |
Email: [email protected] |
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=1089636&uid= Position: Sr. Data Engineer, Location: Remote, only 10+ years profiles Hi Partner, Hope you are doing well. Please let me know if you have anyone for the below position: Position: Sr. Data Engineer Location: Remote D Hi Partner, Hope you are doing well. Please let me know if you have anyone for the below position: Position: Sr. Data Engineer Location: Remote Duration: 12+ months Job Description: Key skills - Python, SQL (expert level), Spark and Scala (intermediate). Expertise: 1. 8+ years of relevant industry experience with a BS/Masters 2. Experience with distributed processing technologies and frameworks, such as Hadoop, Spark, Kafka, and distributed storage systems (e.g., HDFS, S3) 3. Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions 4. Expertise with ETL schedulers such as Apache Airflow, Luigi, Oozie, AWS Glue or similar frameworks 5. Solid understanding of data warehousing concepts and hands-on experience with relational databases (e.g., PostgreSQL, MySQL) and columnar databases (e.g., Redshift, BigQuery, HBase, Click House) 6. Excellent written and verbal communication skills Responsibilities: 1. Design, build, and maintain robust and efficient data pipelines that collect, process, and store data from various sources, including user interactions, financial details, and external data feeds. 2. Develop data models that enable the efficient analysis and manipulation of data for merchandising optimization. Ensure data quality, consistency, and accuracy. 3. Build scalable data pipelines (SparkSQL & Scala) leveraging Airflow scheduler/executor framework 4. Collaborate with cross-functional teams, including Data Scientists, Product Managers, and Software Engineers, to define data requirements, and deliver data solutions that drive merchandising and sales improvements. 5. Contribute to the broader Data Engineering community at Airbnb to influence tooling and standards to improve culture and productivity 6. Improve code and data quality by leveraging and contributing to internal tools to automatically detect and mitigate issues. Thanks & Regards, Nitin Sachdeva XL Impex Inc dba Atika Technologies 1 Clyde Road Suite 201 Somerset NJ 08873 Email: [email protected] 2024 XL Impex Inc dba Atika Technologies | 1 Clyde Road Suite 201 Somerset NJ 08873 Web Version Preferences Forward Powered by Mad Mimi A GoDaddy company Keywords: sthree New Jersey http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=1089636&uid= |
[email protected] View All |
09:15 PM 06-Feb-24 |