| 100% remote Opportunity || Principal Data Engineer with Azure Databricks || Contract at Remote, Remote, USA |
| Email: [email protected] |
|
From: Saumya Singh, Tanisha Systems [email protected] Reply to: [email protected] Minimum 15+ Years Candidates Only. Principal Data Engineer with Azure Databricks 100% remote Opportunity Contract Job descriptions: We operate in an Azure + Databricks Lakehouse. Well need a person with: Azure experience ADF for orchestration, ADLS for storage, Azure DevOps for CI/CD Databricks experience all compute/ETL leverages Databricks and is programmed leveraging Spark (PySpark, Spark SQL) Power experience this is our scripting language of choice. SQL proficiency its used everywhere (TSQL, PostgreSQL) Proficiency with parquet and delta formats Additionally they will need experience in: SDLC + CI/CD we follow a standard deployment process (dev, test, prod) that includes peer reviewed code. They need to be comfortable with standard DevOps practices. Should have a deep understanding of indexes and partitioning. Should be proficient optimizing code for performance (able to read a DAG, determine where CBO is using most resources) Should be proficient in writing code in a matter that it can run repeatedly and produce the same state (we have a custom SQL Deployment framework) Best Regards, Saumya Singh | Sr. Technical Recruiter Tanisha Systems Inc. Email : [email protected] Direct: 732-369-9497 Address: 99 Wood Ave South, Suite # 308, Iselin, NJ 08830 Keywords: continuous integration continuous deployment information technology New Jersey 100% remote Opportunity || Principal Data Engineer with Azure Databricks || Contract [email protected] |
| [email protected] View All |
| 06:26 AM 15-May-24 |