| Spark Developer at Plano, Texas, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2453034&uid=e85c153ee4ad434c93dbc0f8dba10fd8 From: Navya, Fisec Global [email protected] Reply to: [email protected] Job Title: Spark Developer with Databricks Location: Plano, TX (On-site) Need locals only Looking for candidates on our W2 Key Responsibilities: Design and develop scalable big data pipelines using Apache Spark (PySpark/Scala) and Databricks. Implement ETL processes and integrate data from various sources including structured, semi-structured, and unstructured data. Optimize Spark jobs for performance and scalability in cloud environments (e.g., Azure, AWS, GCP). Collaborate with data scientists, analysts, and stakeholders to deliver high-quality data solutions. Implement best practices in data governance, security, and compliance. Monitor and troubleshoot production jobs and workflows on Databricks. Work with Delta Lake, Unity Catalog, and other Databricks tools to manage data versioning and lineage. Develop CI/CD pipelines for data workflows using tools like Git, Jenkins, or Azure DevOps. Required Qualifications: Bachelors or Masters degree in Computer Science, Engineering, or related field. 4+ years of experience in big data development using Apache Spark. 2+ years of hands-on experience with Databricks platform. Strong proficiency in PySpark and/or Scala. Experience with cloud platforms (Azure preferred, AWS/GCP acceptable). Knowledge of Delta Lake, data lakes, data warehouse design, and streaming data. Familiarity with orchestration tools such as Airflow, Azure Data Factory, or Databricks Workflows. Proficiency in SQL and data modeling concepts. Preferred Skills: Databricks certification (e.g., Databricks Certified Data Engineer Associate/Professional). Experience with real-time data processing (Kafka, Spark Streaming). Exposure to machine learning workflows and MLflow. Experience in Agile/Scrum methodologies. Keywords: continuous integration continuous deployment wtwo Texas Spark Developer [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2453034&uid=e85c153ee4ad434c93dbc0f8dba10fd8 |
| [email protected] View All |
| 05:13 AM 23-May-25 |