| Urgent Need for AWS Data Lake Engineer at REMOTE (Dallas, TX) at Dallas, Texas, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=238787&uid= From: Sudhir, Techgene Solutions, LLC [email protected] Reply to: [email protected] Hi, We have an Urgent requirement for AWS Data Lake Engineer at REMOTE (Dallas, TX). The below mentioned job description. Kindly forward me your contact details for further process at [email protected]. Position: AWS Data Lake Engineer Location: REMOTE (Dallas, TX) Duration: Long Term NO OPT NEED PP NUMBER or RECENT i94 JOB DESCRIPTION: What the ideal candidate looks like: AWS, Data Lake, Databricks, Spark, Pyspark, Java 5+ years of experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient and distributed data pipelines High Proficiency in at least two of Scala, Python, Spark or Flink applied to large scale data sets. Strong understanding of workflow management platforms (Airflow or similar). Familiarity with advanced SQL. Expertise with big data technologies (Spark, Flink, Data Lake, Presto, Hive, Apache Beam, NoSQL, ...). Knowledge of batch and streaming data processing techniques. Obsession for service observability, instrumentation, monitoring and alerting. Understanding of the Data Lifecycle Management process to collect, access, use, store, transfer, delete data. Strong knowledge of AWS or similar cloud platforms. Expertise with CI/CD tools (CircleCI, Jenkins or similar) to automate building, testing and deployment of data pipelines and to manage the infrastructure (Pulumi, Terraform or CloudFormation). Understanding of relational databases (e.g., MySQL, PostgreSQL), NoSQL databases (e.g., key-value stores like Redis, DynamoDB, RocksDB), and Search Engines (e.g., Elasticsearch). Ability to decide, based on the use case, when to use one over the other Keywords: continuous integration continuous deployment http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=238787&uid= |
| [email protected] View All |
| 09:30 PM 28-Dec-22 |