| 100% Remote || Kafka Tech Admin || Long-Term Contract at Remote, Remote, USA |
| Email: pankaj@tanishasystems.com |
|
From: Pankaj, Tanishasystems.com pankaj@tanishasystems.com Reply to: pankaj@tanishasystems.com Kafka Tech Admin Location: Remote Duration: Long-Term Contract Job Responsibility The primary responsibility of the Confluent Platform Administrator will be to build, test, and maintain Kafka Cluster and its eco-system which is deployed to run Data Streaming use cases for various business units Experience Overall 5+ years of experience out of which 2+ years around Confluent Platform administration Mandatory Job Requirements Manage single and multi-node Kafka cluster deployed on VM, Docker, and Kubernetes Container platform. Experience with Confluent Platform running on-prem Perform Kafka Cluster build, including Design, Infrastructure planning, High Availability and Disaster Recovery Implementing wire encryption using SSL, authentication using SASL/LDAP & authorization using Kafka ACLs in Zookeeper, Broker/Client, Connect cluster/connectors, Schema Registry, REST API, Producers/Consumers, Ksql Perform high-level, day-to-day administration and support functions Upgrades for the Kafka Cluster landscape comprising Development, Test, Staging, and Production/DR systems Creation of key performance metrics, measuring the utilization, performance, and overall health of the cluster. Capacity planning and implementation of new/upgraded hardware and software releases as well as storage infrastructure. Research and recommend innovative ways to maintain the environment and where possible, automate key administration tasks. Ability to work with various infrastructure, administration, and development teams across business units Document and share design, build, upgrade, and standard operating procedures. Conduct knowledge transfer sessions and workshops for other members of the team. Provide technical expertise and guidance to new and junior members of the team Create topics, set Apache Kafka MirrorMaker 2, and Confluent Replicator to replicate the topics, create connect clusters, Schemas for the topics using Confluent Schema Registry Configure various Opensource and licensed Kafka Source/Sink Connectors such as KafkaConnect for SAP HANA, Debezium Oracle and MySQL Connectors, Confluent JDBC source/sink, Confluent ADLS2 Sink connector, and Confluent Oracle CDC source connector... Develop and maintain Unix scripts to perform day-to-day Kafka Admin and Security functions using Confluent REST Proxy server Setting up monitoring tools such as Prometheus, and Grafana to scrape metrics from various Kafkacluster components (Broker, Zookeeper, Connect, REST proxy, Mirror Maker, Schema Registry ...) and other endpoints such as web servers, databases, logs, etc., and configure alerts for KafkaCluster and supporting infrastructure to measure availability and performance SLAs Experience with Confluent ksql to query and process Kafka streams Knowledge of Kafka Producer and Consumer APIs, Kafka Stream Processing, Confluent Ksql Availability to work in shifts, extended hours and to provide on-call support as required. There will be work over weekends at times depending on the project's needs. Must have excellent communication and interpersonal skills Preferred but Optional skills Linux (SLES or RHEL) system administration (basic or advanced), creating scripts. Working experience on docker and Kubernetes clusters (opensource, Rancher, RedHat OCP, VMWare Tanzu) involving administration of containers (Operator level skills), deployments, updates, integration with products running outside of the cluster Working knowledge of container registries such as Harbor, Quay, Nexus, etc. Exposure to Container/artifact scanners such as Trivy, Claire Security-related config for above listed software or any other tools in SSL for wire encryption, integration with AD for authentication, and RBAC for authorizations Implemented and supported any enterprise product such as any well-known ERP products, Data warehouse, Middleware, etc. Database administration skills in Oracle, MSSQL, SAP HANA, DB2, Aerospike, and Postgres. Exposure to SaaS-based observability platforms like New Relic Deployment of container images and pods using CI/CD pipelines using Jenkins or comparable tools. Experience in building Kafka deployment pipelines using Terraform, Ansible, Cloud formation templates, s, etc. Worked in Public cloud environments such as Azure AWS or GCP, preferably in Azure. Pankaj Kumar Tanisha Systems Inc An ISO-Certified Company Phone: 732-384-4465 Email: pankaj@tanishasystems.com Address: 99 Wood Ave South, Suite#308 Iselin, NJ 08830 Keywords: continuous integration continuous deployment active directory New Jersey 100% Remote || Kafka Tech Admin || Long-Term Contract pankaj@tanishasystems.com |
| pankaj@tanishasystems.com View All |
| 03:13 PM 04-May-24 |