Home

Infrastructure / Platform Engineer with Apache Kafka and Flink at San Antonio, Texas, USA

Email: [email protected]

Position Infrastructure / Platform Engineer with Apache Kafka and Flink Location San Antonio, TX Duration Long-Term Contract Must Skills: Apache Kafka and Flink Job Description: Skills and Expertise: AWS Managed Services: Proficiency in AWS services such as Amazon MSK (Managed Streaming for Kafka), Amazon Kinesis, AWS Lambda, Amazon S3, Amazon EC2, Amazon RDS, Amazon VPC, and AWS IAM. Ability to manage infrastructure as code with AWS CloudFormation or Terraform. Apache Flink: Understanding of Apache Flink for real-time stream processing and batch data processing. Familiarity with Flink s integration with Kafka, or other messaging services. Experience in managing Flink clusters on AWS (using EC2, EKS, or managed services). Kafka Broker (Apache Kafka): Deep knowledge of Kafka architecture, including brokers, topics, partitions, producers, consumers, and zookeeper. Proficiency with Kafka management, monitoring, scaling, and optimization. Hands-on experience with Amazon MSK (Managed Streaming for Kafka) or self-managed Kafka clusters on EC2. DevOps & Automation: Strong experience in automating deployments and infrastructure provisioning. Familiarity with CI/CD pipelines using tools like Jenkins, GitLab, GitHub Actions, CircleCI, etc. Experience with Docker and Kubernetes, especially for containerizing and orchestrating applications in cloud environments. Programming & Scripting: Strong scripting skills in Python, Bash, or Go for automation tasks. Ability to write and maintain code for integrating data pipelines with Kafka, Flink, and other data sources. Monitoring & Performance Tuning: Knowledge of CloudWatch, Prometheus, Grafana, or similar monitoring tools to observe Kafka, Flink, and AWS service health. Expertise in optimizing real-time data pipelines for scalability, fault tolerance, and performance. Tools & Technologies: Apache Kafka (Self-managed or MSK) AWS managed Apache Flink Amazon EC2, S3, RDS, and VPC Terraform/CloudFormation Docker, Kubernetes (EKS) Elk, CloudWatch Python, Bash Please share resumes at [email protected] Keywords: continuous integration continuous deployment sthree golang Texas

[email protected] View All

09:28 PM 11-Mar-25

To remove this job post send "job_kill 2246196" as subject from [email protected] to [email protected]. Do not write anything extra in the subject line as this is a automatic system which will not work otherwise.




Pages not loading, taking too much time to load, server timeout or unavailable, or any other issues please contact admin at [email protected]


Time Taken: 9

Location: San Antonio, Texas