Kafka Engineer/developer(100%Remote)

Posted 1 month ago

Job Title:  Kafka Engineer/developer

Duration: Long term Contract

Location: 100%Remote

The role is for a Kafka engineer, with hands on development and not administration.  Kafka (Confluent Kafka, MSK) working with Debezium is a MUST

Job Description :

  • Expertise in Kafka brokers, zookeepers, Kafka connect, schema registry, KSQL, Rest proxy, Replicator. Both Confluent and Apache Kafka.
  • Solid understanding of Kafka architecture, how to save Kafka space.
  • Hands on and Working knowledge of Apache Kafka, AWS MSK, Linux/Unix systems.
  • Kafka (Confluent Kafka, MSK) working with Debezium
  • Use automation tools like provisioning using Docker, Jenkins and GitLab.
  • Hands on commands usage of Kafka and all components.
  • Ability to perform data related benchmarking, performance analysis and tuning.
  • Solid knowledge of monitoring tools and fine-tuning alerts on Splunk, Prometheus, Grafana, Splunk.
  • Setting up security on Kafka (Setting different security mechanism in Kafka).
  • Manage Kafka users and topics.
  • Monitor, prevent and troubleshoot security related issues.
  • Good skills in Database Design, Data Integration.
  • Good knowledge of big data ecosystem to design and develop capabilities to deliver solutions using CI/CD pipelines

 

Nice to have

  • Skilled experience in writing and troubleshooting Python/PySpark scripts to generate extracts, cleanse, conform and deliver data for consumption.
  • Strong working knowledge of the AWS Data analytics eco-system such as AWS Glue, S3, Athena, SQS etc.
  • Good understanding of other AWS services such as CloudWatch monitoring, scheduling, and automation services

Shaik Abdul Rahmaan | US IT Recruiter
Supreme Sourcing Skills
Desk: 669-222-2042 Ext: 126
Email:  srahman@supremesourcingskills.com