Kafka Jobs in Chennai

Data Engineering Engineer 2

RLE India Private Limited•

Chennai

•full time

Job Summary We are seeking a skilled Data Engineering Engineer 2 to join our growing team in Chennai. This role is critical to supporting our data-driven initiatives within the Technology industry. The position requires a strong foundation in data engineering principles and a passion for building robust and scalable data pipelines. Key Responsibilities This role will focus on the design, development, and maintenance of data pipelines and infrastructure. The successful candidate will collaborate with cross-functional teams to ensure data quality, reliability, and accessibility. Required Skills & Qualifications The ideal candidate will possess a strong understanding of data engineering concepts and a proven ability to implement them in a practical setting. The following skills and qualifications are essential: Google Cloud Platform (GCP) : Demonstrated proficiency in utilizing GCP services for data storage, processing, and analysis. BigQuery : Expertise in designing and implementing BigQuery solutions for large-scale data warehousing and querying. Data Flow : Experience with Data Flow for building and managing streaming data pipelines. Dataproc : Ability to leverage Dataproc for running and managing Apache Spark and Apache Hadoop clusters. Data Fusion : Familiarity with Data Fusion for building and managing data integration pipelines. TERRAFORM : Proficiency in using TERRAFORM for infrastructure as code and automating the deployment of data infrastructure. Tekton : Experience with Tekton for building and managing CI/CD pipelines for data engineering projects. Cloud SQL : Knowledge of Cloud SQL for managing relational databases in the cloud. AIRFLOW : Experience with AIRFLOW for orchestrating and scheduling complex data workflows. POSTGRES : Familiarity with POSTGRES database management. Airflow PySpark : Ability to utilize Airflow and PySpark for data processing and transformation. Python : Strong programming skills in Python for data manipulation, scripting, and automation. API : Understanding of API integration and data exchange. Big Data : Solid understanding of Big Data concepts and technologies. Apache Kafka : Experience with Apache Kafka for building and managing real-time data streaming applications. Bachelor's Degree : A Bachelor's Degree is required. Experience Required: 4 - 4 years of experience in a data engineering role. This level of experience indicates a seasoned professional capable of independently designing and implementing complex data solutions, as well as mentoring junior team members. What We Offer Salary: (No salary provided in the input data)

Senior DevOps Engineer – Cloud Platform (AWS)

RLE India Private Limited•

Chennai

•full time

Job Summary We are seeking a highly skilled and experienced Senior DevOps Engineer to join our team in Bangalore. This role will focus on the design, implementation, and maintenance of our AWS -based cloud platform. The ideal candidate will possess a strong understanding of DevOps principles, Platform Engineering practices, and SRE methodologies, with a proven ability to build and operate robust, scalable, and secure cloud infrastructure. Key Responsibilities The Senior DevOps Engineer will be responsible for ensuring the reliability, security, and performance of our cloud platform. This includes automating infrastructure provisioning, implementing continuous integration and continuous delivery ( CI/CD ) pipelines, and proactively identifying and resolving operational issues. The role requires a deep understanding of cloud security best practices and a commitment to maintaining a secure and compliant environment. Required Skills & Qualifications DevOps : Demonstrated expertise in DevOps methodologies, including automation, continuous integration, continuous delivery, and infrastructure as code. Platform Engineering : Experience in designing and building scalable and resilient cloud platforms, with a focus on automation and self-service capabilities. SRE : Familiarity with SRE principles and practices, including monitoring, alerting, incident response, and post-mortem analysis. AWS : Extensive experience with AWS services, including EC2 , S3 , RDS , ElastiCache , Amazon EKS , MSK , Elasticsearch , and OpenSearch . Kubernetes : Proficiency in deploying and managing applications using Kubernetes . Terraform : Strong experience in infrastructure as code using Terraform . AWS CDK : Ability to utilize AWS CDK for defining and provisioning cloud infrastructure. Ansible : Experience with Ansible for configuration management and automation. Kafka : Understanding of Kafka and MSK for distributed streaming. Datadog , Prometheus , Grafana : Experience with monitoring and observability tools such as Datadog , Prometheus , and Grafana . Cloud Security : Solid understanding of Cloud Security principles, including IAM and Compliance . VPC , Subnets , Routing : Knowledge of VPC configuration, Subnets , and Routing . Security : Strong understanding of Security best practices. Analytical Skills : Ability to analyze complex data and identify trends. Problem-Solving Skills : Proven ability to troubleshoot and resolve technical issues. Communication Skills : Excellent written and verbal communication skills. Experience Required: 10 - 10 years of experience in a DevOps or related role. This level of experience indicates a senior-level expectation, requiring a candidate who can independently lead projects, mentor junior team members, and contribute to the overall DevOps strategy. What We Offer Salary:

Data Engineering Engineer 2

RLE India Private Limited•

Chennai

•full time

Job Summary We are seeking a skilled Data Engineering Engineer 2 to join our growing IT / Technology team. This role will focus on building and maintaining robust data pipelines and infrastructure. Key Responsibilities This position will be responsible for the design, development, and maintenance of data solutions. The role requires a strong understanding of data engineering principles and a commitment to delivering high-quality, scalable solutions. Required Skills & Qualifications The ideal candidate will possess a strong foundation in data engineering practices and a proven ability to work with complex data systems. The following skills and qualifications are essential: Google Cloud Platform: Demonstrated proficiency in utilizing Google Cloud Platform services for data storage, processing, and analysis. BigQuery: Expertise in querying and manipulating large datasets using BigQuery . Data Flow: Experience designing and implementing data pipelines using Data Flow . Dataproc: Ability to leverage Dataproc for distributed data processing and analytics. Data Fusion: Knowledge of Data Fusion for building and managing data integration pipelines. TERRAFORM: Proficiency in infrastructure-as-code using TERRAFORM for automating infrastructure provisioning and management. Tekton: Experience with Tekton for building and managing CI/CD pipelines. Cloud SQL: Familiarity with Cloud SQL for managing relational databases in the cloud. AIRFLOW: Strong understanding of AIRFLOW for orchestrating complex data workflows. POSTGRES: Experience with POSTGRES database management. Airflow PySpark: Ability to utilize Airflow and PySpark for data processing and transformation. Python: Strong programming skills in Python for data manipulation and automation. APIs: Experience working with APIs for data integration and exchange. Big Data: A solid understanding of Big Data concepts and technologies. Apache Kafka: Experience with Apache Kafka for real-time data streaming. Education: A Bachelor's Degree is required. Experience: A minimum of 4 - 4 years of experience in a data engineering role is expected. This level of experience indicates a seasoned professional capable of working independently and contributing significantly to complex projects. What We Offer Salary:

Software Engineer (3) - Core Senior Engineer

RLE India Private Limited•

Chennai

•full time

Job Summary We are seeking a highly skilled and experienced Software Engineer to join our core team. This is a senior-level role requiring a deep understanding of software development principles and a proven ability to design, develop, and deploy scalable and reliable applications. The ideal candidate will possess a strong background in cloud technologies and a passion for building innovative solutions. Key Responsibilities This role will be responsible for the full software development lifecycle, from design and implementation to testing and deployment. The candidate will collaborate with cross-functional teams to deliver high-quality software solutions that meet business requirements. Required Skills & Qualifications Education: A Bachelor's Degree is required. Experience: A minimum of 10 years of experience in software engineering is required. This level of experience indicates a seasoned professional capable of leading technical initiatives and mentoring junior engineers. Programming Languages: Proficiency in Java is essential. Frameworks & Technologies: Demonstrated experience with Spring Boot for building robust and scalable applications. Cloud Computing: Extensive experience with GCP (Google Cloud Platform), including Cloud Run for containerized application deployment. Containerization & Orchestration: Strong understanding of containerization technologies such as Docker and orchestration platforms like Kubernetes , GKE , and OpenShift . Experience with Helm for managing Kubernetes deployments is also required. CI/CD & DevOps: Solid experience with CI/CD pipelines, including tools like Tekton , Argo CD , and GitHub Actions . Familiarity with GitOps principles is a plus. Frontend Development: Experience with Angular for building modern user interfaces. API Development: Proven ability to design and implement REST APIs and Microservices architectures. Integration Patterns: Knowledge of Enterprise Integration Patterns for building loosely coupled and scalable systems. Data Management: Experience with relational databases such as AlloyDB and Cloud SQL for PostgreSQL . Cloud Security: Strong understanding of cloud security principles, including IAM , Service Accounts , Workload Identity Federation , Secret Manager , External Secrets , and Least-Privilege Access Controls . Container Security: Experience with Artifact Registry , Container Security , Binary Authorization , and Vulnerability Scanning . Deployment & Monitoring: Proficiency in Secure Deployment Practices , Cloud Logging , Cloud Monitoring , Prometheus , and Dynatrace/Grafana . Operational Skills: Ability to perform Root-Cause Analysis and implement effective Alerting systems. Infrastructure as Code: Experience with Terraform for managing infrastructure as code. Analytical Skills: Strong Analytical Skills for problem-solving and decision-making. Problem-Solving Skills: Excellent Problem-Solving Skills to identify and resolve complex technical challenges. Communication Skills: Effective Communication Skills for collaborating with cross-functional teams and communicating technical concepts clearly. Networking: Understanding of Application Ingress/Egress , Load Balancing , API Routing , Shared VPC , Private Service Connect , Firewall Rules , and DNS . Connectivity: Experience with Private Connectivity and Cross-Project Communication .