Engenheiro de Dados Apache Flink - Remoto

Saia na frente:

CANDIDATE-SE

Vaga ofertada por parceiro do Jobbol:
Important Information Location: BrazilJob Mode: Full-timeWork Mode: Work from homeJob SummaryAs a Data Engineer, you will work with stream processing technologies, particularly Apache Flink and Kafka Connect.
In this role, you ll design, implement, and maintain scalable data pipelines that process real-time and batch data, enabling critical business insights and data-driven decision making.Responsibilities and DutiesDesign, develop, and optimize data pipelines using Apache Flink for stream and batch processing;Implement and maintain Kafka Connect connectors for seamless data integration;Build and maintain data infrastructure on Google Cloud Platform (GCP);Design and optimize BigQuery tables, views, and stored procedures;Collaborate with product managers and analysts to understand data requirements;Ensure data quality, reliability, and proper governance;Troubleshoot and resolve data pipeline issues;Document data flows, transformations, and architecture.
Essential SkillsExperience as a Data Engineer;Strong experience with Apache Flink, including knowledge of the DataStream and Table APIs;Experience with Kafka and Kafka Connect for data integration · Experience with containerization (Docker) and orchestration (Kubernetes);Experience in Cloud Infrastructure platforms such as AWS, GCP;Solid SQL skills with specific experience in BigQuery SQL dialect;Experience with data modeling and schema design;Proficient in at least one programming language (Java or Python);Experience with version control systems (Git) and CI/CD pipelines.Additional SkillsKnowledge and hands-on experience with Kafka Infrastructure (i.e.
managing and configuring Kafka components);Experience with other stream processing frameworks (Spark Streaming, Kafka Streams);Knowledge of data governance and security best practices · Proficiency with Google Cloud Platform services, particularly:- Google Cloud Storage;- Dataflow;- Pub/Sub;- BigQuery;Experience with Apache Airflow;Experience with BI tools such as Tableau or PowerBI · Familiarity with monitoring tools like Prometheus, Grafana;Certifications such as Google Cloud Professional Data Engineer.About EncoraEncora is the preferred digital engineering and modernization partner of some of the world s leading enterprises and digital native companies.
With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora s technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering.At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.