Engenheiro de Dados - Híbrido

Saia na frente:

CANDIDATE-SE

Vaga ofertada por parceiro do Jobbol:
Come to one of the largest IT Services companies in the world Here you can transform your career Why join TCS? Here at TCS we believe that people make the difference, which is why we live a culture of unlimited learning full of opportunities for improvement and mutual development.
The ideal scenario to expand ideas through the right tools, contributing to our success in a collaborative environment.We are looking for Data Engineer focused on Databricks and Azure.
Required skills are even more specific, combining in-depth knowledge of the Databricks platform, Azure services, modern data architecture, and data engineering best practices.Hard Skills (Technical Skills) Programming Languages - Python (main language for data manipulation and creation of pipelines in Databricks) - SQL (for modeling, queries, and data optimization) - Scala (desirable for high performance in Spark) - Bash (for automation and administration scripts in Azure) Data Processing and ETL/ELT - Apache Spark (PySpark, Spark SQL, Delta Engine).
Distributed processing optimized for Databricks - Databricks Workflows and Jobs.
Automation of ETL pipelines and scheduled tasks - Delta Lake.
Transactional data architecture for reliable pipelines (ACID, data versioning) Azure Services for Data Engineering - Azure Data Lake Storage (ADLS Gen2).
Scalable storage for raw and transformed data - Azure Data Factory (ADF).
Orchestration of integrated ETL pipelines with Databricks - Azure Synapse Analytics.
Integration between Databricks and enterprise data warehouses - Azure Event Hubs / Azure Kafka.
Real-time data ingestion for streaming - Azure Functions & Logic Apps.
Automation of data-related tasks Data Modeling and Architecture - Data Lakehouse Architecture.
Hybrid between Data Lake and Data Warehouse (Databricks-supported architecture) Data modeling (Dimensional, Star Schema, Snowflake Schema) - SQL query optimization (indexing, caching, partitioning, Ordering) DevOps & Automation - CI/CD for Databricks (GitHub Actions, Azure DevOps, Terraform) - Monitoring and Logging.
Azure Monitor, Databricks Logging, MLflow for pipeline tracking Security, Governance and Compliance - Azure Purview (Data Catalog and Lineage) - RBAC (Role-Based Access Control) in Azure - Encryption and Masking of Sensitive Data - Implementation of Compliance Rules (GDPR, LGPD, HIPAA) What do we offer?CS Benefits Brazil:Health InsuranceDental PlanLife insuranceTransportation VoucherMeal/Food VoucherDaycare AssistanceGym workoutTCS Cares a free 0800 number that provides psychological (24 hours/day), legal, social and financial assistance to membersPartnership with SESCCertification RefundTCS Free Learning Portal Online Courses and Live TrainingOpportunity for international experienceDiscount Partnership with Universities and Language SchoolsBring Your Buddy By referring people you become eligible to receive a bonus for each hireTCS Gems Performance RecognitionXcelerate Career platform with free mentoringAt TATA Consultancy Services, we promote an inclusive culture and always work towards equity.
This applies to gender, people with disabilities, LGBTQIA+, religion, race, ethnicity, that is, all our opportunities are developed with these principles in mind.
We think about various actions for inclusion and social responsibility, in order to build a TCS that respects individuality.Be a TCSer VempraTCSRGS-9970115