Engenheiro de Dados - Remoto

Saia na frente:

CANDIDATE-SE

Vaga ofertada por parceiro do Jobbol:
About usAt Softbinator Technologies, we re driven by innovation and excellence.
As an engineer here, you ll be working on high-impact projects that challenge the status quo and push the boundaries of technology.
This is a place where you ll tackle real-world problems, collaborate with exceptionally talented engineers, and build cutting-edge solutions that have a tangible impact.Joining Softbinator means not only shaping the future of technology but also working closely with top-tier, innovative companies worldwide.
You ll have the opportunity to contribute to groundbreaking projects with global reach.What we are looking forWe re seeking a highly skilled and motivated Senior Data Engineer with Python with 5+ years of experience, who is passionate about data engineering, API development, and building scalable infrastructure.
In this role, you ll help us develop high-performance systems that power critical security workflows and insights.At the core of our mission is the use of cutting-edge technologies including AI for deduplication, contextual enrichment, and identifying root causes of vulnerabilities.
You ll contribute to building software that enables security teams to anticipate, prioritize, and proactively mitigate threats before they can be exploited.This position is ideal for someone who thrives in data-rich environments, has a strong command of Python and cloud-based systems, and is driven to build solutions that have a tangible impact in cybersecurity.With these skills, you are our perfect match5+ years of experience as a Software Engineer or similar role, with a focus on building data pipelines and infrastructure.Hands-on experience in Python programming and familiarity with data processing libraries such as Pydantic, Pandas, NumPy, and frameworks like FastAPI.3+ years of experience with MongoDB and handling large datasets (terabyte scale).Strong understanding of database systems, with experience in designing and optimizing queries.Hands-on experience with cloud platforms, particularly AWS, and familiarity with services such as S3, ECS, and SQS.Experience working with large-scale distributed systems and parallel processing frameworks.Experience with Redis and Spark.Familiarity with parallel processing frameworks.Knowledge of data security best practices.Solid understanding of data modeling concepts and techniques.Excellent problem-solving skills and attention to detail.Strong communication and collaboration skills, with the ability to work effectively in a team environment.
How you ll drive successDesign, build, and maintain scalable data pipelines and infrastructure to support the collection, processing, and analysis of large volumes of data.Develop robust ETL processes to extract, transform, and load data from various sources into our data warehouse.Optimize data processing workflows for performance, reliability, and scalability.Implement data quality monitoring and validation processes to ensure accuracy and consistency of data.Work closely with frontend software engineers to integrate data-driven features and functionalities into our products and services.Stay abreast of emerging technologies and best practices in data engineering, and propose innovative solutions to enhance our data infrastructure.