- Devising and developing solutions that capitalize on cloud-based data and distributed computing technologies to create BAMs next-gen data quality platform.
- Contribute thought-leadership through the full software development lifecycle from requirements gathering, through architecture, prototyping, development rollout and support.
- Partnering with end-users and collaborating with team members to clarify and expand upon requirements, as well as providing first-class support and guidance on best practices.
- Employing creativity and lateral thinking to engineer high-performance solutions for observing, measuring and alerting on data quality issues.
- Working within a globally-distributed yet tightly-knit engineering team, actively contributing to feature brainstorming, technical design discussions, code reviews, and overall team engagement.
- Producing software that is comprehensible, thoroughly commented, rigorously tested, and meticulously documented.
- A degree in Computer Science or a closely related field.
- Over 5 years of professional software development experience.
- A fervent desire to build robust systems.
- Profound knowledge of software engineering best practices, and the data engineering technology ecosystem.
- Experience in building complex distributed software systems, Python experience a plus but not required.
- Advanced knowledge of open-source data quality and data observability frameworks
- Intermediate or advanced knowledge of SQL and experience crafting production queries for one or more SQL database management systems.
- Familiarity with fundamental DevOps practices, including continuous integration/continuous deployment (CI/CD) and infrastructure as code.
- Experience in at least one cloud environment, with a preference for those familiar with AWS.
- A self-starter mindset, with a penchant for experimentation, a habit of asking probing questions, and the ability to thrive in a fast-paced, agile setting.
- A continuous learner, eager to gain a comprehensive understanding of large and complex systems at every level, who enjoys delving into nuanced problems, conceiving innovative solutions, and conducting thorough tests to grasp both the positive and negative outcomes Loading
Software Engineer - Warsaw, Polska - Balyasny Asset Management L.P.
Opis
LoadingSorry to interruptCSS ErrorSoftware Engineer - Data Quality Platform
LocationWarsaw
PostedPosted 12 Days Ago
CodeREQ5729
You will be a senior contributor in a small, dedicated product team tasked with expanding the core system that BAM's data analysts, data scientists, quantitative investors, and researchers depend on for measuring and detecting issues in our thousands of datasets. The platform simplifies the day-to-day activities of analysts, researchers and data engineers by supporting core data quality metrics and evaluation systems, allowing users to concentrate solely on working with data. The system exists at the epicenter of a cloud-native ecosystem heavily leveraging Kubernetes, airflow and a number of cloud data warehouse technologies.
We're on a journey bringing the platform to the next level, redesigning from the ground up with a blend of open source and internal proprietary approaches. The ideal candidate is passionate about crafting high-quality software, thrives on working with data in all its forms, focuses relentlessly on rigorous design and architecture, and possesses the drive to advance initiatives and achieve results. The ideal candidate has both deep experience as a backend software engineer and experience building upon the open-source and cloud data platform ecosystem. This team supports dozens of other teams managing thousands of datasets, so a client-obsessed mindset is critical; you don't just build the best tech but go above and beyond in helping users to get the most the systems you are building.
Responsibilities of the Software Engineer – Data Quality Platform include:
QUALIFICATIONS AND REQUIREMENTS: