- Build our next-generation data platform tooling and servicesto support the ingestion and processing of billions of documents at scale.
- Improve and extend our Spark based distributed data processing pipeline.
- Improve and extend our Rust based distributed query engine used to request large amounts of document data.
- Create tools to automate and optimize processes across disciplines
- Actively participate in the on-call schedule to investigate and fix production issues related to our data processing pipeline or query engine.
- Participate in code reviews for projects written by your team
- Focus on quality through comprehensive unit and integration testing
- 4+ years of software development experience in writing performant, commercial-grade systems and applications
- Experience with monitoring and troubleshooting production environments
- Proficiency in programming languages used in high volume data processing and applications like Java or Scala and Python
- Experience building data pipelines with distributed compute frameworks like Hadoop. Spark, orDask
- Knowledge of Linux/Unix systems, Docker/Kubernetes and CI/CD including scripting in Python or other scripting languages to automate build and deployment processes
- Knowledge of professional software engineering practices & software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
- Leverages best practices and past experiences to mentor and improve the productivity of the team
- Deep experience building and debugging distributed data pipelines
- Experience with columnar databases and storage formats like Delta Lake and Parquet
- Experience deploying and managing services on Kubernetes
- Experience building with Rust
- If you don't meet 100% of the above qualifications, you should still seriously consider applying.
- Comprehensive health plan
- Flexible work arrangements
- Two, week-long company breaks per year
- Unlimited time off
- Long-term incentive program
- Training investment program
-
Data Engineer
Znalezione w: Adzuna PL C2 - 5 dni temu
DCV Technologies centrum, Katowice, Polska W pełnym wymiarze godzinOur client, is a world-leading digital payments network that removes barriers and connects people. · We're urgently seeking a Data Engineer · Remote, Poland · Salary range up to USD /day · In addition to creating and maintaining an optimal pipeline architecture, typical duties a ...
-
Mid Senior DevOps Engineer
Znalezione w: Adzuna PL C2 - 3 dni temu
Reply Polska Sp. z o. o. Katowice, PolskaResponsibilities · Using powerful and state-of-the-art open-source and cloud technologies work on scalable, cost-effective, and flexible solutions for our customers. · Build and deploy infrastructure and applications for complex data projects. · Engage with innovative topics such ...
-
Software Engineer
Znalezione w: Adzuna PL C2 - 4 dni temu
Reply Polska Sp. z o. o. Katowice, Polska W pełnym wymiarze godzinResponsibilities · As part of our team, you help our customers. successfully design and implement complex solution architectures for mission-critical data analysis and real-time applications. · Using powerful and state-of-the-art open-source and cloud technologies work on scalabl ...
-
Data Engineer
Znalezione w: Talent PL Premium - 5 dni temu
Vaillant Group Katowice, PolskaWHAT YOU WILL DO · You are part of a growing agile community creating the data backbone for the digital future of Vaillant. · As a member of a newly build team, you support the development and operation of a data hub and corresponding data interfaces and loads. · You are respons ...
-
Mid+ Senior Data Engineer Python AWS Terraform
Znalezione w: Adzuna PL C2 - 5 dni temu
Capco Poland -, Katowice, Polska W pełnym wymiarze godzinCAPCO POLAND · *We are looking for Poland based candidate. The job is remote but may require some business trips. · Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to #BeYourselfAtWork. We celebrate individ ...
-
software engineer
Znalezione w: Talent PL Premium - 6 dni temu
Data Reply Katowice, PolskaAs part of our team, you help our customers. successfully design and implement complex solution architectures for mission-critical data analysis and real-time applications. · Using powerful and state-of-the-art open source and cloud technologies work on scalable, cost-effecti ...
-
machine learning
Znalezione w: Talent PL Premium - 6 dni temu
Data Reply Katowice, PolskaSupport our clients during the successful development and implementation of complex solutions for Data Analytics and Machine learning applications. · Through the power of distributed open source and cloud technologies , provide scalable, cost efficient and flexible solutions f ...
-
mid/ senior devops engineer
Znalezione w: Talent PL Premium - 6 dni temu
Data Reply Katowice, PolskaUsing powerful and state-of-the-art open source and cloud technologies work on scalable, cost-effective and flexible solutions for our customers. · Build and deploy infrastructure and applications for complex data projects. · Engage with innovative topics such as artificial ...
-
Data Engineer
Znalezione w: Adzuna PL C2 - 4 dni temu
HCLTech Katowice, Polska W pełnym wymiarze godzinBuild high quality data products on our Azure Paas data platform · At HCL, we are growing our Data & Analytics footprint. As our new data engineer you will collaborate with product owners, architects and other key profiles across the global organisation. You will help business ve ...
-
Senior Java Engineer
Znalezione w: Talent PL Premium - 4 dni temu
WomenTech Network Katowice, PolskaAre you looking for a hybrid or remote work opportunity? Are you interested in a workplace that allows for flexibility in your day? Are you ready for a workplace that provides benefits that suit your needs?Join our team as we innovate the future of data platform architecture, ena ...
-
big data engineer
Znalezione w: Talent PL Premium - 6 dni temu
Machine Learning Reply Katowice, PolskaSupport the successful implementation of customer products related to Big Data, Data Engineering , and/or Data Warehouses. · Build and maintain scalable Data Platforms and Datalakes on Cloud or on-premise , considering DevOps paradigms. · Build and maintain data-intensive a ...
-
non-functional testing engineer
Znalezione w: Talent PL Premium - 6 dni temu
Nexi Digital Katowice, PolskaManage and follow non functional QA methodology on our FinTech Platform based on Openshift, · Cooperate closely with the architects and devops for any infrastructure change, · Design, create, plan and execute non functional tests on preproduction environments · Documents resul ...
-
Data Engineer
Znalezione w: Talent PL Premium - 5 dni temu
ComeOn Group Katowice, PolskaComeOn Group in short · Founded in 2008, ComeOn Group is a leading global player in the rapidly growing iGaming market. Having launched its first online brand in 2010, ComeOn Group is running a wide range of exciting brands across multiple markets. Managing a multi brand portfoli ...
Senior Big Data Engineer with Java Scala - Aleja Pokoju , Kraków, Polska - Relativity
Opis
We work hybrid: 2 times a week in our Krakow office or 4 times a year for employees from other cities.
Overview
Are you looking for a hybrid or remote work opportunity? Are you interested in a workplace that allows for flexibility in your day? Are you ready for a workplace that provides benefits that suit your needs?
Join our team as we innovate the future of data platform architecture, enabling massive scaling and data processing for ML and Gen AI projects. You'll be at the forefront of processing vast unstructured data, building high-throughput APIs, and supporting distributed compute frameworks for seamless model deployment. Ready to dive into the heart of cutting-edge tech?
Your role in action:
Your Skills:
We'd particularly love it if you have:
Relativity is a diverse workplace with different skills and life experiences—and we love and celebrate those differences. We believe that employees are happiest when they're empowered to be their full, authentic selves, regardless how you identify.
Benefit Highlights:
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, or national origin, disability or protected veteran status, or any other legally protected basis, in accordance with applicable law.