- BI technology within the lake infrastructure
- Establish a stable, state-of-the-art technology base with on-prem and cloud solutions
- Set up data lake as single data and analytics hub and effectively ingest most important data sources
- Establish data quality and metadata management
- Provide Data Marts and sandboxes for segments and functions with the most important combination of data sources Commerzbank AG Commerzbank is a leading international commercial bank with branches and offices in almost 50 countries.
Senior Data Engineer - Łódź, Polska - Commerzbank Ag
Opis
Senior Data Engineer - Big Data Miejsce pracy: Łódź Technologies we use Expected Python SQL Terraform Scala About the project As a Senior Data Engineer you will work in the team that is responsible for all cross-cutting cloud/Hadoop topics in the Big Data & Advanced Analytics key area.
You will be in charge of cloud and data engineering in the cloud migration and development of cloud-native applications, mentoring others in technical concepts and implementing best practices for our Cloud-based data ingestion solutions.
Furthermore, in your role you will be responsible for the investigation, preparation and migration of our Products from our On-Premise infrastructure to the Cloud native (GCP and Azure).
A dynamic and representative working environment in a collegial atmosphere and attractive benefits ensure that you feel at home from the start.
Cloud Data Development:
Design and develop cloud-based data storage solutions using Google Cloud Platform services such as Cloud Composer, Dataproc, Dataflow and Pub/Sub Build and maintain data pipelines to ensure data accuracy, consistency, and real-time processing Optimize data infrastructure for performance, scalability and reliability Infrastructure as Code (Ia C): Utilize Terraform to create and manage cloud resources efficiently Implement CI/CD pipelines for automated deployment and continuous integration Microservices and
API:
Work with microservices architecture and design APIs for seamless data integration Scripting and Testing: Proficient in Python and SQL for ETL processes, schema evolution pipeline development and performance tuning Develop, test, and deploy solutions using Dataproc, Dataflow, and
Cloud Functions Scala Expertise:
Leverage Scala for Dataproc pipeline development, enhancement and performance tuning This is how we organize our work This is how we work agile This is how we work on a project Continuous Deployment Continuous Integration What we offer Friendly and multicultural environment 26 days of holiday from the very beginning Benefits private medical care sharing the costs of professional training & courses life insurance remote work opportunities flexible working time integration events corporate sports team retirement pension plan preferential loans no dress code video games at work coffee / tea leisure zone pre-paid cards redeployment package employee referral program extra leave Multisport - personal & professional development program Employee Assistance Program (psychological support)
E-learning platform:
O'Reilly, library, tutorials The Big Data cluster is the enabler for data scientists and provides a huge collection of data and a data science workbench in one place.
We are leaving the traditional bank behind us and are choosing to move forward as a digital enterprise.
This is exactly why we need talented people who will join us on this journey.
We work in inter-locational and international teamwork in agile methodologies.
Please add the following clause to your application: 1.
I consent to the processing of personal data contained in this document by Commerzbank AG with its registered office in Frankfurt am Main, Germany, 60261 Kaiserplatz, operating through the Branch in Poland with its registered office in Łódź, Łódź, ul.
Wersalska 6, KRS , for the implementation of the current recruitment process and for the future recruitment for a period of 6 months, in accordance with the Regulation of the European Parliament and of the Council (EU) 2016/679 of 27 April 2016 on the protection of individuals with regard to the processing of personal data the free flow of such data and the repeal of Directive 95/46 / EC (RODO) and in accordance with the Act of 10 May 2018 on the protection of personal data (Journal of Laws of 2018, item 1000).
I have the right to withdraw this consent at any time.
The withdrawal of consent shall not affect the lawfulness of processing based on consent before its withdrawal.
2.
I have read the content of the information clause, including information about the purpose and methods of processing personal data and the right to access to my personal data and about the right to correct, rectify and delete it.
INFORMATION CLAUSE FOR A CANDIDATE Pursuant to Article of the General Data Protection Regulation of 27 April 2016 (hereinafter referred to as GDPR), I inform that: Your personal data are controlled by Commerzbank AG with its registered office in Frankfurt am Main, Germany, 60261 Kaiserplatz, acting through a Branch in Poland with its registered office in Łódź, Łódź, ul.
Wersalska 6, KRS ; Your personal data will be processed for the purpose of carrying out the recruitment process pursuant to Article 6(1)(c) of GDPR and pursuant to Article 6(1)(a) of GDPR; Your personal data may be made available to other recipients, such as entities processing personal data on behalf of the Data Controller and other entities involved in the process of Data Controller's business activity organisation, such as banks and courier companies, postal operators, Social Insurance Institution [ZUS], tax offices and other entities entitled under the rules of the law; The personal data provided by you will be - based on your consent - transferred to a third country: the United States of America, for which the European Commission has not issued a decision confirming the appropriate level of protection specified in art.
Your data will be protected in a third country by: Standard data protection clauses approved by the European Commission / [supervisory authority] binding corporate rules an approved code of conduct combined with enforceable data recipient's commitments to appropriate safeguards.
administrative contract / arrangement approved by the supervisory authority.
The recipient of your personal data in the abovementioned the third country is Breezy HR, Inc
; Address:
1534 Oak Street, Suite 301; Jacksonville, FL 32204 Your personal data will be stored during the recruitment process and to the extent to which personal data are processed pursuant to the consent granted, until a withdrawal of such consent; You have the right to access your personal data as well as the right to rectify, erase (so-called right to be forgotten), restrict the processing of data, the right to data portability, the right to object to processing, the right to withdraw consent at any time without affecting the lawfulness of processing based on consent before its withdrawal; If you believe that the processing of your personal data is in breach of the provisions of the General Data Protection Regulation of 27 April 2016, you shall have the right to file a complaint to a supervisory authority responsible for the protection of personal data – Chairman of Data Protection Office; To the extent provided for in Article 221 of the Polish Labour Code, the provision of your personal data constitutes a statutory requirement, the non-fulfilment of which renders it impossible to conclude and continue the employment relationship, whereas the provision of personal data subject to consent to their processing, is voluntary; Your personal data will not be processed by automated means, including through profiling.