- Data Source Onboarding
- Data Parsing and Transformation
- Data Quality Assurance
- User Support
- Content support
- Create and maintain documentation, including configuration guides and standard operating procedures
- Bachelor's degree in Computer Science, Information Technology, or a related field
- Proficiency in Linux operating systems (e.g., CentOS, Ubuntu, Red Hat)
- Experience in CI/CD, Ansible and Gitlab
- 3+ years of Elasticsearch experience is a must
- Splunk knowledge will be nice
- Proficiency in data modeling and processing large data sets , SQL, KQL, SPL
- Relevant certifications or technology work experience (e.g., CompTIA Linux+, Red Hat, Elastic, Splunk, etc) is a plus
- Strong understanding of network protocols, security principles, and system administration best practices
- Excellent analytical and problem-solving skills, with the ability to troubleshoot and resolve complex technical issues
- Strong interpersonal and communication skills, with the ability to work effectively in a team-oriented environment
- Excellent verbal & writing skills with English is a must
- Workplace: 100% remote
- MultiSport Plus
- Group insurance
- Medicover Premium
- e-learning platform
Data Quality Engineer - Warszawa, Polska - Experis Manpower Group
Opis
Responsibilities:
o Identify, assess and support owners with new data source onboarding into the data ecosystem
o Develop and maintain efficient data pipelines for ingesting and processing diverse types of log source types (Platform, Application, Security, etc)
o Design and implement data parsing and transformation to ensure data is structured and accessible
o Collaborate with Security Analysts and Data owners to understand data requirement
o Ensure proper data quality standards and processes are maintained
o Perform data review , monitor data pipelines and resolve any data quality related issue
o Asist internal stakeholders in accessing and using data and searches more effectively
o Troubleshoot queries and provide technical support
o Provide Guidance, create and maintain content, visualization, dashboard, reports on the supported platforms
Requirements:
o Experience in both elastic ingest and Logstash pipeline building
o Elastic mapping building, ECS, etc.
o Data visualization with Kibana (lens, vega, machine learning, runtime fields, etc.)
Our offer: