Developer hired for this position will be working in our Data Engineering team on Data Quality capabilities for analyzing and reporting the quality of ingested data. These capabilities enable Data Owners to automate their Data Quality Management.
Data Quality capabilities consist of:
- development of tooling which allows setting up automated measurements that will support analysis of the data quality
- ingestion of data quality results (including metadata) in a common format
- reporting foundation that is used to create automated Data Quality Reporting
- Key responsibilities include:
- Support and develop Data Quality Spark application used to measure quality of ingested data
- Building new Data Quality Reporting foundation
- Work closely with DevOps, QA and Product Management teams in a Continuous Delivery environment
- Experience in Scala and Spark
- Knowledge of:
o Hadoop stack: YARN, Oozie, Hive
o SQL and RDBMS
- Hands on development experience with Jenkins or Bamboo, JIRA, Bitbucket and Git
- Ideally you also have:
- Experience in: Kubernetes and Docker
o Processing Big Data in cloud (AWS, Snowflake)
- Excellent communication skills and experience of distributed global teams
- Data driven thinking capabilities
- Experience in using Agile methods
Więcej informacji na temat Twoich danych przetwarzanych przez ASTEK Polska Sp. z o.o. znajdziesz tu: www.astek.pl/polityka-prywatnosci
Zobacz podobne oferty
LTE / 5G Baseband Physical Layer Algorithm Specialist [rekrutacja online]
Location: Wrocław Daily activities Our tribe is responsible for L1 architecture definition, specifications, algorithm development and simulations. It assumes a close interaction with L1 and SoC development units. We are looking for a...
Software Developer (based on Salesforce)
FLEETCOR is looking for an experienced developer to support and improve the existing applications and to develop new solutions based on Salesforce products for the European division of the business. You will join high skilled...
We are looking for OSM Developer to join our Digital Solutions Team. Technical Requirements: Experience with OSM development & support Experience in using Oracle OSM Understand OSM task client Experience in OSM Design Studio and...